site overloads


 
Thread Tools Search this Thread
Contact Us Post Here to Contact Site Administrators and Moderators site overloads
# 1  
Old 11-22-2011
site overloads

I suspect it has less to do with server problems and more to do with the 3,500 3,700 3,800 unidentified "guests". Are we being DDOSed?
# 2  
Old 11-22-2011
No, it is Googlebot mostly..... we have changed our webmaster tools setting to slow down the crawl rate on the site. Hopefully, that will help!
# 3  
Old 11-22-2011
That's all Google? With 3,800 search instances, it might as well be a DDOS attack Smilie

It's not any better. 30 tries and counting to submit this reply.

---------- Post updated at 01:56 PM ---------- Previous update was at 01:54 PM ----------

The number of googlebot "guests" has increased to nearly 3,000.
# 4  
Old 11-22-2011
The "guests" you are seeing are not Googlebot. Only "mods" can see spiders, for example, just now:

Quote:
MSNBot(2), Google AdSense(64), Google(79), Collective Media(4), Lycos, Yahoo! Slurp(2)
Googlebot was over 100 yesterday and it was "sucking" really hard (can see in the access.log file).

I think the issue might be related to our site map "update" for posts, which is annually, and it might be "that time a year again" and Googlebot is hitting us hard, which is "a good thing" but we need to reset the crawl rate in webmaster tools since we don't have the spare CPU for both peak time guests and a hundred Googlebot spiders pulling hard.

On the other hand, we are definitely behind in our server hardware upgrade. We like to have the server need a forum admin just in case of a major failure; and currently the server is in Ireland where reborg is; but he has been a but too busy at work in the past year to "do the upgrade deed". He has indicated recently he would be "back in action" soon.
This User Gave Thanks to Neo For This Post:
# 5  
Old 11-23-2011
Site behavior returned mostly to normal shortly after I had to try 30 times to make a post above. Your work seems to have stabilized it after all. Smilie
# 6  
Old 11-23-2011
Yah... we instructed Googlebot to reduce its load on the site.... seems to have worked as you noticed. Thanks.
# 7  
Old 11-23-2011
... hahaha.. and it does not "hurt" that traffic is going down as we enter into the US Thanksgiving Holiday and following weekend....
Login or Register to Ask a Question

Previous Thread | Next Thread

5 More Discussions You Might Find Interesting

1. What is on Your Mind?

Is this site for me?

Hello, I am new here and my name is Robert. I was actually looking for a forums website where I can go with questions regarding Linux and embedded Linux applications. I am fairly new (6 months) to the world of Linux and embedded Linux applications and the the learning curve is steep. When I am not... (13 Replies)
Discussion started by: Circuits
13 Replies

2. IP Networking

IPSec Openswan Site to Site VPN - Big Pain

Hi @all, I try to connect 2 LANs with IPSec/Openswan LAN 1: 192.168.0.0/24 LAN 2: 192.168.1.0/24 This is my Config: conn HomeVPN # # Left security gateway, subnet behind it, nexthop toward right. left=192.168.1.29 ... (1 Reply)
Discussion started by: bahnhasser83
1 Replies

3. IP Networking

Does cisco 1921 router support site to site VPNs using IPSec?

Q: "Does Cisco 1921 router support,, act as an endpoint for, site to site VPNs using IPSec? If so, how many? " A: If you get the Cisco 1921/k9 with the security services bundle then it will have built in security features. Cisco, typically includes IP Sec tunnels I believe as part of that... (0 Replies)
Discussion started by: Ayaerlee
0 Replies

4. IP Networking

How to establish site to site vpn - Linux machine and cisco asa?

Hi, I am trying to establish vpn between my linux server and cisco asa at client side. I installed openswan on my cent os. Linux Server eth0 - 182.2.29.10 Gateway - 182.2.29.1 eth1 - 192.9.200.75 I have simple IPtables Like WAN="eth0" LAN="eth1" (0 Replies)
Discussion started by: ashokvpp
0 Replies

5. IP Networking

port access to site to site VPN

Setup a site to site VPN between two cisco routers. One of the site locations is unable to access ports such as https://example.com:9001 How do I let them go into port 9001? They can ssh, ftp, telnet and everything else. Is this a VPN issue or ACL access issue? I put permit ip host... (0 Replies)
Discussion started by: photon
0 Replies
Login or Register to Ask a Question