site overloads Post: 302575765

Sponsored Content

Contact Us Post Here to Contact Site Administrators and Moderators site overloads Post 302575765 by Neo on Tuesday 22nd of November 2011 09:40:44 PM

11-22-2011

Administrator

The "guests" you are seeing are not Googlebot. Only "mods" can see spiders, for example, just now:

Quote:

MSNBot(2), Google AdSense(64), Google(79), Collective Media(4), Lycos, Yahoo! Slurp(2)

Googlebot was over 100 yesterday and it was "sucking" really hard (can see in the access.log file).

I think the issue might be related to our site map "update" for posts, which is annually, and it might be "that time a year again" and Googlebot is hitting us hard, which is "a good thing" but we need to reset the crawl rate in webmaster tools since we don't have the spare CPU for both peak time guests and a hundred Googlebot spiders pulling hard.

On the other hand, we are definitely behind in our server hardware upgrade. We like to have the server need a forum admin just in case of a major failure; and currently the server is in Ireland where reborg is; but he has been a but too busy at work in the past year to "do the upgrade deed". He has indicated recently he would be "back in action" soon.

This User Gave Thanks to Neo For This Post:

Neo

View Public Profile for Neo

Visit Neo's homepage!

Find all posts by Neo

5 More Discussions You Might Find Interesting

1. IP Networking

port access to site to site VPN

Setup a site to site VPN between two cisco routers. One of the site locations is unable to access ports such as https://example.com:9001 How do I let them go into port 9001? They can ssh, ftp, telnet and everything else. Is this a VPN issue or ACL access issue? I put permit ip host...

2. IP Networking

How to establish site to site vpn - Linux machine and cisco asa?

Hi, I am trying to establish vpn between my linux server and cisco asa at client side. I installed openswan on my cent os. Linux Server eth0 - 182.2.29.10 Gateway - 182.2.29.1 eth1 - 192.9.200.75 I have simple IPtables Like WAN="eth0" LAN="eth1"

3. IP Networking

Does cisco 1921 router support site to site VPNs using IPSec?

Q: "Does Cisco 1921 router support,, act as an endpoint for, site to site VPNs using IPSec? If so, how many? " A: If you get the Cisco 1921/k9 with the security services bundle then it will have built in security features. Cisco, typically includes IP Sec tunnels I believe as part of that...

4. IP Networking

IPSec Openswan Site to Site VPN - Big Pain

Hi @all, I try to connect 2 LANs with IPSec/Openswan LAN 1: 192.168.0.0/24 LAN 2: 192.168.1.0/24 This is my Config: conn HomeVPN # # Left security gateway, subnet behind it, nexthop toward right. left=192.168.1.29 ...

5. What is on Your Mind?

Is this site for me?

Hello, I am new here and my name is Robert. I was actually looking for a forums website where I can go with questions regarding Linux and embedded Linux applications. I am fairly new (6 months) to the world of Linux and embedded Linux applications and the the learning curve is steep. When I am not...

5 More Discussions You Might Find Interesting

1. IP Networking

port access to site to site VPN

Discussion started by: photon

2. IP Networking

How to establish site to site vpn - Linux machine and cisco asa?

Discussion started by: ashokvpp

3. IP Networking

Does cisco 1921 router support site to site VPNs using IPSec?

Discussion started by: Ayaerlee

4. IP Networking

IPSec Openswan Site to Site VPN - Big Pain

Discussion started by: bahnhasser83

5. What is on Your Mind?

Is this site for me?

Discussion started by: Circuits