Google Bot

[lee]

Is there anything amiss with these figures? I dont ever recall Google sucking up so much?!

Name ----->Hits--------Bandwidth---Last Visit

Googlebot 39,026+417 1.27 GB 17 Apr 2013 - 09:56

<SNIP out lots of others>

MSNBot 439+31 34.60 MB 17 Apr 2013 - 08:26
Yahoo Slurp 339+2 9.47 MB 16 Apr 2013 - 20:49
Alexa (IA Archiver) 80+34 3.78 MB 17 Apr 2013 - 09:30
MSNBot-media 43+47 1.58 MB 16 Apr 2013 - 01:57

Is that genuine or perhaps an error? The website has about 1250 pages.

 

[tifosi]

Wouldn't be surprised. I've noticed a massive increase on bandwidth usage in the last month on our coldplaying site. So much so that we though we were being ddos'ed for a while. When we checked the logs the ips were google, bing etc.

The bandwidth usage was over twice normal. We had to put a limiter on them in the end. It was like they'd forgotten it was an old site and started blasting is like it was new again. weird.

 

[lee]

. It was like they'd forgotten it was an old site and started blasting is like it was new again. weird.

Intersting quote. I had pointed a traffic laden site to this one for 48hrs before reverting back and it seems that has kick started Google into a frenzy. Thanks for the info.

 

[Stas]

spam bots etc can show googlebot as user agent too

 

[Admin]

Log into your Google Webmaster Tools account (or create one if you don't have it) - you can set (throttle) your site crawl rate there

Admin