Domain Manage

Google Bot

Discussion in 'Domain Traffic / Keyword Research' started by lee, Apr 17, 2013.

Thread Status:
Not open for further replies.
  1. lee United Kingdom

    lee Active Member

    Joined:
    Feb 2013
    Posts:
    277
    Likes Received:
    3
    Is there anything amiss with these figures? I dont ever recall Google sucking up so much?!

    Name ----->Hits--------Bandwidth---Last Visit

    Googlebot 39,026+417 1.27 GB 17 Apr 2013 - 09:56

    <SNIP out lots of others>

    MSNBot 439+31 34.60 MB 17 Apr 2013 - 08:26
    Yahoo Slurp 339+2 9.47 MB 16 Apr 2013 - 20:49
    Alexa (IA Archiver) 80+34 3.78 MB 17 Apr 2013 - 09:30
    MSNBot-media 43+47 1.58 MB 16 Apr 2013 - 01:57

    Is that genuine or perhaps an error? The website has about 1250 pages.
     
  2. Domain Forum

    Acorn Domains Elite Member

    Joined:
    1999
    Messages:
    Many
    Likes Received:
    Lots
     
  3. tifosi United Kingdom

    tifosi Well-Known Member

    Joined:
    Oct 2004
    Posts:
    3,128
    Likes Received:
    45
    Wouldn't be surprised. I've noticed a massive increase on bandwidth usage in the last month on our coldplaying site. So much so that we though we were being ddos'ed for a while. When we checked the logs the ips were google, bing etc.

    The bandwidth usage was over twice normal. We had to put a limiter on them in the end. It was like they'd forgotten it was an old site and started blasting is like it was new again. weird.
     
  4. lee United Kingdom

    lee Active Member

    Joined:
    Feb 2013
    Posts:
    277
    Likes Received:
    3

    Intersting quote. I had pointed a traffic laden site to this one for 48hrs before reverting back and it seems that has kick started Google into a frenzy. Thanks for the info.
     
  5. Stas United Kingdom

    Stas Active Member

    Joined:
    Jan 2010
    Posts:
    137
    Likes Received:
    1
    spam bots etc can show googlebot as user agent too
     
  6. admin Spain

    admin Administrator Staff Member

    Joined:
    Jun 2004
    Posts:
    10,084
    Likes Received:
    115
    Log into your Google Webmaster Tools account (or create one if you don't have it) - you can set (throttle) your site crawl rate there ;)

    Admin
     
Thread Status:
Not open for further replies.

Share This Page