Domain Manage

Don't use Gzip with Google Crawler

Discussion in 'Google Adsense' started by jrowlinson, Nov 24, 2008.

Thread Status:
Not open for further replies.
  1. jrowlinson

    jrowlinson Active Member

    Joined:
    Jan 2006
    Posts:
    80
    Likes Received:
    3
    Hi,

    I bought a book called high performance websites a while back. It was written by Yahoo. There is also a tool called Yslow.

    We turned on Gzip per Yahoo's recomendation for a high performance website. 10 minutes ago Google Adsense Support just told me:

    "... we determined that our crawler is having difficulty accessing your URL. Specifically, your webserver is sending compressed HTML in gzip format to our crawler, which it is unable to process...."

    So there's the problem. Could Yahoo have been sinister? In any event if you have Gzip on you should turn it off. It's cost me thousands and thousands of pounds.



    John
     
    Last edited: Nov 24, 2008
  2. Domain Forum

    Acorn Domains Elite Member

    Joined:
    1999
    Messages:
    Many
    Likes Received:
    Lots
     
  3. retired_member9

    retired_member9 Retired Member

    Joined:
    Aug 2005
    Posts:
    519
    Likes Received:
    8
    Shouldn't happen with a properly configured server. It should send gzip encoded documents only if client shows support by sending you headers 'Accept-encoding: gzip,deflate'.

    I doubt Google's crawler sends such headers.
     
  4. jrowlinson

    jrowlinson Active Member

    Joined:
    Jan 2006
    Posts:
    80
    Likes Received:
    3
     
Thread Status:
Not open for further replies.

Share This Page