Does your site get crawled by Google if you URL is found on another page it has crawl

[eetc]

Does your site get crawled by Google if your URL is found on another page it crawled

If one of your sites has a link to another of your sites and you submit that one to Google, does the first site also get crawled?

Chris

 

[charliecharlie is verified member.]

in very simple basics the idea of "crawling" is exactly that.

Google will take all the URLs on your page a crawl them at some point. The frequency and weighting of this depends on the popularity of the site. Put your link in your sig for acorndomains and it soon appears - thanks admin!

 

[AdminAdmin is verified member.]

You are welcome Charlie! We dont mind you putting your sites in your signatures as long as they are kept to 2 lines of text and are not direct affiliate links.

 

[eetc]

So how often do you suspect AcornDomains gets crawled by Google?

Chris

 

[AdminAdmin is verified member.]

September Google Crawler Stats:

Googlebot 4507+75 110.46 MB 30 Sep 2005 - 22:01

Anyone know what this really means? Taken from Advanced Web Statistics 6.4

We have put controls in our HTaccess file to stop Google crawling Pms and opening too many connections as we found at times the Googlebot had 20 connections open at once when spidering the site.

 

[aquanuke]

Looking at the last cached page on the home page will give you an idea how often Googlebot comes around..

http://216.239.59.104/search?source...GLD:en&q=cache:http://www.acorndomains.co.uk/

3rd October (yesterday) .. so I would imagine most days Googlebot visits.

 

[stevie]

September Google Crawler Stats:

Googlebot 4507+75 110.46 MB 30 Sep 2005 - 22:01

Anyone know what this really means? Taken from Advanced Web Statistics 6.4

googlebot spider has crawled your site 4507 times and crawled your robots.txt file 75 times, total bandwidth used by bot 110.46mb, last visited 30th sept @ 22:01