Membership is FREE, giving all registered users unlimited access to every Acorn Domains feature, resource, and tool! Optional membership upgrades unlock exclusive benefits like profile signatures with links, banner placements, appearances in the weekly newsletter, and much more - customized to your membership level!

Does your site get crawled by Google if you URL is found on another page it has crawl

Status
Not open for further replies.
Joined
Mar 30, 2005
Posts
397
Reaction score
3
Does your site get crawled by Google if your URL is found on another page it crawled

If one of your sites has a link to another of your sites and you submit that one to Google, does the first site also get crawled?

Chris
 
Last edited:
in very simple basics the idea of "crawling" is exactly that.

Google will take all the URLs on your page a crawl them at some point. The frequency and weighting of this depends on the popularity of the site. Put your link in your sig for acorndomains and it soon appears - thanks admin!
 
You are welcome Charlie! We dont mind you putting your sites in your signatures as long as they are kept to 2 lines of text and are not direct affiliate links.
 
So how often do you suspect AcornDomains gets crawled by Google?

Chris
 
September Google Crawler Stats:

Googlebot 4507+75 110.46 MB 30 Sep 2005 - 22:01

Anyone know what this really means? Taken from Advanced Web Statistics 6.4

We have put controls in our HTaccess file to stop Google crawling Pms and opening too many connections as we found at times the Googlebot had 20 connections open at once when spidering the site.
 
admin said:
September Google Crawler Stats:

Googlebot 4507+75 110.46 MB 30 Sep 2005 - 22:01

Anyone know what this really means? Taken from Advanced Web Statistics 6.4

googlebot spider has crawled your site 4507 times and crawled your robots.txt file 75 times, total bandwidth used by bot 110.46mb, last visited 30th sept @ 22:01
 
Status
Not open for further replies.

The Rule #1

Do not insult any other member. Be polite and do business. Thank you!

Premium Members

New Threads

Domain Forum Friends

Our Mods' Businesses

*the exceptional businesses of our esteemed moderators
General chit-chat
Help Users
  • No one is chatting at the moment.
      There are no messages in the current room.
      Top Bottom