Membership is FREE, giving all registered users unlimited access to every Acorn Domains feature, resource, and tool! Optional membership upgrades unlock exclusive benefits like profile signatures with links, banner placements, appearances in the weekly newsletter, and much more - customized to your membership level!

Good robots.txt for SEO?

Status
Not open for further replies.
Joined
Aug 12, 2004
Posts
251
Reaction score
5
I've currently got a holding page up for one of my domains. It's on google through old back links thus the googlebot amongst others is crawling it.

Does anyone have an example of a good robots.txt file that I should put up that is search engine friendly. Or does it no make a difference?
 
None is fine.

However if you've got a large site with large quantities of information it can be very expensive in terms of bandwidth to keep feeding the robots.

http://en.wikipedia.org/robots.txt is a good starting point for weeding out the useless robots.
 
Status
Not open for further replies.

The Rule #1

Do not insult any other member. Be polite and do business. Thank you!

Members online

No members online now.

Premium Members

New Threads

Domain Forum Friends

Our Mods' Businesses

*the exceptional businesses of our esteemed moderators
General chit-chat
Help Users
  • No one is chatting at the moment.
      There are no messages in the current room.
      Top Bottom