• Welcome to AcornDomains.co.uk, a friendly community for UK domain investors, developers and anyone interested in domain names.

    Whether you're looking to buy or sell domains, learn more about the UK domain market, get feedback on your names, or simply chat with other domainers, you're in the right place. AcornDomains has been bringing together people from across the UK domain industry for many years, from complete beginners to experienced investors.

    Have a look around, join the discussions and, if you haven't already, create a free account and introduce yourself.

Good robots.txt for SEO?

Status
Not open for further replies.
Joined
Aug 12, 2004
Posts
251
Reaction score
5
I've currently got a holding page up for one of my domains. It's on google through old back links thus the googlebot amongst others is crawling it.

Does anyone have an example of a good robots.txt file that I should put up that is search engine friendly. Or does it no make a difference?
 
None is fine.

However if you've got a large site with large quantities of information it can be very expensive in terms of bandwidth to keep feeding the robots.

http://en.wikipedia.org/robots.txt is a good starting point for weeding out the useless robots.
 
Status
Not open for further replies.
Top Bottom