Quote:
Originally Posted by LeeOwen  I'm not sure it's a good idea that only logged in members can see the sales forums. It is good however that spiders can't roam around them, why not just put the sales forums main urls in robot.txt that way they wont go there and will be denied, seems far simpler. |
Rogue robots ignore robots.txt and the info still leaks out. This way however is leak-proof, and definitely the right way to implement it.
__________________
Memorable Domains Ltd - Over 7,000 descriptive, generic .co.uk domains for sale
Please note: All sale prices over a week old are automatically invalid. No exceptions. Thanks!