Search Spiders and these Forums

[suzi]

Hi

Can someone please confirm which bits of the forums are blocked from being indexed and which aren't?

Many thanks

Suzi

 

[dropcycle]

It's all indexed except the (password protected) sales threads and a few other single URLs – full list is in the robots.txt file in the root directory.

 

[Skinner]

Just logout of the forum is an easier way to tell

 

[golddiggerguy]

And thats only good robots, as some don't follow the txt file rules!

 

[suzi]

And thats only good robots, as some don't follow the txt file rules!

Meaning some 'naughty' robots might try to index everything - although presumably they'd struggle to get to the password protected areas - or am I wrong (as usual!)?

Suzi

 

[dropcycle]

You are spot on – password protected content is under the protection of Acorns servers and not indexable unless Admin exposes the content.