What are people using for their affiliate datafeeds?

[retired_member21]

Yeah it's not the number of bikes, it's the number of dynamic pages really. Either robots.txt them off (in a directory) or block them with tags unless you have some unique info. I really learnt this the hard way

 

[pbryd]

I've set up a robot.txt and checked it with google webmaster tools.

I've blocked the php directory which holds the includes and files for submitting to the database.

I've also blocked the single dynamic page which is generated for each bike.

User-agent: *
Allow: /
Disallow: /php
Disallow: /shop/moredetails.php