Thread: Yahoo Slurp
View Single Post
Old 27-12-2006, 10:55:20 AM     #3 (permalink)
stevie

 
Join Date: Jun 2005
Location: Manchester
Posts: 465
stevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond repute
you could try a crawl delay for slurp

User-agent: Slurp
Crawl-delay: 10


Yahoo! Help -
stevie is offline