Buy Sell Discuss UK Domain Names at AcornDomains.co.uk UK Cheapest

  All times are GMT. The time now is 09:15:34 AM.
Domain Name Sales Domain Software Calculate UK Domain Drop Dates Domain Registration SedoPro Code Domains For Sale NameDrive Domain Parking
Go Back   Domain Forum Acorn Domains Buy Sell Auction UK Domains > Website Design and Promotion > Search Engine Optimisation

Search Engine Optimisation Discuss Search Engine Optimisation methods. How to assess traffic on a domain name and build traffic on your portfolio.

Closed Thread
 
LinkBack Thread Tools Display Modes
Old 26-12-2006, 04:31:56 PM     #1 (permalink)
Administrator
 
admin's Avatar
 
Join Date: Jun 2004
Posts: 7,190
admin has disabled reputation

Question Yahoo Slurp

Yahoo loves this forum, there are currently 35 spiders on it right now crawling the site.

Anyone know how to calm this down?

It's using over 1GB a month in bandwidth.

Thanks

Admin
__________________
9p Domains | Domain Appraisal | Droplists | Domain Brokerage | Find Valuable Domains | Link to us | Domain Software
New to UK Domain Names? - Go Here | Diet | Domain Transfers | Domain Auctions
Make more money from your Domain Names with SedoPro - PM for a free activation code!
admin is offline  
Old 26-12-2006, 07:19:21 PM     #2 (permalink)

 
stender's Avatar
 
Join Date: Nov 2005
Posts: 1,778
stender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond reputestender has a reputation beyond repute

Not sure of your os or if this helps but....

Clockwatchers Web Hosting - robots.txt Tutorial - Block Bad Bots
stender is offline  
Old 27-12-2006, 10:55:20 AM     #3 (permalink)

 
stevie's Avatar
 
Join Date: Jun 2005
Location: Manchester
Posts: 464
stevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond reputestevie has a reputation beyond repute

you could try a crawl delay for slurp

User-agent: Slurp
Crawl-delay: 10


Yahoo! Help -
stevie is offline  
Closed Thread



Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off
Forum Jump

Similar Threads
Thread Thread Starter Domain Name Community Replies Last Post
OpenDomain Donates Use of Web Addresses to Encourage Online ... - Yahoo! News (press release) RSS Domain Name News 0 29-09-2006 04:59:02 PM
Yahoo Status Page retired_member6 General Board 1 22-07-2006 10:37:48 PM
dotMobi Announces Extension of Trademark Registration - Yahoo! News (press release) RSS Domain Name News 0 10-07-2006 03:59:06 PM
Microsoft Office Live catching up with Yahoo! - iTWire RSS Domain Name News 0 31-05-2006 04:00:09 AM
Yahoo Site Explorer admin Search Engine Optimisation 4 12-02-2006 05:30:17 AM

Sky TV Package Offer


All times are GMT. The time now is 09:15:34 AM.


Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2010, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.3.2
All content on Acorn Domains is member generated and is not moderated before posting. All content is viewed and used by you at your own risk and AD does not warrant the accuracy or reliability of any of the information. The views expressed are those of the individual contributors and not necessarily those of AD. Please contact us to report any issues or send a PM to "Admin".