![]() |
|
| Domain Name Sales | Domain Software | Calculate UK Domain Drop Dates | Domain Registration | NameDrive | Domain Parking | Subscribe to our Domains For Sale newsletter |
| | ||||||
| Home | Register | Rules | Membership Upgrade | Domains For Sale | Domain Name Escrow | Mark Forums Read | Domain Classified | Chat Room |
| Content Management Systems Website CMS systems, Blog Site Systems, Mini Site Scripts |
![]() |
| | LinkBack | Thread Tools | Display Modes |
| | #1 (permalink) |
![]() | wordpress robots.txt
Has anyone a preffered robots.txt for wordpress? I've googled various opinions but wondered if anyone has a proven one they use with a well ranked wp site found this one Disallow: /wp-content/ Disallow: /trackback/ Disallow: /wp-admin/ Disallow: /feed/ Disallow: /archives/ Disallow: /sitemap.xml Disallow: /index.php Disallow: /*? Disallow: /*.php$ Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: */feed/ Disallow: */trackback/ Disallow: /page/ Disallow: /tag/ Disallow: /category/ User-agent: Googlebot-Image Disallow: /wp-includes/ User-agent: Mediapartners-Google* Disallow: User-agent: ia_archiver Disallow: / User-agent: duggmirror Disallow: / Last edited by stender; 27-08-2010 at 09:01:19 AM. |
| |
| | #3 (permalink) |
![]() |
Hmm doesn't look so good that one... Why is it disallowing the sitemap, and why does it have no sitemap: rule? and why isn't it allowing google images hmm... I would just grab one off the bigger wp blogs like techcrunch or something. |
| |
![]() |
| Bookmarks |
| Thread Tools | |
| Display Modes | |
| |
Similar Threads | ||||
| Thread | Thread Starter | Domain Name Community | Replies | Last Post |
| High quality free Wordpress themes | springer | Wordpress | 0 | 05-01-2010 02:48:31 PM |
| Example of sites built in Wordpress | WaftyCrank | Wordpress | 13 | 18-03-2009 07:53:02 PM |
| Free Wordpress Theme Gallery - Submit YOUR theme! | bizcorp | Domain Appraisals | 2 | 20-02-2009 03:42:46 AM |