Give your brand more visibility with premium banner ads and newsletter exposure.

  • Welcome to AcornDomains.co.uk, a friendly community for UK domain investors, developers and anyone interested in domain names.

    Whether you're looking to buy or sell domains, learn more about the UK domain market, get feedback on your names, or simply chat with other domainers, you're in the right place. AcornDomains has been bringing together people from across the UK domain industry for many years, from complete beginners to experienced investors.

    Have a look around, join the discussions and, if you haven't already, create a free account and introduce yourself.

.UK and .CO.UK Sedo

Stop a SE from spidering my site

Status
Not open for further replies.
Paullas

PaullasPaullas is verified member.

Acorn Moderator
Nominet Member
Nominet Registrar
Hosting Provider
Domain Marketplace
Parking Service
Joined
Jul 13, 2004
Posts
5,928
Reaction score
467
Does anyone know the full Apache syntax i add in my .htaccess to stop all the SE's from spidering my site. I want it to be full search engine blocked.
 
Domain Summit Africa 2027
create a robots.txt file in your root directory with..

User-agent: *
Disallow: /

That would block all SE's that read and follow the robots.txt

Not all bots do but that would work for the main ones.
 
Status
Not open for further replies.

Similar threads

brandforge
Michiel From the Netherlands
Replies
3
Views
222
HelmutsHelmuts is verified member.
Helmuts
it.com
it.com 7 Free Tools for Website Monitoring
Replies
0
Views
362
it.comit.com is verified member.
it.com
it.com
it.com Industry News Digest: April 2026
Replies
0
Views
813
it.comit.com is verified member.
it.com
it.com
it.com 5 Subdomain Setup Mistakes and How to Avoid Them
Replies
0
Views
895
it.comit.com is verified member.
it.com
it.com
it.com 3 Effective Content Promotion Tactics for IT Startup Websites
Replies
1
Views
2K
Wintorez
Wintorez
  • Home
  • Forums
  • Events
  • Auctions
    • Top Bottom