Membership is FREE – with unlimited access to all features, tools, and discussions. Premium accounts get benefits like banner ads and newsletter exposure. ✅ Signature links are now free for all. 🚫 No AI-generated (LLM) posts allowed. Share your own thoughts and experience — accounts may be terminated for violations.
Site Direct helps you monetize your domain portfolios with ease

Stop a SE from spidering my site

Status
Not open for further replies.
Paullas

PaullasPaullas is verified member.

Acorn Moderator
Nominet Member
Nominet Registrar
Hosting Provider
Domain Marketplace
Parking Service
Joined
Jul 13, 2004
Posts
5,868
Reaction score
400
Does anyone know the full Apache syntax i add in my .htaccess to stop all the SE's from spidering my site. I want it to be full search engine blocked.
 
Domain Summit Africa 2026
create a robots.txt file in your root directory with..

User-agent: *
Disallow: /

That would block all SE's that read and follow the robots.txt

Not all bots do but that would work for the main ones.
 
:) thats the one, cheers
 
Status
Not open for further replies.

Similar threads

it.com
it.com How to Find and Fix Broken Links on Your Website
Replies
0
Views
2K
it.comit.com is verified member.
it.com
it.com
it.com How to Fix Page Indexing Issues on Your Website
Replies
0
Views
6K
it.comit.com is verified member.
it.com
it.com
it.com What Is a Sitemap and How to Create One for Your Website
Replies
0
Views
4K
it.comit.com is verified member.
it.com
DomainManage
Domain Name Selling Support
Replies
9
Views
618
HelmutsHelmuts is verified member.
Helmuts
Siusaidh
LOKMEG (Tom) and an excellent transaction
Replies
1
Views
4K
NiceNICDomainServerNiceNICDomainServer is verified member.
NiceNICDomainServer
General chit-chat
Help Users
  • No one is chatting at the moment.
      There are no messages in the current room.
    • Home
    • Forums
    • Events
    • Auctions
      • Top Bottom