Duplicate content problems

paul · 15-07-2005, 06:24:50 PM

Admin

Just noticed there is a problem with duplicate content on this site which is no doubt affecting traffic.

I did a quick look to see how many pages were listed in google and was surprised to see over 45,000.

After a bit of digging I see the problem is there are 5 different ways of getting to each page.

If you take a unique page title and enclose it in quotes you will see the problem click here

Other files that are bloating the index and probably diluting the power of the content pages are newreply.php? & sendmessage.php? especially newreply.php

If you blocked these in your robots.txt file or some other way I'm sure you would see an increase in traffic.

Just my 2 cents

gromy · 15-07-2005, 07:06:01 PM

Your search for "Selling domains - contract of sale?" returned 19 English pages and 91 Google Ads in 0.38 seconds.

paul · 15-07-2005, 07:11:35 PM

yes but only results 1,3,4,6,& 7 are duplicates of the same page

admin · 15-07-2005, 07:18:55 PM

Well spotted Paul, I have updated my robots.txt file as follows:

Code:

User-agent: *
Disallow: /admin/ 
Disallow: /db/ 
Disallow: /images/ 
Disallow: /includes/ 
Disallow: /language/ 
Disallow: /templates/ 
Disallow: /common.php 
Disallow: /groupcp.php 
Disallow: /memberlist.php 
Disallow: /modcp.php 
Disallow: /posting.php 
Disallow: /profile.php 
Disallow: /privmsg.php 
Disallow: /viewonline.php 
Disallow: /faq.php 
Disallow: /updates-topic.html*$ 
Disallow: /stop-updates-topic.html*$ 
Disallow: /ptopic*.html$ 
Disallow: /ntopic*.html$
Disallow: /announcement.php
Disallow: /faq.php
Disallow: /forumdisplay.php
Disallow: /login.php
Disallow: /member.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /printthread.php
Disallow: /search.php
Disallow: /showthread.php

Any idea how long before Google reacts?

Thanks for the heads up, appreacited.

Admin

paul · 15-07-2005, 07:26:01 PM

I found a page in the google index this week from one of my sites that I deleted about 4 years ago, so your guess is as good as mine. I suppose it all depends on how often they spider those pages on your site.

15-07-2005, 06:24:50 PM	#1 (permalink)
paul Join Date: Mar 2005 Location: Worcester Posts: 1,092 No Classified Ratings Domain Trader Rating: (100% / 18)	Duplicate content problems Admin Just noticed there is a problem with duplicate content on this site which is no doubt affecting traffic. I did a quick look to see how many pages were listed in google and was surprised to see over 45,000. After a bit of digging I see the problem is there are 5 different ways of getting to each page. If you take a unique page title and enclose it in quotes you will see the problem click here Other files that are bloating the index and probably diluting the power of the content pages are newreply.php? & sendmessage.php? especially newreply.php If you blocked these in your robots.txt file or some other way I'm sure you would see an increase in traffic. Just my 2 cents __________________ Green Flag AA breakdown cover RAC breakdown cover Van Insurance Pet Insurance

15-07-2005, 07:11:35 PM	#3 (permalink)
paul Join Date: Mar 2005 Location: Worcester Posts: 1,092 No Classified Ratings Domain Trader Rating: (100% / 18)	yes but only results 1,3,4,6,& 7 are duplicates of the same page __________________ Green Flag AA breakdown cover RAC breakdown cover Van Insurance Pet Insurance

15-07-2005, 07:26:01 PM	#5 (permalink)
paul Join Date: Mar 2005 Location: Worcester Posts: 1,092 No Classified Ratings Domain Trader Rating: (100% / 18)	I found a page in the google index this week from one of my sites that I deleted about 4 years ago, so your guess is as good as mine. I suppose it all depends on how often they spider those pages on your site. __________________ Green Flag AA breakdown cover RAC breakdown cover Van Insurance Pet Insurance

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

15-07-2005, 07:06:01 PM	#2 (permalink)
gromy Junior Member Join Date: Mar 2005 Posts: 26 No Classified Ratings Domain Trader Rating: (0% / 0)	Your search for "Selling domains - contract of sale?" returned 19 English pages and 91 Google Ads in 0.38 seconds.