DevWebProFrance News Archives About Us Feedback


Click to Play

The Changing World Of Keyword...
The Changing World Of Keyword Research People who have been adhering to the same old tactics while researching keywords might do well to shake...

Recent Articles

The Importance Of The Whole Website For Link Building
In my last post, Holistic Link Building 101, the beginning of a series of post was embarked upon and the topic is very subjective. When it comes to building a website for SEO success, however, link building or development... .

Merging VOC Data With Site Data
In the first post on this topic, I promised to walk though the basic steps involved in integrating VOC data into your web analytics solution. I'm focusing on QuestionPro - a very inexpensive survey solution as an example...

Developing Websites In A Niche
I'm in the process of developing websites in a couple of different niches and going through the process of building sites from scratch has been instructional, especially since the process has changed with the availability of...

Generate More Traffic With A 404 Error Page
SEO campaign strategy can be an exciting stage in the website building process. As a lot of websites are looking to optimize their page, however, finding a creative edge is becoming more and more of a challenge. One way to add an extra creative aspect to your site is to make...

Determine Your Site's Success Ratio With Google...
Now the time has gone when the number of "hits" a page used to get was enough to determine its success ratio… The Official Google Blog has come up with some simple, yet extremely effective tips to determine the...


06.04.09

How To Not Make Duplicate Content In Your WordPress Blog

By Barry Welford

The best way to ensure a web page ranks well in Google keyword searches is to make sure it is the only one on the web that includes the content on the page. In this way you avoid several web pages all having a somewhat equal possibility of being judged relevant for the particular keyword search. This increases the chance that this unique page will outrank other quite independent web pages that cover the same topic. That's the theory and it seems to work out well in practice.

Wordpress is a great software for producing blogs but out-of-the-box the WordPress content management system produces a series of pages that all contain the same content. Just see the concerns expressed in this WebmasterWorld thread about WordPress And Google: Avoiding Duplicate Content Issues where several coding suggestions were offered to avoid the problems. More recently, David Bradley has suggested that something called the canonical link element can be the solution to Avoiding Duplicate Content Penalties.

We should quickly add that this is not an inherent weakness of WordPress alone since many other CMSs will suffer from similar problems. It is a well known problem and you can find an excellent article on how to Avoid Duplicate Content on Wordpress Websites, which gives the appropriate steps to take. The most important step of all is to have the right robots.txt file.

I wondered how well people were grappling with this duplicate content problem and decided to check out some of the Technorati's Blogger Central / top 100 blogs. In particular I thought a check of their robots.txt files would give an indication on whether they had tried to solve the problem. Here is what I found for the robots.txt files for the most popular 8 blogs.

The Huffington Post
# All robots will spider the domain
User-agent: *
Disallow:

# Disallow directory /backstage/
User-agent: *
Disallow: /backstage/

TechCrunch
User-agent: *
Disallow: /*/feed/
Disallow: /*/trackback/

Relax and Enjoy Free* Managed Hosting till
the Summer Solstice 21st June 2009

Engadget
(empty)

Boing Boing
User-agent: *
Disallow: /cgi-bin

Mashable!

User-agent: *
Disallow: /feed
Disallow: /*/feed/
Disallow: /*/trackback/
Disallow: /adcentric
Disallow: /adinterax
Disallow: /atlas
Disallow: /doubleclick
Disallow: /eyereturn
Disallow: /eyewonder
Disallow: /klipmart
Disallow: /pointroll
Disallow: /smartadserver
Disallow: /unicast
Disallow: /viewpoint

Continue reading this article.


About the Author:
Barry Welford, President of SMM Internet Marketing Consultants works with business owners and senior management on Internet Marketing strategy and action plans to grow their companies. He is a moderator at the Cre8asite Forums and writes on Business and the Internet in four blogs, Senior Money Memos, BPWrap, StayGoLinks and The Other Bloke's Blog.
About DevWebProFrance
DevWebProFrance is for professional developers ... those who build and manage applications and sophisticated websites. DevWebProFrance delivers via news and expert advice New Strategies In Development.





DevWebProFrance is brought to you by:

SecurityConfig.com NetworkingFiles.com
NetworkNewz.com WebProASP.com
DatabaseProNews.com SQLProNews.com
ITcertificationNews.com SysAdminNews.com
LinuxProNews.com WirelessProNews.com
CProgrammingTrends.com NetworkNewz.com






-- DevWebProFrance is an iEntry, Inc. publication --
iEntry, Inc. 2549 Richmond Rd. Lexington KY, 40509
 © 2009 iEntry Inc.  All Rights Reserved  Privacy Policy Legal  
 

archives | advertising info | news headlines | free newsletters | comments/feedback | submit article


New Strategies In Development
DevWebProFrance Home Page About Article Archive News Downloads WebProWorld Forums Jayde iEntry Advertise Contact