Revision [674]

This is an old revision of Mod033bRobotIndexing made by JsnX on 2004-06-17 01:50:01.

 

Wikka Mod 033

Type: Bug Fix / Feature

Credit:

CharlesNepote -- http://www.wakkawiki.com/MatthiasAppel


This is the method used in Wikka:

In header.php :
<?php if ($this->GetMethod() != 'show') echo "<meta name=\"robots\" content=\"noindex, nofollow\" />\n";?>



History from WakkaWiki........


Hm, does anybody know how to make search robots not to index the ../edit ../revisions and ../referrers links on every page? You can search for WakkaWiki on Google and see the result.
--MatthiasAppel

Yes. See : http://www.robotstxt.org/wc/exclusion.html.
-- CharlesNepote

Does that mean, that I have to add a robots.txt with this content:
User-agent: Googlebot
Disallow: /edit$
Disallow: /revisions$
Disallow: /referrers$

User-agent: *
Disallow: /edit
Disallow: /revisions
Disallow: /referrers

--MatthiasAppel
Did it work with robots.txt? And what does $ mean?? What is with referrers_sites? --MoE

Dont really know, but I think $ doesnt belong there. But you could use something like this:
User-agent: googlebot
Disallow: /*/edit
Disallow: /*/revisions
Disallow: /*/referrers
Disallow: /*/referrers_sites
Googlebot understands the wildcard *. Other SE Bots won't.
But also like Charles' method noted below. --JanPiotrowski

On WikiNi we code that in header.php :
<?php if ($this->GetMethod() != 'show') echo "<meta name=\"robots\" content=\"noindex, nofollow\" />\n";?>
It seem to work quite well.
-- CharlesNepote
There are no comments on this page.
Valid XHTML :: Valid CSS: :: Powered by WikkaWiki