Revision [279]
This is an old revision of Mod033bRobotIndexing made by JsnX on 2004-05-13 03:25:09.
Wikka Mod 033
Type: Bug Fix / FeatureCredit:
CharlesNepote -- http://www.wakkawiki.com/MatthiasAppelHm, does anybody know how to make search robots not to index the ../edit ../revisions and ../referrers links on every page? You can search for WakkaWiki on Google and see the result.
--MatthiasAppel
Yes. See : http://www.robotstxt.org/wc/exclusion.html.
-- CharlesNepote
Does that mean, that I have to add a robots.txt with this content:
User-agent: Googlebot Disallow: /edit$ Disallow: /revisions$ Disallow: /referrers$ User-agent: * Disallow: /edit Disallow: /revisions Disallow: /referrers
--MatthiasAppel
Did it work with robots.txt? And what does $ mean?? What is with referrers_sites? --MoE
On WikiNi we code that in header.php :
<?php if ($this->GetMethod() != 'show') echo "<meta name=\"robots\" content=\"noindex, nofollow\" />\n";?>
It seem to work quite well.
-- CharlesNepote