Revision [16797]

This is an old revision of RobotFriendly made by TqzLj4 on 2007-05-31 10:48:59.

 

To prevent web SearchEngines' spiders from crawling non-content pages, most of WikkaWiki's WikiEdit, PageHistoryInfo, etcetera pages include robots meta tags to prevent the spiders from indexing them. This keeps the databases of the SearchEngines cleaner, at least for your website. This page aims to help make your website more friendly to robots.

To start, you probably don’t want deleted pages to show up in the SearchEngines’ indices. There are a few ways to do this.


Robots Meta Tag

Contributed by BarkerJr
This patch adds the robots meta tag to the header of deleted pages. This works good, but some SearchEngines don’t support it, and will still show up in some indexes. Sending 404 (see below) works on all SearchEngines, but can sometimes display incorrectly due to a
Valid XHTML :: Valid CSS: :: Powered by WikkaWiki