User-agent: * ##general rules Disallow: /cgi-bin/ Disallow: /album/ Disallow: /images/ Disallow: /temp/ Disallow: /files/ Disallow: /php/ Disallow: /oth/ ##stop spiders from indexing histories, edit pages, and other background pages that are useless to users performing a search Disallow: /w/ ##stop spiders from indexing two special pages that might confuse them, and generally be unhelpful. Disallow: /wiki/Special:Random Disallow: /wiki/Special%3ARandom Disallow: /wiki/Special:Search Disallow: /wiki/Special%3ASearch