# # robots.txt # http://info.webcrawler.com/mak/projects/robots/robots.html # User-agent: ??? Disallow: User-agent: Due to a deficiency in Java it's not currently possible to set the User-agent. Disallow: User-agent: no Disallow: User-agent: none Disallow: User-agent: not available Disallow: User-agent: yes Disallow: User-agent: * Disallow: /apps/ Disallow: /wiki/