User-agent: * Disallow: /cgi-bin/ Disallow: /_private/ Disallow: /logs/ Disallow: /test/ Disallow: test.htm User-agent: Roverbot Disallow: / User-agent: e-collector Disallow: / User-agent: LabelGrabber Disallow: / User-agent: largin Disallow: / User-agent: Mattie Disallow: / User-agent: NetCarta WebMap Engine Disallow: / User-agent: Openfind data gatherer Disallow: / User-agent: Poppi Disallow: / User-agent: Snooper Disallow: / User-agent: Site Searcher Disallow: / User-agent: URL Check Disallow: / User-agent: WallPaper (alian crawlpaper) Disallow: / User-agent: Webinator Disallow: / User-agent: World Wide Web Worm Disallow: /