# honeypot.be - spamtracker # this robots.txt file can be freely distributed without changes # providing this header remains intact. #AlkalineBot is a commercial research bot User-agent: AlkalineBOT Disallow: / #e-Collector is a freeware e-mail harvesting tool User-agent: LWP:: Disallow: / #Robofox is a site leeching tool User-agent: Robofox v2.0 Disallow: / #WebReaper is a freeware offline browser User-agent: WebReaper [webreaper@otway.com] Disallow: / #All other robots can have full indexing access except for the directories listed below. User-agent: * Disallow: /cgi-bin/ Disallow: /CSS/ Disallow: /GFX/ Disallow: /xSPAMxTRAPx/