User-agent: Mediapartners-Google* Disallow: # /robots.txt file for ALL User-agent: *.* Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for http://webcrawler.com User-agent: webcrawler Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for http://lycra.com User-agent: lycra Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for BizBot04 kirk.overleaf.com User-agent: BizBot04 Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for HappyBot (gserver.kw.net) User-agent: HappyBot Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for CaliforniaBrownSpider User-agent: CaliforniaBrownSpider Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for EI*Net/0.1 libwww/0.1 User-agent: EI*Net/0.1 Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fug Disallow: /ad2 Disallow: /fla Disallow: /watch Disallow: /logout # /robots.txt file for Ibot/1.0 libwww-perl/0.40 User-agent: Ibot Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fug Disallow: /ad2 Disallow: /fla Disallow: /watch Disallow: /logout # /robots.txt file for Merritt/1.0 User-agent: Merritt Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for StatFetcher/1.0 User-agent: StatFetcher Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for TeacherSoft/1.0 libwww/2.17 User-agent: TeacherSoft Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for WWW Collector User-agent: WWW Collector Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for processor/0.0ALPHA libwww-perl/0.20 User-agent: processor/0.0ALPHA Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for wobot/1.0 from 206.214.202.45 User-agent: wobot/1.0 Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for Libertech-Rover www.libertech.com? User-agent: Libertech-Rover Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for SlowBot User-agent: SlowBot Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for CyberSpyder (amant@www.cyberspyder.com) User-agent: CyberSpyder Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for linklooker User-agent: linklooker Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for OGspider User-agent: OGspider Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for SummyCrawler User-agent: SummyCrawler Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for MyCNNSpider User-agent: MyCNNSpider Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for w3index User-agent: w3index Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for ITI Spider User-agent: ITI Spider Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php # /robots.txt file for WhoWhere Robot User-agent: WhoWhere Robot Disallow: /mail Disallow: /ad Disallow: /error Disallow: /admin Disallow: /fsug/member.php Disallow: /fla Disallow: /logout Disallow: /forum/newreply.php Disallow: /forum/newthread.php heraSpider Surfbot Bizbot003 WebWalker SandBot EnigmaBot spyder3.microsys.com www.freeloader.com 205.252.60.71 194.20.32.131 198.5.209.201 acke.dc.luth.se dallas.mt.cs.cmu.edu darkwing.cadvision.com waldec.com www2000.ogsm.vanderbilt.edu unet.ca murph.cais.net