User-agent: *
Disallow: /admin/
Disallow: /cache/
Disallow: /db/
Disallow: /include/
Disallow: /plugins/
Disallow: /wysiwyg/
Crawl-Delay: 10

User-Agent: DISCo Pump, Wget, WebZIP, Teleport Pro, WebSnake, Offline Explorer, Web-By-Mail, BizBot04 kirk.overleaf.com, HappyBot (gserver.kw.net), CaliforniaBrownSpider, EI*Net/0.1 libwww/0.1, Ibot/1.0 libwww-perl/0.40, Merritt/1.0, StatFetcher/1.0, TeacherSoft/1.0 libwww/2.17, WWW Collector, processor/0.0ALPHA libwww-perl/0.20, wobot/1.0 from 206.214.202.45, Libertech-Rover www.libertech.com?, WhoWhere Robot, ITI Spider, w3index, MyCNNSpider, SummyCrawler, OGspider, linklooker, CyberSpyder (amant@www.cyberspyder.com), SlowBot,heraSpider, Surfbot, Bizbot003, WebWalker, SandBot, EnigmaBot, spyder3.microsys.com, www.freeloader.com.
Disallow: /
Crawl-Delay: 10