User-agent: * Disallow: /_include/ Disallow: /_xbd/ Disallow: /docs/ Disallow: /_admin/ Disallow: /ss/ Disallow: /forms/ Disallow: /logs/ Disallow: /menus/ Disallow: /Software/ User-agent: msnbot Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: / --------> End of robots.txt file