# All robots will spider the domain User-agent: * Crawl-Delay: 10 Disallow: Disallow: /phorm/ Disallow: /archive/ Disallow: /cache/ Disallow: /css/ Disallow: /jpgraph/ Disallow: /layout/ Disallow: /mgt/ Disallow: /pt/ Disallow: /global/ Disallow: /news_calendars/ Disallow: /maps/controlpoints/