# # robots exclusion list. # User-agent: PiplBot Disallow: / User-agent: Yahoo Pipes 1.0 Disallow: / User-agent: nimblecrawler Disallow: / User-agent: 008 Disallow: / User-agent: * Crawl-delay: 10 Disallow: /ERICWebPortal/contactUs/ Disallow: /ERICWebPortal/thesaurus/ Disallow: /WebHelp/ Disallow: /contentdelivery/ Disallow: /ERICWebPortal/contentdelivery/servlet/