# robots.txt for http://www.engr.utexas.edu/ User-agent: ExtractorPro Disallow: / User-agent: StayOn Pro Disallow: / User-agent: EmailSiphon Disallow: / User-agent: ConveraCrawler/0.9e+(+http://www.authoritativeweb.com/crawl) Disallow: / User-agent: Slurp Disallow: / User-agent: * Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /cgi-bin/ Disallow: /forms/ Disallow: /fpdb/ Disallow: /includes/ Disallow: /itg/classrooms/monitor/ Disallow: /secure/ Disallow: /sos/ Disallow: /templates/ Disallow: /news/emailpage.cfm