User-agent: *
Disallow: /cgi-bin
Disallow: http://www.math.hmc.edu/~milton/math189/notes/*
Disallow: /pics


User-agent: crawl/0.4
Crawl-delay: 10