#robots.txt for http://nature.berkeley.edu User-Agent: * Disallow: /beta Disallow: /~slist/ns10 Disallow: /~slist/ripm_comp Disallow: /ssh Disallow: /compute Disallow: /counter.php Disallow: /mindterm Disallow: /help Disallow: /vacation Disallow: /forward Disallow: /calendar Disallow: /webmail Disallow: /webmail2 Disallow: /~casterln/smartlist-arc Disallow: /~casterln/wedding Disallow: /~casterln/montana2002 Disallow: /comtf/xfr Disallow: /comtf/xfr/tmp Disallow: /espm/_notes Disallow: /espm/Templates Disallow: /espm/include Disallow: /espm/gradinfo Disallow: /espm/admin Disallow: /citybugs/oldsite Disallow: /citybugs/db Disallow: /envscibeta Disallow: /~smith/blucard Disallow: /urbanelp Disallow: mailman/private/urbanelp Disallow: /_vti_bin Disallow: /MSOffice Disallow: /luanlab/Labmember Disallow: /boyerlab/150/cww Disallow: /boyerlab/290/cww Disallow: /departments/nut/test-site Disallow: /departments/nut/test-site Disallow: /cgi-bin/mt/mt-atom.cgi Disallow: /departments/espm/env-hist/env160/lectures/ Disallow: /departments/espm/env-hist/env161/lectures/ Disallow: /agwages/report Disallow: /login.php Disallow: /conn.php Disallow: /biofuelsbr