#robots.txt for http://cobweb.aecom.yu.edu #update this file to control access by friendly robots User-agent:* #inside use Disallow: /admin/ Disallow: /myalbert/ Disallow: /access/ Disallow: /dh4/ Disallow: /gd/ Disallow: /library/ Disallow: /matter/ Disallow: /meduser/ Disallow: /test*/ Disallow: /testing/ Disallow: /ooeCal/ Disallow: /ooeCal105/ Disallow: /ooeCal*/ #older fie lists Disallow: /cgi-bin/ Disallow: /download/ Disallow: /kiosk/ Disallow: /temp/ Disallow: /css/ Disallow: /Images/ Disallow: /map/ Disallow: /Plug-Ins/ Disallow: sapplet.class Disallow: classes.zip Disallow: /FlashStats/ Disallow: Archived Logs/ #available only through our server Disallow: /messages/ Disallow: /Calendar/ Disallow: /home-navi.shtml Disallow: /ical/ Disallow: /ooe/ Disallow: /img/ Disallow: /obgynwiki/