# # Robot exclusion file. This specifies what "intelligent" web robots # may (and may not) search for on our site. Of course, the individual # writer may choose to ignore this file, but most follow it. # # Last updated: Aug 8, 1999 dna+robots@clas.ufl.edu # # Removed the comments. I think 'scooter' (Alta-Vista) gets confused # by 'em and decides to ignore the 'Disallow:' directives. # # User-agent: * Disallow: /ftp Disallow: /cgi-bin Disallow: /~ Disallow: /users/kludwig Disallow: /archives Disallow: /internal Disallow: /clasnet/internal Disallow: /novell Disallow: /mail Disallow: /images