[UUG/MLUG] MLUG Server & Robots Policy

[William F Bishop <EMAIL:PROTECTED>]

  What is the MLUG server policy (if any) regarding access by 
web robots?...  I was just reading some information about 'A 
Standard for Robot Exclusion' located at the following URL
http://info.webcrawler.com/mak/projects/robots/norobots.html
as I have been using an online Link Checker and HTML Validator
program to check some webpages hereon...  I telneted onto the
mlug.missouri.edu server and looked for a /robots.txt file
in the server root directory but didn't find one...  does this
imply that the topic has not surfaced?...  or does this imply
that access by web robots is acceptable?...  has anyone had 
any interest or problem in this area before on this server?...
would robot access to the server seem to be a potential problem
or definite benefit?...  opinions?...  facts?...  Bill
William F Bishop       EMAIL:PROTECTED
Bishop Computing   http://mlug.missouri.edu/~wbishop/