[MLUG] robots.txt problem

[Mike Miller <EMAIL:PROTECTED>]

I've always maintained a robots.txt file that stops the bots from indexing 
some collections of my pages.  The other day I made the mistake of editing 
and saving the file and emacs automatically changed ownership so that the 
file was no longer readable.  So the bots came in and indexed everything. 
So all these pages are now in Google and I didn't want them to be there. 
Is there any way to undo that?  I can change directory names, but the 
files are still in Google cache.  Is there any way out of that?

Mike

P.S.  In case you are wondering how emacs could change ownership of my 
file - I had made it so all my web pages were chmod 640 and owner was me 
but with group 'apache', thus other users couldn't snoop around in my web 
pages.  When I edited and saved the file, it changed the group to 'staff', 
but the apache daemon isn't in that group so it couldn't serve the 
robots.txt file.  Apache would have given this error to the Google bots...

Forbidden
You don't have permission to access /robots.txt on this server.

...but I guess that is interpretted as "do whatever you please."
_______________________________________________
members mailing list
EMAIL:PROTECTED
http://mlug.missouri.edu/mailman/listinfo/members