Re: [MLUG] filesystem hooks

[Michael <EMAIL:PROTECTED>]

> > Interesting...that is just accounting, though, and doesn't let you
> > "intervene" with the file creation/modfication, right?
> >
> > There are also all kinds of very hacky things you can do with named
> > pipes that can mimic some of the behavior you might want.  And I
> > other people do stuff with cron jobs when you don't have to
> > "intervene" with the modification and can deal with what I guess
> > would be technically a "race condition" (file created and destroyed
> > before cron job runs).
> >
> > So what are you really trying to do here?
>
> I was wondering the same thing.  Plus, this would *really, really, really*
> slow down your system.  Maybe grind it to a halt.  Think of the overhead
> in forking, interpreting then executing a shell script each time a file
> is written.  Think of all the temp files that get written.  That's a lot
> of extra overhead.
>
> If you want to account for stuff, CSA should allow you to monitor then run
> scripts on the data to flag you.

What I'm doing has to do with a spidering program (Actually a lot of
different ones) that write data to a given file tree. Each file written to
this tree needs to be checked (not corrupt, not a duplicate, etc) and if
it is okay copied to a permanent file warehouse.. passing through the
needed filters along the way.  My spiders are a collection of programs
written by myself in several different languages,  third party tools, etc
making it painful to have to hack into each program if I need to change
the method files are saved into the warehouse by. Cron jobs work okay but
they put a lot of unneeded load on the system scanning the file tree for
new files and sometimes miss files that are created and destroyed quickly.
The best solution is to trigger the warehousing scripts as needed by the
filesystem. In this specific case this solution will use fewer system
resources than other solutions and shouldn't create a problem as this
filesystem is only being used over a very select group of files.

Will look at CSA. Maybe it'll keep me from having to write my own file
system. Hope so. :)

--
To unsubscribe, go to http://mlug.missouri.edu/members/edit.php

Archives are available at http://mlug.missouri.edu/list-archives/