Home | FAQ | Server | Presentations | Mailing Lists/Archives | Member Tools | Links | Sponsors | ContactOn Thu, Aug 01, 2002 at 04:49:52PM -0500, Michael wrote: > What I'm doing has to do with a spidering program (Actually a lot of > different ones) that write data to a given file tree. Each file written to > this tree needs to be checked (not corrupt, not a duplicate, etc) and if > it is okay copied to a permanent file warehouse.. passing through the > needed filters along the way. My spiders are a collection of programs > written by myself in several different languages, third party tools, etc > making it painful to have to hack into each program if I need to change > the method files are saved into the warehouse by. Cron jobs work okay but > they put a lot of unneeded load on the system scanning the file tree for > new files and sometimes miss files that are created and destroyed quickly. > The best solution is to trigger the warehousing scripts as needed by the > filesystem. In this specific case this solution will use fewer system > resources than other solutions and shouldn't create a problem as this > filesystem is only being used over a very select group of files. > > Will look at CSA. Maybe it'll keep me from having to write my own file > system. Hope so. :) Check out dnotify: http://www.student.lu.se/~nbi98oli/ Jeremy
Attachment:
pgp00000.pgp
Description: PGP signature