Re: [perf-discuss] File events notification mechansim

2008-08-22 Thread Alan Coopersmith
Gail Nagle wrote: > The file event discussed here in May 2006 is close to what I am looking for. > Its only shortcoming is that a separate event is needed for each directory > being tracked. A more useful interface would allow events to be received for > all create/delete activity in a directory

Re: [perf-discuss] File events notification mechansim

2008-08-22 Thread Gail Nagle
The file event discussed here in May 2006 is close to what I am looking for. Its only shortcoming is that a separate event is needed for each directory being tracked. A more useful interface would allow events to be received for all create/delete activity in a directory tree, starting from a giv

Re: [perf-discuss] File events notification mechansim

2006-05-13 Thread Michael Schulte
Hey Prakash, 2 comments see below: prakash sangappa wrote: PS> [snip] PS> PS> We have a good discussion going. To summarize... PS> PS> PS> File event types PS> PS> FILE_ACCESS File was accessed PS> FILE_MODIFIED File was modified. PS> FILE_CREATE File/dire

Re: [perf-discuss] File events notification mechansim

2006-05-11 Thread prakash sangappa
[snip] We have a good discussion going. To summarize... File event types FILE_ACCESS File was accessed FILE_MODIFIED File was modified. FILE_CREATE File/directory was created. FILE_DELETE File/directory was deleted. FILE_ATTRIB Fil

Re: [perf-discuss] File events notification mechansim

2006-05-11 Thread Eoin Lawless
On Wed, 2006-05-10 at 23:28, prakash sangappa wrote: Spotlight. The distributed filesystem issue is somewhat addressed by remote spotlight: http://weblog.infoworld.com/enterprisemac/archives/2006/04/remote_desktop.html "Remote Spotlight is a hugely useful feature. It launches Spotlight searches o

Re: [perf-discuss] File events notification mechansim

2006-05-10 Thread prakash sangappa
I found the following which talks about the file event notification facility in Apples OS X 10.4. The fslogger is a utility which uses this feature. Apparently this is the same feature used by 'Spotlight' too http://www.kernelthread.com/software/fslogger Their file events notification mechanism

Re: [perf-discuss] File events notification mechansim

2006-05-08 Thread Spencer Shepler
On Fri, Prakash Sangappa wrote: > Spencer Shepler wrote: > >>It appears that the distributed filesystem implementation should > >>provide necessary means > >>to collect such events. I think the responsibility falls squarely on the > >>distributed file system > >>implementation. I don't of if th

Re: [perf-discuss] File events notification mechansim

2006-05-08 Thread Eoin Lawless
As far as I know, Beagle is similar to Spotlight rather than the other way round - it tries to copy Spotlight. It was very far behind Spotlight when I last tried it. A good article on file system events, indexing and search in Apple's MacosX 10.4 Tiger is at: http://arstechnica.com/reviews/os/m

Re: [perf-discuss] File events notification mechansim

2006-05-05 Thread Prakash Sangappa
Spencer Shepler wrote: It appears that the distributed filesystem implementation should provide necessary means to collect such events. I think the responsibility falls squarely on the distributed file system implementation. I don't of if there are any distributed file system implementation

Re: [perf-discuss] File events notification mechansim

2006-05-05 Thread Spencer Shepler
On Fri, Prakash Sangappa wrote: > Darren Kenny wrote: > >Hi Prakash, > > > >I don't think it's the implementation that bridges between the kernel > >and the user spaces that's important to JDS, and probably most other > >people - it's the ultimate API that people will have to write to, and > >I

Re: [perf-discuss] File events notification mechansim

2006-05-05 Thread Prakash Sangappa
Darren Kenny wrote: Hi Prakash, I don't think it's the implementation that bridges between the kernel and the user spaces that's important to JDS, and probably most other people - it's the ultimate API that people will have to write to, and I think from this perspective that sysevents is not

Re: [perf-discuss] File events notification mechansim

2006-05-05 Thread Darren Kenny
Hi Prakash, I don't think it's the implementation that bridges between the kernel and the user spaces that's important to JDS, and probably most other people - it's the ultimate API that people will have to write to, and I think from this perspective that sysevents is not what we want - it may

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Alan Coopersmith
Jonathan Adams wrote: Ah, but you can just poll/select on the port fd to get notifications there are events on it. So you're fine. Great. (I'd heard a bit about event ports, but this is the first use of them that's sounded useful to anything close to what I work on, so I've never learned the

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Jonathan Adams
On Thu, May 04, 2006 at 05:53:51PM -0700, Alan Coopersmith wrote: > Jonathan Adams wrote: > >On Thu, May 04, 2006 at 05:47:06PM -0700, Alan Coopersmith wrote: > >I believe the idea is more that you convert your pool/select loop into > >a port_getn() on a single port, which all of your events are se

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Alan Coopersmith
Jonathan Adams wrote: On Thu, May 04, 2006 at 05:47:06PM -0700, Alan Coopersmith wrote: I believe the idea is more that you convert your pool/select loop into a port_getn() on a single port, which all of your events are set up on. Not so easy to do when the poll/select loop is buried deep in th

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Jonathan Adams
On Thu, May 04, 2006 at 05:47:06PM -0700, Alan Coopersmith wrote: > Prakash Sangappa wrote: > >- Unlike the 'inotify' interfaces, which uses 'ioctls' to a device, our > > interfaces will be based on the existing Event ports framework. The > >events > > will be delivered to a specified 'Event

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Alan Coopersmith
Prakash Sangappa wrote: - Unlike the 'inotify' interfaces, which uses 'ioctls' to a device, our interfaces will be based on the existing Event ports framework. The events will be delivered to a specified 'Event port'(which is an fd). Can this fd be polled via poll/select or will all co

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Glynn Foster
Hi, Prakash Sangappa wrote: [snip lots of good discussion that I can't really add to] FILE_CLOSE_WRITE - What is the purpose of this event? If it is found to be useful, we could include it. I would think it would be most useful for the indexing system for search ie. only index a file that

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Prakash Sangappa
Glynn Foster wrote: Yeah, currently Beagle only indexes a relatively small amount of per-user data, generally in $HOME - however, as has been mentioned, it's probably one of the first proper use cases of inotify. I'd suggest that it's definitely worth looking at what inotify does - given th

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Glynn Foster
Hey, John Levon wrote: On Thu, May 04, 2006 at 08:46:01AM -0700, Bart Smaalders wrote: http://beaglewiki.org/Main_Page as well as some other GNOME things, apparently. This cannot scale. It doesn't necessarily need to scale; from my understanding, Beagle is more about watching ~/Documents/

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Spencer Shepler
On Thu, Michael Pogue wrote: > See also Apple's Spotlight, which is similar to Linux's Beagle. I believe > that Windows-Next will also have this capability. So, yes, I think this > should be a primary use case for this new API. > > Mike > > John Levon wrote: > >On Wed, May 03, 2006 at 07:31:0

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Michael Pogue
See also Apple's Spotlight, which is similar to Linux's Beagle. I believe that Windows-Next will also have this capability. So, yes, I think this should be a primary use case for this new API. Mike John Levon wrote: On Wed, May 03, 2006 at 07:31:08PM -0700, Prakash Sangappa wrote: If you

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Prakash Sangappa
John Levon wrote: On Thu, May 04, 2006 at 08:46:01AM -0700, Bart Smaalders wrote: Does this mean we don't get told /what/ got created? Is an application that wants to know "what files are disappearing/appearing under /foo/bar/?" going to have to readdir() the whole directory every time it get

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread John Levon
On Thu, May 04, 2006 at 08:46:01AM -0700, Bart Smaalders wrote: > >http://beaglewiki.org/Main_Page > > > >as well as some other GNOME things, apparently. > > This cannot scale. It doesn't necessarily need to scale; from my understanding, Beagle is more about watching ~/Documents/ than big lots o

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Bart Smaalders
John Levon wrote: On Wed, May 03, 2006 at 07:31:08PM -0700, Prakash Sangappa wrote: If you where to watch for events on an entire directory tree, what types of events that would be? Presumably there would be some way to specify, but file creation/deletion would be the most obviously useful ev

Re: [perf-discuss] File events notification mechansim

2006-05-03 Thread John Levon
On Wed, May 03, 2006 at 07:31:08PM -0700, Prakash Sangappa wrote: > If you where to watch for events on an entire directory tree, what types > of events that would be? Presumably there would be some way to specify, but file creation/deletion would be the most obviously useful events. > How woul

Re: [perf-discuss] File events notification mechansim

2006-05-03 Thread Prakash Sangappa
John Levon wrote: On Wed, May 03, 2006 at 02:44:01PM -0700, Prakash Sangappa wrote: FILE_CREATE File/Directory was created. I think GNOME and others want to be able to watch an entire directory tree. It sounds like the proposal is that you can only watch a particular p

Re: [perf-discuss] File events notification mechansim

2006-05-03 Thread John Levon
On Wed, May 03, 2006 at 02:44:01PM -0700, Prakash Sangappa wrote: > FILE_CREATE File/Directory was created. I think GNOME and others want to be able to watch an entire directory tree. It sounds like the proposal is that you can only watch a particular path "/etc/non_existent_file"