Re: [perf-discuss] File events notification mechansim

2008-08-22 Thread Alan Coopersmith
Gail Nagle wrote: > The file event discussed here in May 2006 is close to what I am looking for. > Its only shortcoming is that a separate event is needed for each directory > being tracked. A more useful interface would allow events to be received for > all create/delete activity in a directory

Re: [perf-discuss] File events notification mechansim

2008-08-22 Thread Gail Nagle
The file event discussed here in May 2006 is close to what I am looking for. Its only shortcoming is that a separate event is needed for each directory being tracked. A more useful interface would allow events to be received for all create/delete activity in a directory tree, starting from a giv

Re: [perf-discuss] File events notification mechansim

2006-05-13 Thread Michael Schulte
Hey Prakash, 2 comments see below: prakash sangappa wrote: PS> [snip] PS> PS> We have a good discussion going. To summarize... PS> PS> PS> File event types PS> PS> FILE_ACCESS File was accessed PS> FILE_MODIFIED File was modified. PS> FILE_CREATE File/dire

Re: [perf-discuss] File events notification mechansim

2006-05-11 Thread prakash sangappa
[snip] We have a good discussion going. To summarize... File event types FILE_ACCESS File was accessed FILE_MODIFIED File was modified. FILE_CREATE File/directory was created. FILE_DELETE File/directory was deleted. FILE_ATTRIB Fil

Re: [perf-discuss] File events notification mechansim

2006-05-11 Thread Eoin Lawless
On Wed, 2006-05-10 at 23:28, prakash sangappa wrote: Spotlight. The distributed filesystem issue is somewhat addressed by remote spotlight: http://weblog.infoworld.com/enterprisemac/archives/2006/04/remote_desktop.html "Remote Spotlight is a hugely useful feature. It launches Spotlight searches o

Re: [perf-discuss] File events notification mechansim

2006-05-10 Thread prakash sangappa
I found the following which talks about the file event notification facility in Apples OS X 10.4. The fslogger is a utility which uses this feature. Apparently this is the same feature used by 'Spotlight' too http://www.kernelthread.com/software/fslogger Their file events notification mechanism

Re: [perf-discuss] File events notification mechansim

2006-05-08 Thread Spencer Shepler
On Fri, Prakash Sangappa wrote: > Spencer Shepler wrote: > >>It appears that the distributed filesystem implementation should > >>provide necessary means > >>to collect such events. I think the responsibility falls squarely on the > >>distributed file system > >>implementation. I don't of if th

Re: [perf-discuss] File events notification mechansim

2006-05-08 Thread Eoin Lawless
As far as I know, Beagle is similar to Spotlight rather than the other way round - it tries to copy Spotlight. It was very far behind Spotlight when I last tried it. A good article on file system events, indexing and search in Apple's MacosX 10.4 Tiger is at: http://arstechnica.com/reviews/os/m

Re: [perf-discuss] File events notification mechansim

2006-05-05 Thread Prakash Sangappa
Spencer Shepler wrote: It appears that the distributed filesystem implementation should provide necessary means to collect such events. I think the responsibility falls squarely on the distributed file system implementation. I don't of if there are any distributed file system implementation

Re: [perf-discuss] File events notification mechansim

2006-05-05 Thread Spencer Shepler
On Fri, Prakash Sangappa wrote: > Darren Kenny wrote: > >Hi Prakash, > > > >I don't think it's the implementation that bridges between the kernel > >and the user spaces that's important to JDS, and probably most other > >people - it's the ultimate API that people will have to write to, and > >I

Re: [perf-discuss] File events notification mechansim

2006-05-05 Thread Prakash Sangappa
Darren Kenny wrote: Hi Prakash, I don't think it's the implementation that bridges between the kernel and the user spaces that's important to JDS, and probably most other people - it's the ultimate API that people will have to write to, and I think from this perspective that sysevents is not

Re: [perf-discuss] File events notification mechansim

2006-05-05 Thread Darren Kenny
Hi Prakash, I don't think it's the implementation that bridges between the kernel and the user spaces that's important to JDS, and probably most other people - it's the ultimate API that people will have to write to, and I think from this perspective that sysevents is not what we want - it may

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Alan Coopersmith
Jonathan Adams wrote: Ah, but you can just poll/select on the port fd to get notifications there are events on it. So you're fine. Great. (I'd heard a bit about event ports, but this is the first use of them that's sounded useful to anything close to what I work on, so I've never learned the

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Jonathan Adams
On Thu, May 04, 2006 at 05:53:51PM -0700, Alan Coopersmith wrote: > Jonathan Adams wrote: > >On Thu, May 04, 2006 at 05:47:06PM -0700, Alan Coopersmith wrote: > >I believe the idea is more that you convert your pool/select loop into > >a port_getn() on a single port, which all of your events are se

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Alan Coopersmith
Jonathan Adams wrote: On Thu, May 04, 2006 at 05:47:06PM -0700, Alan Coopersmith wrote: I believe the idea is more that you convert your pool/select loop into a port_getn() on a single port, which all of your events are set up on. Not so easy to do when the poll/select loop is buried deep in th

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Jonathan Adams
On Thu, May 04, 2006 at 05:47:06PM -0700, Alan Coopersmith wrote: > Prakash Sangappa wrote: > >- Unlike the 'inotify' interfaces, which uses 'ioctls' to a device, our > > interfaces will be based on the existing Event ports framework. The > >events > > will be delivered to a specified 'Event

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Alan Coopersmith
Prakash Sangappa wrote: - Unlike the 'inotify' interfaces, which uses 'ioctls' to a device, our interfaces will be based on the existing Event ports framework. The events will be delivered to a specified 'Event port'(which is an fd). Can this fd be polled via poll/select or will all co

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Glynn Foster
Hi, Prakash Sangappa wrote: [snip lots of good discussion that I can't really add to] FILE_CLOSE_WRITE - What is the purpose of this event? If it is found to be useful, we could include it. I would think it would be most useful for the indexing system for search ie. only index a file that

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Prakash Sangappa
Glynn Foster wrote: Yeah, currently Beagle only indexes a relatively small amount of per-user data, generally in $HOME - however, as has been mentioned, it's probably one of the first proper use cases of inotify. I'd suggest that it's definitely worth looking at what inotify does - given th

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Glynn Foster
Hey, John Levon wrote: On Thu, May 04, 2006 at 08:46:01AM -0700, Bart Smaalders wrote: http://beaglewiki.org/Main_Page as well as some other GNOME things, apparently. This cannot scale. It doesn't necessarily need to scale; from my understanding, Beagle is more about watching ~/Documents/

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Spencer Shepler
On Thu, Michael Pogue wrote: > See also Apple's Spotlight, which is similar to Linux's Beagle. I believe > that Windows-Next will also have this capability. So, yes, I think this > should be a primary use case for this new API. > > Mike > > John Levon wrote: > >On Wed, May 03, 2006 at 07:31:0

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Michael Pogue
See also Apple's Spotlight, which is similar to Linux's Beagle. I believe that Windows-Next will also have this capability. So, yes, I think this should be a primary use case for this new API. Mike John Levon wrote: On Wed, May 03, 2006 at 07:31:08PM -0700, Prakash Sangappa wrote: If you

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Prakash Sangappa
John Levon wrote: On Thu, May 04, 2006 at 08:46:01AM -0700, Bart Smaalders wrote: Does this mean we don't get told /what/ got created? Is an application that wants to know "what files are disappearing/appearing under /foo/bar/?" going to have to readdir() the whole directory every time it get

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread John Levon
On Thu, May 04, 2006 at 08:46:01AM -0700, Bart Smaalders wrote: > >http://beaglewiki.org/Main_Page > > > >as well as some other GNOME things, apparently. > > This cannot scale. It doesn't necessarily need to scale; from my understanding, Beagle is more about watching ~/Documents/ than big lots o

Re: [perf-discuss] File events notification mechansim

2006-05-04 Thread Bart Smaalders
John Levon wrote: On Wed, May 03, 2006 at 07:31:08PM -0700, Prakash Sangappa wrote: If you where to watch for events on an entire directory tree, what types of events that would be? Presumably there would be some way to specify, but file creation/deletion would be the most obviously useful ev

Re: [perf-discuss] File events notification mechansim

2006-05-03 Thread John Levon
On Wed, May 03, 2006 at 07:31:08PM -0700, Prakash Sangappa wrote: > If you where to watch for events on an entire directory tree, what types > of events that would be? Presumably there would be some way to specify, but file creation/deletion would be the most obviously useful events. > How woul

Re: [perf-discuss] File events notification mechansim

2006-05-03 Thread Prakash Sangappa
John Levon wrote: On Wed, May 03, 2006 at 02:44:01PM -0700, Prakash Sangappa wrote: FILE_CREATE File/Directory was created. I think GNOME and others want to be able to watch an entire directory tree. It sounds like the proposal is that you can only watch a particular p

Re: [perf-discuss] File events notification mechansim

2006-05-03 Thread John Levon
On Wed, May 03, 2006 at 02:44:01PM -0700, Prakash Sangappa wrote: > FILE_CREATE File/Directory was created. I think GNOME and others want to be able to watch an entire directory tree. It sounds like the proposal is that you can only watch a particular path "/etc/non_existent_file"

[perf-discuss] File events notification mechansim

2006-05-03 Thread Prakash Sangappa
Hi All, We are working on adding a 'file events notification/monitoring' mechanism to the Event ports framework in Solaris. There are several different implementations around this file events notification mechanism currently available, like 'dnotify, inotify' for Linux or the 'FAM' from SGI e