Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2007-01-05 Thread Chaitanya Patti
> We are in the process of porting RAIF to 2.6.19 right now. Should be done > in early January. The trick is that we are trying to keep the same source > good for a wide range of kernel versions. In fact, not too long ago we > even were able to compile it for 2.4.24! > > Nikolai. We now have R

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-25 Thread Nikolai Joukov
> > Every stackable file system caches the data at its own level and > > copies it from/to the lower file system's cached pages when necessary. > > ... > > this effectively reduces the system's cache memory size by two or more > > times. > > It should not be that bad with a decent cache replacement

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-22 Thread Nikolai Joukov
> > 3. A known ideal solution for this problem is sharing of the cached pages > >between file systems. We attempted to do it for Tracefs but the > >resulting code is not beautiful and is potentially racy: > > > >U

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-16 Thread Nikolai Joukov
> I am looking at filling the net-pipe, and it only reaches 40-75% max, with > some short 100% bursts, and a slow 10% start. It seems that caching > somewhat delays the writes, which then batch up and sync at various speeds. > So you have the cache really hiding slow sync speeds. To tune this, it

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread Nikolai Joukov
> >The idea behind the cloneset is that most of the blocks (or files) > >do not change in either source or target. This being the case its only > necessary > >to update the changed elements. This means updates are incremental. Once > >the system has figured out what it needs to update its usable

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread Nikolai Joukov
> > We have designed a new stackable file system that we called RAIF: > > Redundant Array of Independent Filesystems. > > > > Similar to Unionfs, RAIF is a fan-out file system and can be mounted over > > many different disk-based, memory, network, and distributed file systems. > > RAIF can use the

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread David Lang
On Wed, 13 Dec 2006, Nikolai Joukov wrote: We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Similar to Unionfs, RAIF is a fan-out file system and can be mounted over many different disk-based, memory, network, and distributed file sys

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread Ed Tomlinson
On Friday 15 December 2006 15:11, Nikolai Joukov wrote: > > On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: > > > We have designed a new stackable file system that we called RAIF: > > > Redundant Array of Independent Filesystems > > > > Do you have a function similar to an an EMC clonese

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread Nikolai Joukov
> On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: > > We have designed a new stackable file system that we called RAIF: > > Redundant Array of Independent Filesystems > > Do you have a function similar to an an EMC cloneset? Basicily a cloneset > tracks what has changed in both the sou

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread Nikolai Joukov
> Nikolai Joukov wrote: > > > > We started the project in April 2004. Right now I am using it as my > > > > /home/kolya file system at home. We believe that at this stage RAIF > > > > is mature enough for others to try it out. The code is available at: > > > > > > > >

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread Nikolai Joukov
> Nikolai Joukov wrote: > > > Nikolai Joukov wrote: > > > > We have designed a new stackable file system that we called RAIF: > > > > Redundant Array of Independent Filesystems. > > > > > > Great! > > > > > > > We have performed some benchmarking on a 3GHz PC with 2GB of RAM and > > > > U320 SCSI d

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread Nikolai Joukov
> On Friday 15 December 2006 10:01, Nikolai Joukov wrote: > > > Nikolai Joukov wrote: > > > > We have designed a new stackable file system that we called RAIF: > > > > Redundant Array of Independent Filesystems. > > > > > > Great! > > Yes, definitely... > > I see the major benefit being in the mobi

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-15 Thread Ed Tomlinson
On Wednesday 13 December 2006 12:47, Nikolai Joukov wrote: > We have designed a new stackable file system that we called RAIF: > Redundant Array of Independent Filesystems Do you have a function similar to an an EMC cloneset? Basicily a cloneset tracks what has changed in both the source and tar

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-14 Thread Al Boldi
Nikolai Joukov wrote: > > Nikolai Joukov wrote: > > > We have designed a new stackable file system that we called RAIF: > > > Redundant Array of Independent Filesystems. > > > > Great! > > > > > We have performed some benchmarking on a 3GHz PC with 2GB of RAM and > > > U320 SCSI disks. Compared to

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-14 Thread Al Boldi
Nikolai Joukov wrote: > > > We started the project in April 2004. Right now I am using it as my > > > /home/kolya file system at home. We believe that at this stage RAIF > > > is mature enough for others to try it out. The code is available at: > > > > > >

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-14 Thread Nikolai Joukov
> Well, Congratulations, Doctor!! [Must be nice to be exiled to Stony > Brook!! Oh, well, not I] Long Island is a very nice place with lots of vineries and perfect sand beaches - don't envy :-) > Here's hoping that source exists, and that it is available for us. I guess, you are subscribed to

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-14 Thread Nikolai Joukov
> > We started the project in April 2004. Right now I am using it as my > > /home/kolya file system at home. We believe that at this stage RAIF is > > mature enough for others to try it out. The code is available at: > > > > > > > > The code requires n

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-14 Thread berk walker
Nikolai Joukov wrote: Figures 9.7 and 9.8 also show profiles of the Linux RAID5 and RAIF5 operation under the same Postmark workload. Nikolai. - Nikolai Joukov, Ph.D. Filesystems and Storage Laboratory Ston

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-14 Thread Charles Manning
On Friday 15 December 2006 10:01, Nikolai Joukov wrote: > > Nikolai Joukov wrote: > > > We have designed a new stackable file system that we called RAIF: > > > Redundant Array of Independent Filesystems. > > > > Great! Yes, definitely... I see the major benefit being in the mobile, industrial and

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-14 Thread Nikolai Joukov
> Nikolai Joukov wrote: > > We have designed a new stackable file system that we called RAIF: > > Redundant Array of Independent Filesystems. > > Great! > > > We have performed some benchmarking on a 3GHz PC with 2GB of RAM and U320 > > SCSI disks. Compared to the Linux RAID driver, RAIF has overh

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-13 Thread Nikolai Joukov
> >We have designed a new stackable file system that we called RAIF: > >Redundant Array of Independent Filesystems. > > > >Similar to Unionfs, RAIF is a fan-out file system and can be mounted over > >many different disk-based, memory, network, and distributed file systems. > >RAIF can use the stabl

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-13 Thread Jan Engelhardt
>We have designed a new stackable file system that we called RAIF: >Redundant Array of Independent Filesystems. > >Similar to Unionfs, RAIF is a fan-out file system and can be mounted over >many different disk-based, memory, network, and distributed file systems. >RAIF can use the stable and maint

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-13 Thread Nikolai Joukov
> > Nikolai Joukov wrote: > > > replication. In case of RAID4 and RAID5-like configurations, RAIF > > > performed > > > about two times *better* than software RAID and even better than an > > > Adaptec > > > 2120S RAID5 controller. This is because RAIF is located above file system > > > caches

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-13 Thread Nikolai Joukov
> Nikolai Joukov wrote: > > replication. In case of RAID4 and RAID5-like configurations, RAIF performed > > about two times *better* than software RAID and even better than an Adaptec > > 2120S RAID5 controller. This is because RAIF is located above file system > > caches and can cache parity as

Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-13 Thread Phillip Susi
Nikolai Joukov wrote: replication. In case of RAID4 and RAID5-like configurations, RAIF performed about two times *better* than software RAID and even better than an Adaptec 2120S RAID5 controller. This is because RAIF is located above file system caches and can cache parity as normal data when

[ANNOUNCE] RAIF: Redundant Array of Independent Filesystems

2006-12-13 Thread Nikolai Joukov
We have designed a new stackable file system that we called RAIF: Redundant Array of Independent Filesystems. Similar to Unionfs, RAIF is a fan-out file system and can be mounted over many different disk-based, memory, network, and distributed file systems. RAIF can use the stable and maintained c