Re: [zfs-discuss] Adding my own compression to zfs

2008-10-05 Thread MC
> It would be trivial to make the threshold a tunable, > but we're > trying to avoid this sort of thing. I don't want > there to be a > ZFS tuning guide, ever. That would mean we failed. > > Jeff harumph... http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide :-) Well now that

Re: [zfs-discuss] Adding my own compression to zfs

2008-07-30 Thread Robert Milkowski
Hello Rob, Sunday, July 20, 2008, 12:11:56 PM, you wrote: >> Robert Milkowski wrote: >> During christmass I managed to add my own compression to zfs - it as quite >> easy. RC> Great to see innovation but unless your personal compression RC> method is somehow better (very fast with excellent R

Re: [zfs-discuss] Adding my own compression to zfs

2008-07-20 Thread Rob Clark
> Robert Milkowski wrote: > During christmass I managed to add my own compression to zfs - it as quite > easy. Great to see innovation but unless your personal compression method is somehow better (very fast with excellent compression) then would it not be a better idea to use an existing (lea

Re: [zfs-discuss] Adding my own compression to zfs

2008-07-20 Thread Rob Clark
> Robert Milkowski wrote: > During christmass I managed to add my own compression to zfs - it as quite > easy. Great to see innovation but unless your personal compression method is somehow better (very fast with excellent compression) then would it not be a better idea to use an existing (lea

Re: [zfs-discuss] Adding my own compression to zfs

2007-11-30 Thread roland
*bump* just wanted to keep this into discussion. i think it could be important to zfs if it could compress faster with a better compressratio. This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://m

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-22 Thread Domingos Soares
> Yes, I think that was the original intent of the project proposal. It > could probably be reworded to decrease emphasis on a single algorithm, > but I read it as a generic exploration of alternative algorithms. Yes, you read right. The original intent was to investigate alternative algorithms i

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-17 Thread roland
being at $300 now - a friend of mine just adding another $100 This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-15 Thread Eric Schrock
Yes, I think that was the original intent of the project proposal. It could probably be reworded to decrease emphasis on a single algorithm, but I read it as a generic exploration of alternative algorithms. Pluggable algorithms is tricky, because compression is encoded as a single 8-bit quantity

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-14 Thread me
> I haven't heard from any other core contributors, but this sounds like a > worthy project to me. Someone from the ZFS team should follow through > to create the project on os.org[1] > > Its sounds like like Domingos and Roland might constitute the initial > "project team". In my opinion, the pr

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-13 Thread Eric Schrock
I haven't heard from any other core contributors, but this sounds like a worthy project to me. Someone from the ZFS team should follow through to create the project on os.org[1] Its sounds like like Domingos and Roland might constitute the initial "project team". - Eric [1] http://www.opensola

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-09 Thread roland
for those who are interested in lzo with zfs, i have made a special version of the patch taken from the zfs-fuse mailinglist: http://82.141.46.148/tmp/zfs-fuse-lzo.tgz this file contains the patch in unified diff format and also a broken out version (i.e. split into single files). maybe this m

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-08 Thread Toby Thain
On 8-Oct-07, at 5:39 PM, roland wrote: > besides re-inventing the wheel somebody at sun should wake up and > go ask mr. oberhumer and pay him $$$ to get lzo into ZFS. > > this is taken from http://www.oberhumer.com/opensource/lzo/ > lzodoc.php : > > Copyright > - > LZO is Copyright (

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-08 Thread roland
besides re-inventing the wheel somebody at sun should wake up and go ask mr. oberhumer and pay him $$$ to get lzo into ZFS. this is taken from http://www.oberhumer.com/opensource/lzo/lzodoc.php : Copyright - LZO is Copyright (C) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-08 Thread Domingos Soares
Hi Mario, This is common knowledge but not completely true. The bottleneck of BWT is the suffix sorting step and there have been many recent advances that significantly reduced the time and space needs of the algorithm. Of course, it will probably never be so fast as a lightweight Ziv-Lempel imple

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-08 Thread Mario Goebbels
> Besides, > there are some new results about BWT that I'm sure would be of > interest in this context. I thought bzip2/BWT is a compression scheme that has a heavy footprint and is generally brain damaging to implement? -mg signature.asc Description: OpenPGP digital signature

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-07 Thread Domingos Soares
Hi, No news. I received some very good suggestions, but unfortunately I didn't get as much discussion as I had hoped it would. I'm sending the project proposal again. I think that there are a lot of interesting things to research and develop regarding the subject and I hope this time we discuss a

Re: [zfs-discuss] Adding my own compression to zfs

2007-10-07 Thread roland
any news on additional compression-schemes for zfs ? this is interesting research-topic, imho :) so, some more real-world tests with zfs-fuse + lzo patch : -LZO zfs set compression=lzo mypool time cp /vmware/vserver1/vserver1.vmdk /mypool real