Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

Adam Leventhal wrote: > This is a great idea. I'd like to add a couple of suggestions: > > It might be interesting to focus on compression algorithms which are > optimized for particular workloads and data types, an Oracle database for > example. NB. Oracle 11g has builtin compression. In genera

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

pedantic comment below... dave johnson wrote: > "Richard Elling" <[EMAIL PROTECTED]> wrote: >> Dave Johnson wrote: >>> "roland" <[EMAIL PROTECTED] > wrote: >>> > >>> > there is also no filesystem based approach in >>> compressing/decompressing a whole filesystem. >>>

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

> Wouldn't ZFS's being an integrated filesystem make it > easier for it to > identify the file types vs. a standard block device > with a filesystem > overlaid upon it? > > I read in another post that with compression enabled, > ZFS attempts to > compress the data and stores it compressed if it

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

"Richard Elling" <[EMAIL PROTECTED]> wrote: > Dave Johnson wrote: >> "roland" <[EMAIL PROTECTED] > wrote: >> > >> > there is also no filesystem based approach in >> compressing/decompressing a whole filesystem. >> one could kludge this by setting the compression parame

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

On Mon, Jul 09, 2007 at 03:42:03PM -0700, Darren Dunham wrote: > > Wouldn't ZFS's being an integrated filesystem make it easier for it to > > identify the file types vs. a standard block device with a filesystem > > overlaid upon it? > > I'm not sure. I would think that most applications are go

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

On Mon, Jul 09, 2007 at 05:27:44PM -0500, Haudy Kazemi wrote: > Wouldn't ZFS's being an integrated filesystem make it easier for it to > identify the file types vs. a standard block device with a filesystem > overlaid upon it? How? The API to ZFS that most everything uses is the POSIX API. Ther

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

> Wouldn't ZFS's being an integrated filesystem make it easier for it to > identify the file types vs. a standard block device with a filesystem > overlaid upon it? I'm not sure. I would think that most applications are going to use the POSIX layer where there's no separate API for filetypes.

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

On Jul 9 2007, Domingos Soares wrote: >Hi, > >> It might be interesting to focus on compression algorithms which are >> optimized for particular workloads and data types, an Oracle database for >> example. > >Yes, I agree. That is what I meant when I said "The study might be >extended to the analy

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

Hi, > why not starting with lzo first - it`s already in zfs-fuse on linux and it > looks, that it`s just "in between lzjb and gzip" in terms of performance and > compression ratio. > there needs yet to be demonstrated that it behaves similar on solaris. Good question and I'm afraid I don't have

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

Hi, > It might be interesting to focus on compression algorithms which are > optimized for particular workloads and data types, an Oracle database for > example. Yes, I agree. That is what I meant when I said "The study might be extended to the analysis of data in specific applications (e.g. web

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

Dave Johnson wrote: > "roland" <[EMAIL PROTECTED] > wrote: > > > > there is also no filesystem based approach in > compressing/decompressing a whole filesystem. you can have 499gb of data > on a 500gb partition - and if you need some more space you would think > turni

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

"roland" <[EMAIL PROTECTED]> wrote: > > there is also no filesystem based approach in compressing/decompressing a > > whole filesystem. you can have 499gb of data on a 500gb partition - and if > > you need some more space you would think turning on compression on that fs > > would solve your pro

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

> zfs tries to compress a datablock and if that isn`t compressible enough, it > doesn`t store it compressed. That feature was pointed out to me off-list, and it makes great sense. I had not heard about that before this thread. This message posted from opensolaris.org ___

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

>One thing ZFS is missing is the ability to select which files to compress. yes. there is also no filesystem based approach in compressing/decompressing a whole filesystem. you can have 499gb of data on a 500gb partition - and if you need some more space you would think turning on compression on

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

Awesome initiative. One thing ZFS is missing is the ability to select which files to compress. Even a simple heuristic like "don't compress mp3,avi,zip,tar files" would yield a tremendous change in which data is compressed on consumer computers. I don't know if such a heuristic is planned o

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

nice idea! :) >We plan to start with the development of a fast implementation of a Burrows >Wheeler Transform based algorithm (BWT). why not starting with lzo first - it`s already in zfs-fuse on linux and it looks, that it`s just "in between lzjb and gzip" in terms of performance and compressi

Re: [zfs-discuss] ZFS Compression algorithms - Project Proposal

This is a great idea. I'd like to add a couple of suggestions: It might be interesting to focus on compression algorithms which are optimized for particular workloads and data types, an Oracle database for example. It might be worthwhile to have some sort of adaptive compression whereby ZFS could