Re: [CentOS] Deduplication data for CentOS?

2012-10-01 Thread joel billy
At our shop we have used quadstor - http://www.quadstor.com with good amount of success. But our use is specifically for vmware environments over a SAN. However it is possible (i have tried this a couple of times) to use the quadstor virtual disks as a local block device, format it with ext4 or btr

Re: [CentOS] Deduplication data for CentOS?

2012-09-13 Thread Ryan Palamara
Behalf Of Les Mikesell Sent: Thursday, September 13, 2012 3:09 PM To: CentOS mailing list Subject: Re: [CentOS] Deduplication data for CentOS? On Thu, Sep 13, 2012 at 12:06 PM, Ryan Palamara wrote: > The better option for ZFS would be to get a SSD and move the dedupe table > onto that

Re: [CentOS] Deduplication data for CentOS?

2012-09-13 Thread Les Mikesell
On Thu, Sep 13, 2012 at 12:06 PM, Ryan Palamara wrote: > The better option for ZFS would be to get a SSD and move the dedupe table > onto that drive instead of having it in RAM, because it can become massive. What's 'massive' in dollars these days? -- Les Mikesell lesmikes...@gmail.com

Re: [CentOS] Deduplication data for CentOS?

2012-09-13 Thread Ryan Palamara
-Original Message- From: centos-boun...@centos.org [mailto:centos-boun...@centos.org] On Behalf Of Dean Jones Sent: Monday, August 27, 2012 11:45 AM To: CentOS mailing list Subject: Re: [CentOS] Deduplication data for CentOS? Deduplication with ZFS takes a lot of RAM. I would not yet

Re: [CentOS] Deduplication data for CentOS?

2012-09-11 Thread Bob Hepple
Rainer Traut writes: > > Hi list, > > is there any working solution for deduplication of data for centos? > We are trying to find a solution for our backup server which runs a bash > script invoking xdelta(3). But having this functionality in fs is much > more friendly... > > We have looked

Re: [CentOS] Deduplication data for CentOS?

2012-08-29 Thread John R Pierce
On 08/29/12 2:43 AM, Rainer Traut wrote: > Yes, there is commercial software to do incremental backups but I do not > know of commandline options to do this. Maybe anyone? > > Les is right, I stop the server, take the snapshot, start the server and > do the xdelta on the snapshot NSF files. > Havin

Re: [CentOS] Deduplication data for CentOS?

2012-08-29 Thread Rainer Traut
Am 28.08.2012 21:26, schrieb Les Mikesell: > On Tue, Aug 28, 2012 at 2:04 PM, John R Pierce wrote: >> On 08/28/12 11:41 AM, Les Mikesell wrote: >>> On Tue, Aug 28, 2012 at 3:03 AM, Rainer Traut wrote: >>> > Rsync is of no use for us. We have mainly big Domino .nsf files which > only c

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread Les Mikesell
On Tue, Aug 28, 2012 at 2:04 PM, John R Pierce wrote: > On 08/28/12 11:41 AM, Les Mikesell wrote: >> On Tue, Aug 28, 2012 at 3:03 AM, Rainer Traut wrote: >> >>> >Rsync is of no use for us. We have mainly big Domino .nsf files which >>> >only change slightly. So rsync would not be able to ma

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread John R Pierce
On 08/28/12 11:41 AM, Les Mikesell wrote: > On Tue, Aug 28, 2012 at 3:03 AM, Rainer Traut wrote: >>> >> >> >Rsync is of no use for us. We have mainly big Domino .nsf files which >> >only change slightly. So rsync would not be able to make many hardlinks. :) > Rdiff-backup might work for this sinc

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread Les Mikesell
On Tue, Aug 28, 2012 at 3:03 AM, Rainer Traut wrote: >> > Rsync is of no use for us. We have mainly big Domino .nsf files which > only change slightly. So rsync would not be able to make many hardlinks. :) Rdiff-backup might work for this since it stores deltas. Are you doing something to snap

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread Leon Fauster
Am 28.08.2012 um 10:03 schrieb Rainer Traut: > Rsync is of no use for us. We have mainly big Domino .nsf files which > only change slightly. So rsync would not be able to make many hardlinks. :) can this endeavor ensure the consistence of this "database" files? -- LF __

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread John R Pierce
On 08/28/12 1:03 AM, Rainer Traut wrote: > Rsync is of no use for us. We have mainly big Domino .nsf files which > only change slightly. So rsync would not be able to make many hardlinks. :) so you need block level dedup? good luck with that. never seen a scheme yet that wasn't full of issues

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread John R Pierce
On 08/28/12 12:58 AM, Rainer Traut wrote: > The website looks promising. They are using a thing called SPL, > Sun/Solaris Porting Layer to be able to use the Solaris ZFS code. > But there is no more OpenSolaris, isn't it? Means they have to stay with > the ZFS code from when it was open? opensolar

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread Fajar Priyanto
Sorry for the top posting. Dedup is just a hype. After a while the table that manage the deduped data will be just too big. Don't use it for long term. Sent from Samsung Galaxy ^^ ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread Rainer Traut
Am 27.08.2012 22:55, schrieb Adam Tauno Williams: > On Mon, 2012-08-27 at 14:32 -0400, Brian Mathis wrote: >> On Mon, Aug 27, 2012 at 7:55 AM, Rainer Traut wrote: >>> We have looked into lessfs, sdfs and ddar. >>> Are these filesystems ready to use (on centos)? >>> ddar is sthg different, I know.

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread Rainer Traut
Am 27.08.2012 18:04, schrieb Les Mikesell: > On Mon, Aug 27, 2012 at 6:55 AM, Rainer Traut wrote: >> >> is there any working solution for deduplication of data for centos? >> We are trying to find a solution for our backup server which runs a bash >> script invoking xdelta(3). But having this func

Re: [CentOS] Deduplication data for CentOS?

2012-08-28 Thread Rainer Traut
Am 27.08.2012 16:04, schrieb Janne Snabb: > On 08/27/2012 07:23 PM, Rainer Traut wrote: > >> Yeah I know it has this feature, but is there a working zfs >> implementation for linux? > > I have heard some positive feedback about http://zfsonlinux.org/ but I > have not had time to test myself yet. It

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread Adam Tauno Williams
On Mon, 2012-08-27 at 14:32 -0400, Brian Mathis wrote: > On Mon, Aug 27, 2012 at 7:55 AM, Rainer Traut wrote: > > We have looked into lessfs, sdfs and ddar. > > Are these filesystems ready to use (on centos)? > > ddar is sthg different, I know. > This is something I have been thinking about perip

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread Brian Mathis
On Mon, Aug 27, 2012 at 7:55 AM, Rainer Traut wrote: > Hi list, > > is there any working solution for deduplication of data for centos? > We are trying to find a solution for our backup server which runs a bash > script invoking xdelta(3). But having this functionality in fs is much > more friendl

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread David C. Miller
- Original Message - > From: "Rainer Traut" > To: centos@centos.org > Sent: Monday, August 27, 2012 4:55:03 AM > Subject: [CentOS] Deduplication data for CentOS? > > Hi list, > > is there any working solution for deduplication of data for centos? >

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread Les Mikesell
On Mon, Aug 27, 2012 at 6:55 AM, Rainer Traut wrote: > > is there any working solution for deduplication of data for centos? > We are trying to find a solution for our backup server which runs a bash > script invoking xdelta(3). But having this functionality in fs is much > more friendly... > Bel

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread Leon Fauster
Am 27.08.2012 um 16:23 schrieb John R Pierce: > On 08/27/12 4:55 AM, Rainer Traut wrote: >> is there any working solution for deduplication of data for centos? >> We are trying to find a solution for our backup server which runs a bash >> script invoking xdelta(3). But having this functionality in

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread Dean Jones
Deduplication with ZFS takes a lot of RAM. I would not yet trust any of the linux zfs projects for data that I wanted to keep long term. On Mon, Aug 27, 2012 at 8:26 AM, Les Mikesell wrote: > On Mon, Aug 27, 2012 at 9:23 AM, John R Pierce wrote: >> On 08/27/12 4:55 AM, Rainer Traut wrote: >>> i

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread Les Mikesell
On Mon, Aug 27, 2012 at 9:23 AM, John R Pierce wrote: > On 08/27/12 4:55 AM, Rainer Traut wrote: >> is there any working solution for deduplication of data for centos? >> We are trying to find a solution for our backup server which runs a bash >> script invoking xdelta(3). But having this function

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread John R Pierce
On 08/27/12 4:55 AM, Rainer Traut wrote: > is there any working solution for deduplication of data for centos? > We are trying to find a solution for our backup server which runs a bash > script invoking xdelta(3). But having this functionality in fs is much > more friendly... BackupPC does exactl

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread Janne Snabb
On 08/27/2012 07:23 PM, Rainer Traut wrote: > Yeah I know it has this feature, but is there a working zfs > implementation for linux? I have heard some positive feedback about http://zfsonlinux.org/ but I have not had time to test myself yet. It probably depends on your intended usage. It is a n

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread Rainer Traut
Am 27.08.2012 14:15, schrieb John Doe: > From: Rainer Traut > >> is there any working solution for deduplication of data for centos? >> We are trying to find a solution for our backup server which runs a bash >> script invoking xdelta(3). But having this functionality in fs is much >> more friendl

Re: [CentOS] Deduplication data for CentOS?

2012-08-27 Thread John Doe
From: Rainer Traut > is there any working solution for deduplication of data for centos? > We are trying to find a solution for our backup server which runs a bash > script invoking xdelta(3). But having this functionality in fs is much > more friendly... > > We have looked into lessfs, sdfs a

[CentOS] Deduplication data for CentOS?

2012-08-27 Thread Rainer Traut
Hi list, is there any working solution for deduplication of data for centos? We are trying to find a solution for our backup server which runs a bash script invoking xdelta(3). But having this functionality in fs is much more friendly... We have looked into lessfs, sdfs and ddar. Are these file

Re: [CentOS] Deduplication

2011-03-10 Thread Fajar Priyanto
On Thu, Mar 10, 2011 at 10:01 PM, Lars Hecking wrote: > >> I haven't tried SDFS, but I've been using LessFS for our fileserver >> for few months now. > >  How do you do backup and archiving? It's a VM. I back it up to encrypted external HDD then off to offsite location. __

Re: [CentOS] Deduplication

2011-03-10 Thread Lars Hecking
> I haven't tried SDFS, but I've been using LessFS for our fileserver > for few months now. How do you do backup and archiving? ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] Deduplication

2011-03-10 Thread Fajar Priyanto
On Thu, Mar 10, 2011 at 9:28 PM, Lars Hecking wrote: > >  Has anyone played with SDFS on CentOS? Is it usable? > >  http://www.opendedup.org/ I haven't tried SDFS, but I've been using LessFS for our fileserver for few months now. Beside dedup, it also gives file compression. So far so good. I'll

[CentOS] Deduplication

2011-03-10 Thread Lars Hecking
Has anyone played with SDFS on CentOS? Is it usable? http://www.opendedup.org/ ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos