Re: delta copies

2007-09-23 Thread Fabian Cenedese
>Not necessarily. Depending on how pg_dump works, it could be that >small changes to the database are resulting in unnecessarily large >changes to the dump. Make sure you are using the uncompressed format >because most compression algorithms defeat the delta-transfer >algorithm almost completely

Re: delta copies

2007-09-23 Thread WebTent
On Sun, 2007-09-23 at 17:46 -0400, Matt McCutchen wrote: > On 9/23/07, WebTent <[EMAIL PROTECTED]> wrote: > Not necessarily. Depending on how pg_dump works, it could be that > small changes to the database are resulting in unnecessarily large > changes to the dump. Make sure you are using the unc

Re: delta copies

2007-09-23 Thread Matt McCutchen
On 9/23/07, WebTent <[EMAIL PROTECTED]> wrote: > Well, I am getting matched data, but it just doesn't seem to be matching > very much considering the small change in file size. I tested one dump > after another rsyncing in between dumps and got very little matched > data :( > mx1# pg_dump -Fc -Upg

DO NOT REPLY [Bug 4834] --inplace with --backup --backup-dir does not work

2007-09-23 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=4834 [EMAIL PROTECTED] changed: What|Removed |Added Status|NEW |RESOLVED Resolution|

Re: delta copies

2007-09-23 Thread WebTent
On Sun, 2007-09-23 at 12:09 -0400, Matt McCutchen wrote: > On 9/23/07, Robert Fitzpatrick <[EMAIL PROTECTED]> wrote: > > On Sun, 2007-09-23 at 00:56 -0400, Matt McCutchen wrote: > > > Either the delta transfer algorithm is not being used due to a > > > misconfiguration, or the pgsql backups are cha

A preliminary design for an external DB for rsync

2007-09-23 Thread Wayne Davison
I've put some thought into adding DB support to rsync (in a future release). This would allow it to maintain some extra information about files and be able to lookup information rapidly. This would support things like caching of checksum information, finding files to hard-link with, saving file a

Re: compression of source and target files

2007-09-23 Thread Wayne Davison
On Sun, Sep 23, 2007 at 10:34:30AM -0400, Matt McCutchen wrote: > On 9/23/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > > i tried "--checksum" but it didn`t work as expected. In a future release (probably one past 3.0.0) I'm hoping to add a DB accessing protocol that will allow quite a few ex

Re: compression of source and target files

2007-09-23 Thread Wayne Davison
On Fri, Sep 21, 2007 at 01:10:18PM -0700, Kenneth Simpson wrote: > Sorry, I neglected to mention the source is uncompressed but > we need to compress the target file because we're running out > of disk space and the files are highly compressible. The BackupPC program has the ability to store files

Re: delta copies

2007-09-23 Thread Matt McCutchen
On 9/23/07, Robert Fitzpatrick <[EMAIL PROTECTED]> wrote: > On Sun, 2007-09-23 at 00:56 -0400, Matt McCutchen wrote: > > Either the delta transfer algorithm is not being used due to a > > misconfiguration, or the pgsql backups are changing in a perverse way > > that prevents it from matching any da

Re: delta copies

2007-09-23 Thread Matt McCutchen
On 9/23/07, Robert Fitzpatrick <[EMAIL PROTECTED]> wrote: > Doing some more testing this morning, maybe what you suggested about the > pgsql backup is what is happening. I took a closer look and realize that > my sql backup is actually smaller some days than the destination, will > that affect delt

Re: delta copies

2007-09-23 Thread Robert Fitzpatrick
On Sun, 2007-09-23 at 00:56 -0400, Matt McCutchen wrote: > On 9/22/07, Robert Fitzpatrick <[EMAIL PROTECTED]> wrote: > Either the delta transfer algorithm is not being used due to a > misconfiguration, or the pgsql backups are changing in a perverse way > that prevents it from matching any data. P

Re: compression of source and target files

2007-09-23 Thread Matt McCutchen
On 9/23/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > i can transfer remote files to a local dir and they are being compressed on > the > local side Good, so it basically works. > +Use of --dest-filter automatically enables --whole-file. I suppose the patch could be changed to allow delta

Re: compression of source and target files

2007-09-23 Thread devzero
oh, this is interesting patch - thanks for giving pointer. i have tried it and it and it looks interesting, but somewhat incomplete. i can transfer remote files to a local dir and they are being compressed on the local side, but (quite logical) this breaks size/content-checking. being also ment