Re: [HACKERS] Making pg_standby compression-friendly

2008-10-27 Thread Charles Duffy
Koichi Suzuki wrote: As Heikki pointed out, the issue is not to decompress the compressed WAL, but also how we can keep archive log still compressed after it is handled by pg_standby. pg_standby makes a *copy* of the segment from the archive, and need only ensure that the copy is decompressed;

Re: [HACKERS] Making pg_standby compression-friendly

2008-10-27 Thread Kevin Grittner
>>> "Koichi Suzuki" <[EMAIL PROTECTED]> wrote: > As Heikki pointed out, the issue is not to decompress the compressed > WAL, but also how we can keep archive log still compressed after it is > handled by pg_standby. > > I'm afraid pg_standby cannot handle this solely, may need some support > by t

Re: [HACKERS] Making pg_standby compression-friendly

2008-10-27 Thread Koichi Suzuki
As Heikki pointed out, the issue is not to decompress the compressed WAL, but also how we can keep archive log still compressed after it is handled by pg_standby. I'm afraid pg_standby cannot handle this solely, may need some support by the pg core. For example, after closing archive log in arch

Re: [HACKERS] Making pg_standby compression-friendly

2008-10-24 Thread Charles Duffy
In the absence of further feedback from 'yall (and in the presence of some positive results from internal QA), I'm adding the posted patch as-is to the 2008-11 CommitFest queue. That said, any such additional feedback would be gratefully appreciated. -- Sent via pgsql-hackers mailing list (pg

Re: [HACKERS] Making pg_standby compression-friendly

2008-10-23 Thread Heikki Linnakangas
Koichi Suzuki wrote: In terms of compress/decompress WAL in archive/restore, please take a look at my project pglesslog, http://pgfoundry.org/projects/pglesslog/ This project compresses WAL segment by replacing full page writes with corresponding incremental logs. When restored, it inserts dum

Re: [HACKERS] Making pg_standby compression-friendly

2008-10-23 Thread Koichi Suzuki
In terms of compress/decompress WAL in archive/restore, please take a look at my project pglesslog, http://pgfoundry.org/projects/pglesslog/ This project compresses WAL segment by replacing full page writes with corresponding incremental logs. When restored, it inserts dummy WAL record to mainta

Re: [HACKERS] Making pg_standby compression-friendly

2008-10-22 Thread Charles Duffy
On Thu, Oct 23, 2008 at 1:15 AM, Heikki Linnakangas < [EMAIL PROTECTED]> wrote: > Charles Duffy wrote: > >> I'm interested in compressing archived WAL segments in an environment >> set up for PITR in the interests of reducing both network traffic and >> storage requirements. However, pg_standby pr

Re: [HACKERS] Making pg_standby compression-friendly

2008-10-22 Thread Heikki Linnakangas
Charles Duffy wrote: I'm interested in compressing archived WAL segments in an environment set up for PITR in the interests of reducing both network traffic and storage requirements. However, pg_standby presently checks file sizes, requiring that an archive segment be exactly the right size to be

[HACKERS] Making pg_standby compression-friendly

2008-10-22 Thread Charles Duffy
Howdy, all. I'm interested in compressing archived WAL segments in an environment set up for PITR in the interests of reducing both network traffic and storage requirements. However, pg_standby presently checks file sizes, requiring that an archive segment be exactly the right size to be considere