Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread David Hedberg
Hi, On Sat, Sep 29, 2018 at 8:03 PM, Stephen Frost wrote: > Greetings, > > * David Hedberg (david.hedb...@gmail.com) wrote: >> On Sat, Sep 29, 2018 at 7:01 PM, Stephen Frost wrote: >> > * David Hedberg (david.hedb...@gmail.com) wrote: >> >> On Sat, Sep 29, 2018 at 5:03 PM, Stephen Frost wrote:

Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread Stephen Frost
Greetings, * David Hedberg (david.hedb...@gmail.com) wrote: > On Sat, Sep 29, 2018 at 7:01 PM, Stephen Frost wrote: > > * David Hedberg (david.hedb...@gmail.com) wrote: > >> On Sat, Sep 29, 2018 at 5:03 PM, Stephen Frost wrote: > >> Generally, my thinking is that this can be pretty useful in gen

Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread Andres Freund
Hi, On 2018-09-29 14:51:33 +0200, David Hedberg wrote: > I recently wanted a way to encrypt/decrypt backups while still > utilizing the parallel dump/restore functionality. I couldn't see a > way to do this so I experimented a bit with the directory backup > format. If there's in fact already a wa

Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread David Hedberg
Hi, On Sat, Sep 29, 2018 at 7:01 PM, Stephen Frost wrote: > Greetings, > > * David Hedberg (david.hedb...@gmail.com) wrote: >> On Sat, Sep 29, 2018 at 5:56 PM, David Fetter wrote: >> > On Sat, Sep 29, 2018 at 11:42:40AM -0400, Tom Lane wrote: >> > As I understand it, those are the options for pr

Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread Stephen Frost
Greetings, * David Hedberg (david.hedb...@gmail.com) wrote: > On Sat, Sep 29, 2018 at 5:56 PM, David Fetter wrote: > > On Sat, Sep 29, 2018 at 11:42:40AM -0400, Tom Lane wrote: > > As I understand it, those are the options for providing secrets in > > general. At least in the case of encryption,

Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread David Hedberg
On Sat, Sep 29, 2018 at 5:56 PM, David Fetter wrote: > On Sat, Sep 29, 2018 at 11:42:40AM -0400, Tom Lane wrote: >> Stephen Frost writes: >> > * David Hedberg (david.hedb...@gmail.com) wrote: >> >> The idea is to add a --pipe option to pg_dump / pg_restore where >> >> you can specify a custom she

Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread David Fetter
On Sat, Sep 29, 2018 at 11:42:40AM -0400, Tom Lane wrote: > Stephen Frost writes: > > * David Hedberg (david.hedb...@gmail.com) wrote: > >> The idea is to add a --pipe option to pg_dump / pg_restore where > >> you can specify a custom shell command that is used to write / > >> read each .dat-file.

Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread Tom Lane
Stephen Frost writes: > * David Hedberg (david.hedb...@gmail.com) wrote: >> The idea is to add a --pipe option to pg_dump / pg_restore where you >> can specify a custom shell command that is used to write / read each >> .dat-file. Usage examples include encryption with pgp and/or custom >> compres

Re: Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread Stephen Frost
Greetings, * David Hedberg (david.hedb...@gmail.com) wrote: > I recently wanted a way to encrypt/decrypt backups while still > utilizing the parallel dump/restore functionality. I couldn't see a > way to do this so I experimented a bit with the directory backup > format. If there's in fact already

Adding pipe support to pg_dump and pg_restore

2018-09-29 Thread David Hedberg
Hello, I recently wanted a way to encrypt/decrypt backups while still utilizing the parallel dump/restore functionality. I couldn't see a way to do this so I experimented a bit with the directory backup format. If there's in fact already a way to do this, please tell me now :-) The idea is to add