Re: [GENERAL] options for logical replication plugins?

2017-03-15 Thread Chris Withers
On 15/03/2017 19:18, Andres Freund wrote: Hi, On 2017-03-15 18:29:06 +, Chris Withers wrote: Shame the decoding has to be done on the server-side rather than the client side. Why? Requiring compiled extensions to be installed on the server is always going to be a pain, especially in a

Re: [GENERAL] pg_dump pg_restore hanging in CentOS for large data

2017-03-15 Thread Tom Lane
Sridevi B writes: >I am facing an issue with backup/Restore for data size more than *2GB*. I'm suspicious that you're running into some limit external to postgres itself. A couple of likely possibilities: * maybe you've got a ulimit active on the server or the pg_dump or pg_restore proces.

Re: [GENERAL] pg_dump pg_restore hanging in CentOS for large data

2017-03-15 Thread Adrian Klaver
On 03/14/2017 09:48 AM, Sridevi B wrote: Hi , I am facing an issue with backup/Restore for data size more than *2GB*. Its working fine for *1GB*. Below are the details for issue: Description: The command pg_dump is hanging at saving large objects and process gets terminated after som

Re: [GENERAL] options for logical replication plugins?

2017-03-15 Thread Andres Freund
Hi, On 2017-03-15 18:29:06 +, Chris Withers wrote: > Shame the decoding has to be done on the server-side rather than the client > side. Why? You can't filter on the client side. You don't have any catalog information available, so you'd have to transport a lot of metadata and / or decode t

[GENERAL] options for logical replication plugins?

2017-03-15 Thread Chris Withers
Hi All, What are the current "best" options for logical replication plugins? I saw wal2json and one that serialized to protobuf instead, and then of course there's bottledwater, but none of these smell particularly production ready. Shame the decoding has to be done on the server-side rather

Re: [GENERAL] Postgres backup solution

2017-03-15 Thread Francisco Olarte
Rich: On Tue, Mar 14, 2017 at 11:42 PM, Rich Shepard wrote: > 2.) I'm far from being a professional DBA but if I had to back up a 13T > database what I'd do (since I use only linux) is run pg_dump with the > archive (tar) format, then use dirvish to synchronize it with a remote copy. > Dirvish

Re: [GENERAL] UPDATE ... ON CONFLICT DO NOTHING

2017-03-15 Thread David G. Johnston
The convention on these lists is to inline or bottom-post. On Tue, Mar 14, 2017 at 12:07 PM, Yasin Sari wrote: > ​​ > Have you tried with inner block and do nothing on exception; > > ​I suppose that would work - though using an exception path for expected logic is messy - and considerably slower

[GENERAL] pg_dump pg_restore hanging in CentOS for large data

2017-03-15 Thread Sridevi B
Hi , I am facing an issue with backup/Restore for data size more than *2GB*. Its working fine for *1GB*. Below are the details for issue: Description: The command pg_dump is hanging at saving large objects and process gets terminated after some time. The command pg_restore is hangin

Re: [GENERAL] UPDATE ... ON CONFLICT DO NOTHING

2017-03-15 Thread Yasin Sari
Have you tried with inner block and do nothing on exception; BEGIN .. BEGIN UPDATE words_social SET uid = out_uid WHERE uid = ANY(_uids); EXCEPTION WHEN OTHERS THEN --do nothing or write NULL means do nothing

Re: [GENERAL] Postgres backup solution

2017-03-15 Thread Stuart Bishop
On 15 March 2017 at 03:04, John McKown wrote: > Your message is not diplaying. At least not for me. I guess that my reader > does not understand the "smime.p7m" file, which shows as an attachment. For > others, his question is: > > === original question from Lawrence Cohan === > > Yes, this is wh