BDR PG9.4 Replica Identity Full

2018-01-04 Thread ning chan
Hi BDR PostgreSQL experts, I am recently trying out the logical decoding with Replica Identity Full using postgresql-bdr94-server. However, i seems to run in to a bug reporting in this thread https://github.com/2ndQuadrant/bdr/issues/104. I tested stock version of PG 9.4 and it works just fine.

Re: Replication questions - read-only and temporary read/write slaves

2018-01-04 Thread Michael Paquier
On Fri, Jan 5, 2018 at 3:58 AM, Tiffany Thang wrote: > Thanks for your input. What I meant to say was rolling back all the changes. > I was hoping for a way to temporary open the read-only standby in r/w for > testing purpose and then rollback all the changes made during the test > without having

Re: Bulk Insert/Update Scenario

2018-01-04 Thread Jordan Deitch
INSERT .. ON CONFLICT can be ran as a bulk operation: create table test(id int); insert into test(id) values (1), (2), (3), (4); Unless you mean you don't want to run this for every table? Thanks, Jordan Deitch http://id.rsa.pub

Re: Bulk Insert/Update Scenario

2018-01-04 Thread Mana M
Thanks Jordan. One more question I had was - anyway to avoid doing individual INSERT ... ON CONFLICT? I was thinking about dumping everything into TEMP table and using that as source for INSERT ... ON CONFLICT. However, I was not sure on how to get thousands of rows from my Python application into

Re: Bulk Insert/Update Scenario

2018-01-04 Thread legrand legrand
Hi, check documentation Populate a database this explains how to create a dummy table, load it using COPY command, and then INSERT / UPDATE target tables (using ON CONFLICT if needed) You can also investigate: - file_fdw

Re: Bulk Insert/Update Scenario

2018-01-04 Thread Jordan Deitch
Hi Mana, A starting point would be reading about the batch upsert functionality: https://www.postgresql.org/docs/current/static/sql-insert.html You would do something like: INSERT INTO table ON CONFLICT update... This operation would be atomic. You can also look into deferrable constraints such

Bulk Insert/Update Scenario

2018-01-04 Thread Mana M
I am setting up the data processing pipeline and the end result gets stored in Postgres. Have not been a heavy DB user in general and had question regarding how best to handle bulk insert/updates scenario with Postgres. Here is my use case: * I get file with thousands of entries (lines) periodical

Re: Production Database requirement

2018-01-04 Thread Michelle Konzack
Salam Mohammed, Am DATE hackte Azimuddin Mohammed in die Tasten: > Hello All, > Can anyone please let me know > > 1. What is the hardware and software requirement for postgressql to be > installed in production. We are planning to use postgres for hadoop > backend, to store user access info, meta

Re: Replication questions - read-only and temporary read/write slaves

2018-01-04 Thread Tiffany Thang
Michael, Thanks for your input. What I meant to say was rolling back all the changes. I was hoping for a way to temporary open the read-only standby in r/w for testing purpose and then rollback all the changes made during the test without having to re-create the standby from scratch. Thanks. Tiff

Re: Production Database requirement

2018-01-04 Thread Vincenzo Romano
2018-01-04 18:47 GMT+01:00 Azimuddin Mohammed : > Hello All, > Can anyone please let me know > > 1. What is the hardware and software requirement for postgressql to be > installed in production. We are planning to use postgres for hadoop backend, > to store user access info, metadata etc. So, it w

Re: Production Database requirement

2018-01-04 Thread Francis Santiago
2018-01-04 14:47 GMT-03:00 Azimuddin Mohammed : > Hello All, > Can anyone please let me know > > 1. What is the hardware and software requirement for postgressql to be > installed in production. We are planning to use postgres for hadoop > backend, to store user access info, metadata etc. So, it

Production Database requirement

2018-01-04 Thread Azimuddin Mohammed
Hello All, Can anyone please let me know 1. What is the hardware and software requirement for postgressql to be installed in production. We are planning to use postgres for hadoop backend, to store user access info, metadata etc. So, it will not be high transaction db, but we might see lost of re

Re: Pg Upgrade failing as it is not able to start and stop server properly

2018-01-04 Thread Bruce Momjian
On Thu, Jan 4, 2018 at 01:49:17PM +0530, kiran gadamsetty wrote: > While upgrading the PostgreSQL database from 9.1.4 to 9.6.4 version on > windows 2012 server, Pg_upgrade is failing as postgre service start and > stop are failing because of time outs. I got the information as using -m

Re: Pg Upgrade failing as it is not able to start and stop server properly

2018-01-04 Thread kiran gadamsetty
Hi All, Any help on this issue? Regards, Kiran G On Thu, Dec 21, 2017 at 3:03 PM, kiran gadamsetty < kirankumar.gadamse...@gmail.com> wrote: > Hi, > > While upgrading the PostgreSQL database from 9.1.4 to 9.6.4 version on > windows 2012 server, Pg_upgrade is failing as postgre service start an