Re: very high replay_lag on 3-node cluster

2019-07-22 Thread Tiemen Ruiten
Anyone have an idea? Thanks very much in advance for any reply. On Fri, Jul 19, 2019 at 1:46 PM Tiemen Ruiten wrote: > Hello, > > In my previous post[1] on this list I brought up an issue with long > running checkpoints. I reduced checkpoint_timeout to a more reasonable > value (15m down from 60

Re: very high replay_lag on 3-node cluster

2019-07-22 Thread Jehan-Guillaume (ioguix) de Rorthais
Hi, On Mon, 22 Jul 2019 11:05:57 +0200 Tiemen Ruiten wrote: [...] > > Now to my current issue: I took the advice to add more monitoring on > > replay lag (using pg_last_xact_replay_timestamp) and things are not looking > > good. Last night replication lagged by almost 6 hours on one of the > > no

Re: very high replay_lag on 3-node cluster

2019-07-22 Thread Tiemen Ruiten
On Mon, Jul 22, 2019 at 11:28 AM Jehan-Guillaume (ioguix) de Rorthais < iog...@free.fr> wrote: > Hi, > > On Mon, 22 Jul 2019 11:05:57 +0200 > Tiemen Ruiten wrote: > [...] > > > Now to my current issue: I took the advice to add more monitoring on > > > replay lag (using pg_last_xact_replay_timesta

Re: How to run a task continuously in the background

2019-07-22 Thread Rory Campbell-Lange
On 19/07/19, Peter J. Holzer (hjp-pg...@hjp.at) wrote: > On 2019-07-17 12:34:41 +0100, Rory Campbell-Lange wrote: > > We make extensive use of postgresql 'contacting' an external process, > > but our use case involves many databases in a cluster rather than many > > schemas. Also we don't have to d

Re: very high replay_lag on 3-node cluster

2019-07-22 Thread Jehan-Guillaume (ioguix) de Rorthais
On Mon, 22 Jul 2019 12:58:47 +0200 Tiemen Ruiten wrote: [...] > I've attached a graph of network IO on all servers. The network config is > identical for all three nodes: 2x bonded gigabit connection to the same > stacked switch pair. AFAICS, Network doesn't looks saturated. > Currently I don't

Re: Rearchitecting for storage

2019-07-22 Thread Luca Ferrari
On Fri, Jul 19, 2019 at 4:41 PM Matthew Pounsett wrote: > My current backup plan for this database is on-site replication, and a > monthly pg_dump from the standby to be copied off-site. Doing per-table > backups sounds like a great way to end up with an inconsistent backup, but > perhaps I mi

PGbackrest capacity related question

2019-07-22 Thread chiru r
Hi All, I am using pgbackrest on my production workloads and it is working as expected. However our DB is growing more and more . We have currently two disks and each one is 4 TB size. However 3.8TB size data got loaded into DB currently and our /pgback mount point size is 4TB. So if the DB size

Re: PGbackrest capacity related question

2019-07-22 Thread David Steele
On 7/22/19 5:08 PM, chiru r wrote: Hi  All, I am using pgbackrest on my production workloads and it is working as expected. However our DB is growing more and more . We have currently two disks and each one is 4 TB size. However 3.8TB size data got loaded into DB currently and our /pgback mou

Re: PGbackrest capacity related question

2019-07-22 Thread chiru r
Thank you David. On Mon, Jul 22, 2019 at 6:44 PM David Steele wrote: > On 7/22/19 5:08 PM, chiru r wrote: > > Hi All, > > > > I am using pgbackrest on my production workloads and it is working as > > expected. > > However our DB is growing more and more . > > We have currently two disks and eac

Re: Queries on QMF to POSTGRE

2019-07-22 Thread Oleksandr Shulgin
-hackers +pgsql general On Sun, Jul 21, 2019 at 7:33 PM JVM . wrote: > > > I’m looking to convert QMF Queries , QMF forms and QMF procedure to the > POSTGRESQL will it support all of them. > > If yes please help us with the sample example. Or any Documentation. > What would help anyone willing

Re: Queries on QMF to POSTGRE

2019-07-22 Thread Ron
On 7/23/19 12:30 AM, Oleksandr Shulgin wrote: -hackers +pgsql general On Sun, Jul 21, 2019 at 7:33 PM JVM . > wrote: I’m looking to convert QMF Queries , QMF forms and QMF procedure to the POSTGRESQL will it support a