Understanding logical replication lag

2021-01-21 Thread Patrick Molgaard
Hi all, *My top-level query is*: I'm using logical replication under pg 9.6 to do a kind of change data capture and I'm seeing occasional extended periods of significant lag. I'm not sure what conceptual model I'm missing in order to understand why this happens. *The details:* I'm running Postgr

Re: Multi-second pauses blocking even trivial activity

2018-09-21 Thread Patrick Molgaard
Andreas -- just following up to say that this was indeed the root cause. Thanks again. Patrick On Sat, 8 Sep 2018, 01:34 Patrick Molgaard, wrote: > This sounds extremely plausible -- thanks for the tip, Andreas. > > Best, > Patrick > > > On Fri, 7 Sep 2018, 19:20 Andreas

Re: How Do You Associate a Query With its Invoking Procedure?

2018-09-15 Thread Patrick Molgaard
You might find application-level tracing a more practical answer - e.g. check out Datadog APM for a (commercial) plug and play approach or Jaeger for a self-hostable option. Patrick On Fri, Sep 14, 2018 at 4:38 PM Fred Habash wrote: > Any ideas, please? > > On Thu, Sep 13, 2018, 3:49 PM Fd Habas

Re: Multi-second pauses blocking even trivial activity

2018-09-07 Thread Patrick Molgaard
This sounds extremely plausible -- thanks for the tip, Andreas. Best, Patrick On Fri, 7 Sep 2018, 19:20 Andreas Kretschmer, wrote: > > > > >Intermittently (one or two times a week), all queries on that host are > >simultaneously blocked for extended periods (10s of seconds). > > > >The blocked

Re: Multi-second pauses blocking even trivial activity

2018-09-07 Thread Patrick Molgaard
ck On Fri, 7 Sep 2018, 20:20 Jeff Janes, wrote: > On Fri, Sep 7, 2018 at 2:03 PM Patrick Molgaard > wrote: > >> >> Hi Jeff, >> >> Thanks for your reply. Are locks relevant in this case, though? >> > > I don't know, but why the

Re: Multi-second pauses blocking even trivial activity

2018-09-07 Thread Patrick Molgaard
. Or are there some system level locks that a trivial query, touching no relations, might be contending for? Best Patrick On Fri, 7 Sep 2018, 15:32 Jeff Janes, wrote: > On Fri, Sep 7, 2018 at 8:00 AM Patrick Molgaard > wrote: > >> Hi folks, >> >> I've been seein

Multi-second pauses blocking even trivial activity

2018-09-07 Thread Patrick Molgaard
Hi folks, I've been seeing some curious behaviour on a postgres server I administer. Intermittently (one or two times a week), all queries on that host are simultaneously blocked for extended periods (10s of seconds). The blocked queries are trivial & not related to locking - I'm seeing slowlogs