Re: surprisingly slow creation of gist index used in exclude constraint

2021-12-22 Thread Chris Withers
, Chris On 14/05/2020 21:11, Chris Withers wrote: Hi, I'm upgrading a database from 9.4 to 11.5 by dumping from the old cluster and loading into the new cluster. The database is tiny: around 2.3G, but importing this table is pr

Re: surprisingly slow creation of gist index used in exclude constraint

2020-05-15 Thread Chris Withers
On 14/05/2020 21:31, Tom Lane wrote: Chris Withers writes: It has 4.1 million rows in it and while importing the data only takes a couple of minutes, when I did a test load into the new cluster, building the mkt_profile_period_col1_col4_col2_chan_excl index for the

Re: surprisingly slow creation of gist index used in exclude constraint

2020-05-14 Thread Chris Withers
On 14/05/2020 21:16, k...@rice.edu wrote: Hi Chris, This sounds like a candidate for pg_logical replicating from the old to new system. Can you point me to a good guide as to how to easily set this up for one database and would work between pg 9.4 and pg 11.5? cheers, Chris

surprisingly slow creation of gist index used in exclude constraint

2020-05-14 Thread Chris Withers
Hi, I'm upgrading a database from 9.4 to 11.5 by dumping from the old cluster and loading into the new cluster. The database is tiny: around 2.3G, but importing this table is proving problematic: Column | Type|Modifie

Re: Fwd: sensible configuration of max_connections

2020-02-07 Thread Chris Withers
On 07/02/2020 12:49, Chris Ellis wrote: What's "too much" for max_connections? What happens when you set it to high? What factors affect that number? When sizing max_connections you need to trade off how many connections your application will use at peak vs how much RAM and CPU you have.

sensible configuration of max_connections

2020-02-07 Thread Chris Withers
Hi All, What's a sensible way to pick the number to use for max_connections? I'm looking after a reasonable size multi-tenant cluster, where the master handles all the load and there's a slave in case of hardware failure in the master. The machine is used to host what I suspect are mainly djan

Re: here does postgres take its timezone information from?

2019-11-05 Thread Chris Withers
On 05/11/2019 22:54, Adrian Klaver wrote: On 11/5/19 2:46 PM, Chris Withers wrote: Hi All, Brazil recently abolished daylight savings time, resulting in updates to system timezone information packages. Does postgres use these? If so, does it need a reload or restart to see the updated zone

here does postgres take its timezone information from?

2019-11-05 Thread Chris Withers
Hi All, Brazil recently abolished daylight savings time, resulting in updates to system timezone information packages. Does postgres use these? If so, does it need a reload or restart to see the updated zone info? If not, how does postgres store/obtain its timezone zone information and how w

Re: granting right to create and delete just one database

2019-06-05 Thread Chris Withers
On 05/06/2019 09:52, Laurenz Albe wrote: Chris Withers wrote: Is there any way to grant rights to a user such that they can drop and re-create only a single database? No; what I'd do if I needed that is to create a SECURITY DEFINER function that is owned by a user with the CREATEDB priv

granting right to create and delete just one database

2019-06-04 Thread Chris Withers
Hi All, Is there any way to grant rights to a user such that they can drop and re-create only a single database? cheers, Chris

why would postgres be throttling a streaming replication slot's sending?

2018-12-12 Thread Chris Withers
On 11/12/2018 14:48, Achilleas Mantzios wrote: On 11/12/18 4:00 μ.μ., Chris Withers wrote: I'm looking after a multi-tenant PG 9.4 cluster, and we've started getting alerts for the number of WALs on the server. It'd be great to understand what's generating all that WAL a

finding out what's generating WALs

2018-12-11 Thread Chris Withers
Hi All, With a 9.4 cluster, what's the best way to find out what's generating the most WAL? I'm looking after a multi-tenant PG 9.4 cluster, and we've started getting alerts for the number of WALs on the server. It'd be great to understand what's generating all that WAL and what's likely to

Re: debugging intermittent slow updates under higher load

2018-12-06 Thread Chris Withers
On 06/12/2018 11:00, Alexey Bashtanov wrote: I'm loath to start hacking something up when I'd hope others have done a better job already... If you log all queries that take more than a second to complete, is your update the only one logged, or something (the would-be blocker) gets logged down

Re: debugging intermittent slow updates under higher load

2018-12-06 Thread Chris Withers
On 05/12/2018 15:47, Rene Romero Benavides wrote: Also read about hot updates and the storage parameter named "fill_factor", so, data blocks can be recycled instead of creating new ones if the updated fields don't update also indexes. I have read about these, but I'd prefer not to be making o

Re: debugging intermittent slow updates under higher load

2018-12-06 Thread Chris Withers
On 05/12/2018 15:40, Alexey Bashtanov wrote: One of the reasons could be the row already locked by another backend, doing the same kind of an update or something different. Are these updates performed in a longer transactions? Nope, the transaction will just be updating one row at a time.

Re: surprising query optimisation

2018-12-05 Thread Chris Withers
On 05/12/2018 14:38, Stephen Frost wrote: Greetings, * Chris Withers (ch...@withers.org) wrote: On 30/11/2018 15:33, Stephen Frost wrote: * Chris Withers (ch...@withers.org) wrote: On 28/11/2018 22:49, Stephen Frost wrote: For this, specifically, it's because you end up with exactly

debugging intermittent slow updates under higher load

2018-12-05 Thread Chris Withers
Hi All, This is on postgres 9.4.16, same table as the last question I asked, here's an abbreviated desc: # \d alerts_alert   Table "public.alerts_alert" Column  |   Type   | Modifiers -+--+---  tags   

Re: surprising query optimisation

2018-12-05 Thread Chris Withers
On 30/11/2018 22:10, Gavin Flower wrote: I once optimised a very complex set queries that made extensive use of indexes.  However, with the knowledge I have today, I would have most likely had fewer and smaller indexes.  As I now realize, that some of my indexes were probably counter producti

Re: surprising query optimisation

2018-12-05 Thread Chris Withers
On 30/11/2018 15:33, Stephen Frost wrote: Greetings, * Chris Withers (ch...@withers.org) wrote: On 28/11/2018 22:49, Stephen Frost wrote: * Chris Withers (ch...@withers.org) wrote: We have an app that deals with a lot of queries, and we've been slowly seeing performance issues emerg

Re: surprising query optimisation

2018-11-30 Thread Chris Withers
On 30/11/2018 12:55, Stephen Frost wrote: > I'd suggest you check out the wiki article written about this kind of > question: > > https://wiki.postgresql.org/wiki/Slow_Query_Questions Have you tried a partial index on state!=‘RSV’? The solution I originally posted, that we

Re: surprising query optimisation

2018-11-30 Thread Chris Withers
On 28/11/2018 22:49, Stephen Frost wrote: * Chris Withers (ch...@withers.org) wrote: We have an app that deals with a lot of queries, and we've been slowly seeing performance issues emerge. We take a lot of free form queries from users and stumbled upon a very surprising optimisation. S

surprising query optimisation

2018-11-28 Thread Chris Withers
Hi All, We have an app that deals with a lot of queries, and we've been slowly seeing performance issues emerge. We take a lot of free form queries from users and stumbled upon a very surprising optimisation. So, we have a 'state' column which is a 3 character string column with an index on

Re: unsubscribe

2017-11-20 Thread Chris Withers
Make it stap :'( On 20/11/2017 17:55, Zacher, Stacy wrote: