Re: Add A Glossary

2020-03-19 Thread Alvaro Herrera
I gave this a look. I first reformatted it so I could read it; that's 0001. Second I changed all the long items into s, which are shorter and don't have to repeat the title of the refered to page. (Of course, this changes the link to be in the same style as every other link in our documentation;

Re: error context for vacuum to include block number

2020-03-19 Thread Justin Pryzby
On Thu, Mar 19, 2020 at 03:29:31PM -0500, Justin Pryzby wrote: > I was going to suggest that we could do that by passing in a pointer to a > local > variable "LVRelStats olderrcbarg", like: > |update_vacuum_error_cbarg(vacrelstats, VACUUM_ERRCB_PHASE_SCAN_HEAP, > |

Re: nbtree: assertion failure in _bt_killitems() for posting tuple

2020-03-19 Thread Peter Geoghegan
On Thu, Mar 19, 2020 at 9:34 AM Anastasia Lubennikova wrote: > During tests, we catched an assertion failure in _bt_killitems() for > posting tuple in unique index: > > /* kitem must have matching offnum when heap TIDs match */ > Assert(kitem->indexOffset == offnum); > > https://github.com/postgre

Re: Missing errcode() in ereport

2020-03-19 Thread Tom Lane
I wrote: > I think that at least some compilers will complain about side-effect-free > subexpressions of a comma expression. Could we restructure things so > that the errcode/errmsg/etc calls form a standalone comma expression > rather than appearing to be arguments of a varargs function? Yeah, t

Re: improve transparency of bitmap-only heap scans

2020-03-19 Thread Justin Pryzby
On Mon, Mar 16, 2020 at 09:08:36AM -0400, James Coleman wrote: > Does the original optimization cover parallel bitmap heap scans like this? It works for parallel bitmap only scans. template1=# explain analyze select count(*) from exp where a between 25 and 35 and d between 5 and 10; Finalize Ag

Re: improve transparency of bitmap-only heap scans

2020-03-19 Thread James Coleman
On Thu, Mar 19, 2020 at 9:26 PM Justin Pryzby wrote: > > On Mon, Mar 16, 2020 at 09:08:36AM -0400, James Coleman wrote: > > Does the original optimization cover parallel bitmap heap scans like this? > > It works for parallel bitmap only scans. > > template1=# explain analyze select count(*) from e

Re: Add A Glossary

2020-03-19 Thread Corey Huinker
On Thu, Mar 19, 2020 at 8:11 PM Alvaro Herrera wrote: > I gave this a look. I first reformatted it so I could read it; that's > 0001. Second I changed all the long items into s, which > Thanks! I didn't know about xrefs, that is a big improvement. > are shorter and don't have to repeat the

Re: Missing errcode() in ereport

2020-03-19 Thread Andres Freund
Hi, On 2020-03-19 19:32:55 -0400, Tom Lane wrote: > Andres Freund writes: > > On 2020-03-19 14:07:04 -0400, Tom Lane wrote: > >> Now that we can rely on having varargs macros, I think we could > >> stop requiring the extra level of parentheses, > > > I think that'd be an improvement, because: > >

Re: Berserk Autovacuum (let's save next Mandrill)

2020-03-19 Thread David Rowley
On Fri, 20 Mar 2020 at 11:17, Andres Freund wrote: > I think there's too much "reinventing" autovacuum scheduling in a > "local" insert-only manner happening in this thread. And as far as I can > tell additionally only looking at a somewhat narrow slice of insert only > workloads. I understand yo

Re: Missing errcode() in ereport

2020-03-19 Thread Andres Freund
Hi, On 2020-03-19 21:03:17 -0400, Tom Lane wrote: > I wrote: > > I think that at least some compilers will complain about side-effect-free > > subexpressions of a comma expression. Could we restructure things so > > that the errcode/errmsg/etc calls form a standalone comma expression > > rather t

Re: color by default

2020-03-19 Thread Bruce Momjian
On Tue, Mar 3, 2020 at 02:31:01PM +0900, Michael Paquier wrote: > On Mon, Mar 02, 2020 at 01:00:44PM +0100, Juan José Santamaría Flecha wrote: > > - The new entry in the documentation, specially as the PG_COLORS parameter > > seems to be currently undocumented. The programs that can use PG_COLOR >

Re: Berserk Autovacuum (let's save next Mandrill)

2020-03-19 Thread Andres Freund
Hi, On 2020-03-20 15:05:03 +1300, David Rowley wrote: > On Fri, 20 Mar 2020 at 11:17, Andres Freund wrote: > > I think there's too much "reinventing" autovacuum scheduling in a > > "local" insert-only manner happening in this thread. And as far as I can > > tell additionally only looking at a som

Re: Missing errcode() in ereport

2020-03-19 Thread Tom Lane
Andres Freund writes: > I wonder if it'd become a relevant backpatch pain if we started to have > some ereports() without the additional parens in 13+. Yeah, it would be a nasty backpatch hazard. > Would it perhaps > make sense to backpatch just the part that removes the need for the > parents,

Re: Missing errcode() in ereport

2020-03-19 Thread Andres Freund
Hi, On 2020-03-19 22:32:30 -0400, Tom Lane wrote: > Andres Freund writes: > > I wonder if it'd become a relevant backpatch pain if we started to have > > some ereports() without the additional parens in 13+. > > Yeah, it would be a nasty backpatch hazard. > > > Would it perhaps > > make sense t

Re: Memory-Bounded Hash Aggregation

2020-03-19 Thread Pengzhou Tang
Hi, I happen to notice that "set enable_sort to false" cannot guarantee the planner to use hashagg in test groupingsets.sql, the following comparing results of sortagg and hashagg seems to have no meaning. Thanks, Pengzhou On Thu, Mar 19, 2020 at 7:36 AM Jeff Davis wrote: > > Committed. > > Th

Re: Improving connection scalability: GetSnapshotData()

2020-03-19 Thread Thomas Munro
On Sun, Mar 1, 2020 at 9:36 PM Andres Freund wrote: > conns tps master tps pgxact-split > > 1 26842.49284526524.194821 > 10 246923.158682 249224.782661 > 50 695956.539704 709833.746374 > 100 1054727.043139 1903616.306028 >

Re: Memory-Bounded Hash Aggregation

2020-03-19 Thread Pengzhou Tang
On Fri, Mar 20, 2020 at 1:20 PM Pengzhou Tang wrote: > Hi, > > I happen to notice that "set enable_sort to false" cannot guarantee the > planner to use hashagg in test groupingsets.sql, > the following comparing results of sortagg and hashagg seems to have no > meaning. > > Please forget my comme

Re: error context for vacuum to include block number

2020-03-19 Thread Amit Kapila
On Fri, Mar 20, 2020 at 5:59 AM Justin Pryzby wrote: > > On Thu, Mar 19, 2020 at 03:29:31PM -0500, Justin Pryzby wrote: > > I was going to suggest that we could do that by passing in a pointer to a > > local > > variable "LVRelStats olderrcbarg", like: > > |update_vacuum_error_cbarg(vacre

Re: Berserk Autovacuum (let's save next Mandrill)

2020-03-19 Thread Laurenz Albe
On Thu, 2020-03-19 at 15:17 -0700, Andres Freund wrote: > I am doubtful it should be committed with the current settings. See below. > > > From 3ba4b572d82969bbb2af787d1bccc72f417ad3a0 Mon Sep 17 00:00:00 2001 > > From: Laurenz Albe > > Date: Thu, 19 Mar 2020 20:26:43 +0100 > > Subject: [PATCH] A

Re: Improving connection scalability: GetSnapshotData()

2020-03-19 Thread Andres Freund
Hi, Thanks for looking! On 2020-03-20 18:23:03 +1300, Thomas Munro wrote: > On Sun, Mar 1, 2020 at 9:36 PM Andres Freund wrote: > > I'm still working on cleaning that part of the patch up, I'll post it in > > a bit. > > I looked at that part on your public pgxact-split branch. In that > versio

Re: Berserk Autovacuum (let's save next Mandrill)

2020-03-19 Thread Laurenz Albe
On Thu, 2020-03-19 at 14:38 -0700, Andres Freund wrote: > > I am not sure about b). In my mind, the objective is not to prevent > > anti-wraparound vacuums, but to see that they have less work to do, > > because previous autovacuum runs already have frozen anything older than > > vacuum_freeze_min

Re: Internal key management system

2020-03-19 Thread Masahiko Sawada
On Fri, 20 Mar 2020 at 01:38, Bruce Momjian wrote: > > On Fri, Mar 20, 2020 at 12:50:27AM +0900, Masahiko Sawada wrote: > > On Fri, Mar 20, 2020 at 0:35 Bruce Momjian wrote: > > Well, the issue is if the user can control the user key, there is might > > be > > a way to make the user key

Re: Berserk Autovacuum (let's save next Mandrill)

2020-03-19 Thread Andres Freund
Hi, On 2020-03-19 06:45:48 +0100, Laurenz Albe wrote: > On Tue, 2020-03-17 at 18:02 -0700, Andres Freund wrote: > > I don't think a default scale factor of 0 is going to be ok. For > > large-ish tables this will basically cause permanent vacuums. And it'll > > sometimes trigger for tables that act

Re: replay pause vs. standby promotion

2020-03-19 Thread Atsushi Torikoshi
On Fri, Mar 6, 2020 at 10:18 PM Fujii Masao wrote: > > OK, so patch attached. > > This patch causes, if a promotion is triggered while recovery is paused, > the paused state to end and a promotion to continue. OTOH, this patch > makes pg_wal_replay_pause() and _resume() throw an error if it's exe

Re: Berserk Autovacuum (let's save next Mandrill)

2020-03-19 Thread Andres Freund
Hi, On 2020-03-20 06:59:57 +0100, Laurenz Albe wrote: > On Thu, 2020-03-19 at 15:17 -0700, Andres Freund wrote: > > I am *VERY* doubtful that the attempt of using a large threshold, and a > > tiny scale factor, is going to work out well. I'm not confident enough > > in my gut feeling to full throa

Re: [PATCH] Add schema and table names to partition error

2020-03-19 Thread Amit Kapila
On Thu, Mar 19, 2020 at 8:21 PM Chris Bandy wrote: > > On 3/18/20 11:46 PM, Amit Kapila wrote: > > On Thu, Mar 19, 2020 at 3:55 AM Chris Bandy wrote: > >> > >> > >> Sorry for these troubles. Attached are patches created using `git > >> format-patch -n -v6` on master at 487e9861d0. > >> > > > > No

Re: error context for vacuum to include block number

2020-03-19 Thread Justin Pryzby
On Fri, Mar 20, 2020 at 11:24:25AM +0530, Amit Kapila wrote: > On Fri, Mar 20, 2020 at 5:59 AM Justin Pryzby wrote: > That makes sense. I have a few more comments: > > 1. > + VACUUM_ERRCB_PHASE_INDEX_CLEANUP, > +} errcb_phase; > > Why do you need a comma after the last element in the above enum

Re: [PATCH] Add schema and table names to partition error

2020-03-19 Thread Amit Kapila
On Thu, Mar 19, 2020 at 3:34 PM Amit Langote wrote: > > Thank you Chris, Amit. > > On Thu, Mar 19, 2020 at 1:46 PM Amit Kapila wrote: > > On Thu, Mar 19, 2020 at 3:55 AM Chris Bandy wrote: > > > > > > > > > Sorry for these troubles. Attached are patches created using `git > > > format-patch -n -

<    1   2