Re: pg_upgrade failing for 200+ million Large Objects

2021-03-09 Thread Justin Pryzby
be unimportant. -- Justin [1] https://www.postgresql.org/message-id/502641.1606334432%40sss.pgh.pa.us | Does pg_dump really have sane performance for that situation, or | are we soon going to be fielding requests to make it not be O(N^2) | in the number of listed tables? >From cfc7400bb02165

Re: [HACKERS] Custom compression methods

2021-03-10 Thread Justin Pryzby
On Wed, Mar 10, 2021 at 03:50:48PM -0500, Robert Haas wrote: > On Wed, Mar 10, 2021 at 6:52 AM Dilip Kumar wrote: > > The pending comment is providing a way to rewrite a table and > > re-compress the data with the current compression method. > > I spent some time poking at this yesterday and ran

Re: [HACKERS] Custom compression methods

2021-03-10 Thread Justin Pryzby
Korotkov and Justin Pryzby Discussions: https://www.postgresql.org/message-id/20171213151818.75a20...@postgrespro.ru https://www.postgresql.org/message-id/CA%2BTgmoaKDW1Oi9V%3Djc9hOGyf77NbkNEABuqgHD1Cq%3D%3D1QsOcxg%40mail.gmail.com https://www.postgresql.org/message-id/CA%2BTgmobS

Re: [HACKERS] Custom compression methods

2021-03-10 Thread Justin Pryzby
On Thu, Mar 11, 2021 at 08:17:46AM +0530, Dilip Kumar wrote: > On Thu, Mar 11, 2021 at 2:21 AM Robert Haas wrote: > > > > On Wed, Mar 10, 2021 at 6:52 AM Dilip Kumar wrote: > > > The pending comment is providing a way to rewrite a table and > > > re-compress the data with the current compression

Re: Self-join optimisation

2021-03-11 Thread Justin Pryzby
On Thu, Mar 11, 2021 at 03:32:16PM +0100, Matthias van de Meent wrote: > On Thu, 11 Mar 2021 at 15:15, Hywel Carver wrote: > > I asked this question in the Postgres Slack, and was recommended to ask > > here instead. > > > > A few times, I've been in a situation where I want to join a table to >

Re: Parallel INSERT (INTO ... SELECT ...)

2021-03-11 Thread Justin Pryzby
On Thu, Mar 11, 2021 at 01:01:42PM +, houzj.f...@fujitsu.com wrote: > > I guess to have the finer granularity we'd have to go with > > enable_parallel_insert, > > which then would mean possibly having to later add enable_parallel_update, > > should parallel update have similar potential overhe

Re: [HACKERS] Custom compression methods

2021-03-11 Thread Justin Pryzby
On Thu, Mar 11, 2021 at 10:07:30AM +0530, Dilip Kumar wrote: > On Thu, Mar 11, 2021 at 8:50 AM Justin Pryzby wrote: > > > > Looking at v23-0002-alter-table-set-compression, ATRewriteTable() was > > calling > > CompareCompressionMethodAndDecompress(). > > Whil

Re: [HACKERS] Custom compression methods

2021-03-11 Thread Justin Pryzby
On Mon, Mar 01, 2021 at 08:53:09PM +0530, Dilip Kumar wrote: > On Mon, Mar 1, 2021 at 5:36 PM Dilip Kumar wrote: > > On Mon, Mar 1, 2021 at 11:06 AM Justin Pryzby wrote: > > > Thanks. It seems like that explains it. > > > I think if that's a problem with rece

Re: [HACKERS] Custom compression methods

2021-03-11 Thread Justin Pryzby
On Fri, Mar 12, 2021 at 08:38:41AM +0530, Dilip Kumar wrote: > On Thu, Mar 11, 2021 at 11:55 PM Justin Pryzby wrote: > > On Wed, Mar 10, 2021 at 08:28:58PM -0600, Justin Pryzby wrote: > > > This includes a patch to use pkgconfig, in an attempt to build on mac, > > >

Re: [HACKERS] Custom compression methods

2021-03-11 Thread Justin Pryzby
On Fri, Mar 12, 2021 at 11:24:57AM +0530, Dilip Kumar wrote: > On Fri, Mar 12, 2021 at 10:45 AM Justin Pryzby wrote: > > > > On Thu, Mar 11, 2021 at 12:25:26PM -0600, Justin Pryzby wrote: > > > On Wed, Mar 10, 2021 at 08:28:58PM -0600, Justin Pryzby wrote: > > &g

Re: Different compression methods for FPI

2021-03-11 Thread Justin Pryzby
On Sat, Mar 06, 2021 at 12:29:14PM +0500, Andrey Borodin wrote: > > 1 марта 2021 г., в 10:03, Justin Pryzby написал(а): > > Justin, Michael, thanks for comments! > > As far as I understood TODO list for the patch looks as follows: Your patch can be simplified some, and then

Re: [HACKERS] Custom compression methods

2021-03-12 Thread Justin Pryzby
I think these names need to be more specific. +typedef enum CompressionId +{ +PGLZ_COMPRESSION_ID = 0, +LZ4_COMPRESSION_ID = 1 + CompressionId, PGLZ_COMPRESSION_ID, LZ4_COMPRESSION_ID are also being used by Andrey's WAL compression patch. I suggested he use a prefix, but your pat

Re: [HACKERS] GSoC 2017: Foreign Key Arrays

2021-03-12 Thread Justin Pryzby
On Fri, Mar 12, 2021 at 11:32:27PM +0200, Mark Rofail wrote: > I have retested the patch on a windows build and it passes the regression > tests thanks to Justin's recommendations. Hopefully, it will pass CI too. > > Changelog: > - v7 (compatible with current master 2021-3-12, > commit 02b5940dbe

Re: Different compression methods for FPI

2021-03-12 Thread Justin Pryzby
On Fri, Mar 12, 2021 at 01:45:47AM -0600, Justin Pryzby wrote: > On Sat, Mar 06, 2021 at 12:29:14PM +0500, Andrey Borodin wrote: > > > 1 марта 2021 г., в 10:03, Justin Pryzby написал(а): > > > > Justin, Michael, thanks for comments! > > > > As far as I unde

Re: Different compression methods for FPI

2021-03-14 Thread Justin Pryzby
On Sat, Mar 13, 2021 at 08:48:33PM +0500, Andrey Borodin wrote: > > 13 марта 2021 г., в 06:28, Justin Pryzby написал(а): > > Updated patch with a minor fix to configure.ac to avoid warnings on OSX. > > And 2ndary patches from another thread to allow passing recovery tes

Re: Different compression methods for FPI

2021-03-14 Thread Justin Pryzby
lTransactionId GetTopFullTransactionId(void); extern FullTransactionId GetTopFullTransactionIdIfAny(void); extern FullTransactionId GetCurrentFullTransactionId(void); extern FullTransactionId GetCurrentFullTransactionIdIfAny(void); -extern void MarkCurrentTransactionIdLoggedIfAny(void); +extern vo

Re: Parallel INSERT (INTO ... SELECT ...)

2021-03-14 Thread Justin Pryzby
On Mon, Mar 15, 2021 at 11:25:26AM +0530, Amit Kapila wrote: > On Fri, Mar 12, 2021 at 3:01 PM houzj.f...@fujitsu.com wrote: > > > > Attaching new version patch with this change. > > Thanks, the patch looks good to me. I have made some minor cosmetic > changes in the attached. I am planning to pus

Re: Different compression methods for FPI

2021-03-15 Thread Justin Pryzby
On Sun, Mar 14, 2021 at 07:31:35PM -0500, Justin Pryzby wrote: > On Sat, Mar 13, 2021 at 08:48:33PM +0500, Andrey Borodin wrote: > > > 13 марта 2021 г., в 06:28, Justin Pryzby > > > написал(а): > > > Updated patch with a minor fix to configure.ac to avoid war

Re: [HACKERS] PATCH: Batch/pipelining support for libpq

2021-03-15 Thread Justin Pryzby
Are you going to update the assertion ? +#if 0 Assert((meta == META

Re: [PATCH]: Allow errors in parameter values to be reported during the BIND phase itself..

2021-03-15 Thread Justin Pryzby
On Mon, Mar 15, 2021 at 06:45:49PM -0400, Tom Lane wrote: > Justin Pryzby writes: > > For example: > > $ python3.5 -c "import pg; db=pg.DB(); q = db.query(\"SET > > log_parameter_max_length_on_error=-1;\"); db.prepare('p', 'SELECT > > \$

Re: [PATCH]: Allow errors in parameter values to be reported during the BIND phase itself..

2021-03-15 Thread Justin Pryzby
On Mon, Mar 15, 2021 at 08:30:18PM -0400, Tom Lane wrote: > + /* Pop the error callback */ > + error_context_stack = error_context_stack->previous; > + > /* > * Once all parameters have been received, prepare for > printing them >

Re: [HACKERS] Custom compression methods

2021-03-15 Thread Justin Pryzby
I'm a minor contributor now to a couple bits of this patch set, but I can answer a couple of these points. On Mon, Mar 15, 2021 at 03:58:35PM -0700, Andres Freund wrote: > Comments about 0003: > - why is HIDE_TOAST_COMPRESSION useful? Doesn't quite seem to be > comparable to HIDE_TABLEAM? That

Re: Resetting spilled txn statistics in pg_stat_replication

2020-10-26 Thread Justin Pryzby
On Fri, Oct 23, 2020 at 10:45:34AM +0530, Amit Kapila wrote: > On Fri, Oct 23, 2020 at 8:59 AM Amit Kapila wrote: > > > > On Fri, Oct 23, 2020 at 7:42 AM Masahiko Sawada > > wrote: > > > > > > On Thu, 22 Oct 2020 at 20:34, Amit Kapila wrote: > > > > > > > > > > I have modified the description of

Re: Autovacuum on partitioned table (autoanalyze)

2020-10-26 Thread Justin Pryzby
On Fri, Oct 23, 2020 at 03:12:51PM +0900, yuzuko wrote: > Hello, > > I reconsidered a way based on the v5 patch in line with > Horiguchi-san's comment. > > This approach is as follows: > - A partitioned table is checked whether it needs analyze like a plain > table in relation_needs_vacanalyze

[PATCH] remove deprecated v8.2 containment operators

2020-10-26 Thread Justin Pryzby
rom 7868fee24f92fb5150735f1f9507cfe9a6ab212c Mon Sep 17 00:00:00 2001 From: Justin Pryzby Date: Sat, 11 Apr 2020 22:57:06 -0500 Subject: [PATCH] remove deprecated v8.2 containment operators See also: ba920e1c9182eac55d5f1327ab0d29b721154277 684ad6a92fcc33adebdab65c4e7d72a68ba05408 --- contrib/cube/cub

Re: CREATE TABLE .. PARTITION OF fails to preserve tgenabled for inherited row triggers

2020-10-27 Thread Justin Pryzby
On Wed, Oct 21, 2020 at 02:02:37PM -0300, Alvaro Herrera wrote: > On 2020-Oct-21, Justin Pryzby wrote: > > > I came up with this, which probably needs more than a little finesse. > > Hmm, there are two important changes needed on this: 1) it must not emit > CREATE lines f

Re: Resetting spilled txn statistics in pg_stat_replication

2020-10-27 Thread Justin Pryzby
On Tue, Oct 27, 2020 at 09:17:43AM +0530, Amit Kapila wrote: > On Tue, Oct 27, 2020 at 8:51 AM Justin Pryzby wrote: > > > > On Fri, Oct 23, 2020 at 10:45:34AM +0530, Amit Kapila wrote: > > > On Fri, Oct 23, 2020 at 8:59 AM Amit Kapila > > > wrote: > > >

CLUSTER on partitioned index

2020-10-27 Thread Justin Pryzby
ed indexes, and invalidates indisclustered when attaching unclustered indexes. Also, I noticed that CREATE TABLE (LIKE.. INCLUDING INDEXES) doesn't preserve indisclustered, but I can't say that's an issue. -- Justin >From dd4588352f99186f28fc666c497f85a87ac11da2 Mon Sep 17 00:00:00

DROP INDEX CONCURRENTLY on partitioned index

2020-10-27 Thread Justin Pryzby
Forking this thread, since the existing CFs have been closed. https://www.postgresql.org/message-id/flat/20200914143102.GX18552%40telsasoft.com#58b1056488451f8594b0f0ba40996afd On Mon, Sep 14, 2020 at 09:31:03AM -0500, Justin Pryzby wrote: > On Sat, Sep 12, 2020 at 10:35:34AM +0900, Mich

Re: pg_ls_tmpdir to show directories and shared filesets (and pg_ls_*)

2020-10-28 Thread Justin Pryzby
On Tue, Sep 08, 2020 at 02:51:26PM -0500, Justin Pryzby wrote: > On Sat, Jul 18, 2020 at 03:15:32PM -0500, Justin Pryzby wrote: > > Still waiting for feedback from a committer. > > This patch has been waiting for input from a committer on the approach I've > taken with the

Re: psql \df choose functions by their arguments

2020-10-28 Thread Justin Pryzby
On Thu, Oct 15, 2020 at 01:21:06PM -0400, Greg Sabino Mullane wrote: > Improve psql \df to choose functions by their arguments I think this is a good idea. This isn't working for arrays: postgres=# \df aa public | aa | integer | integer, integer| func public | aa | int

Re: pg_dump, ATTACH, and independently restorable child partitions

2020-10-29 Thread Justin Pryzby
On Sat, Oct 24, 2020 at 02:59:49PM -0500, Justin Pryzby wrote: > On Fri, Oct 23, 2020 at 12:29:40AM -0500, Justin Pryzby wrote: > > Since this commit, pg_dump CREATEs tables and then ATTACHes them: > > > > |commit 33a53130a89447e171a8268ae0b221bb48af6468 > > |Author

Re: should INSERT SELECT use a BulkInsertState?

2020-10-29 Thread Justin Pryzby
On Thu, Oct 22, 2020 at 01:29:53PM +0100, Simon Riggs wrote: > On Fri, 16 Oct 2020 at 22:05, Justin Pryzby wrote: > > > > > I made this conditional on BEGIN BULK/SET bulk, so I'll solicit > > > > comments on that. > > I think it would be better

Re: Assertion failure when ATTACH partition followed by CREATE PARTITION.

2020-10-30 Thread Justin Pryzby
TILITY_TOPLEVEL, params=0x0, queryEnv=0x0, > > dest=0x2dc1aa8, qc=0 x7fff225f67c0) at utility.c:524 > > #8 0x0093f163 in PortalRunUtility (portal=0x2e22ab0, > > pstmt=0x2dc19b8, isTopLevel=true, setHoldSnapshot=false, dest=0x2dc1 > > aa8, qc=0x7fff225f67c0) at pquery.c:1159 > > #9 0x0093f380 in PortalRunMulti (portal=0x2e22ab0, > > isTopLevel=true, setHoldSnapshot=false, dest=0x2dc1aa8, altdest=0x2dc1 > > aa8, qc=0x7fff225f67c0) at pquery.c:1305 > > #10 0x0093e882 in PortalRun (portal=0x2e22ab0, > > count=9223372036854775807, isTopLevel=true, run_once=true, > > dest=0x2dc1aa8, altdest=0x2dc1aa8, qc=0x7fff225f67c0) at pquery.c:779 > > #11 0x009389e8 in exec_simple_query (query_string=0x2dc07c0 > > "CREATE TABLE fail PARTITION OF public.sales \nFOR VALUES FROM > > ('2019-01-15') TO ('2019-02-15');") at postgres.c:1239 > > > > Regards, > > Amul Sul -- Justin Pryzby System Administrator Telsasoft +1-952-707-8581

Re: bulk typos

2020-10-30 Thread Justin Pryzby
On Sun, Oct 25, 2020 at 02:48:49PM -0500, Justin Pryzby wrote: > On Sat, Mar 31, 2018 at 05:56:40AM -0500, Justin Pryzby wrote: > > I needed another distraction so bulk-checked for typos, limited to comments > > in > > *.[ch]. > > > > I'm not passionate ab

Re: Add important info about ANALYZE after create Functional Index

2020-10-30 Thread Justin Pryzby
On Fri, Oct 30, 2020 at 03:22:52PM +0900, Michael Paquier wrote: > On Thu, Oct 29, 2020 at 10:59:52AM +0900, Michael Paquier wrote: > > REINDEX CONCURRENTLY is by design wanted to provide an experience > > transparent to the user similar to what a plain REINDEX would do, at > > least that's the ide

CREATE INDEX CONCURRENTLY on partitioned index

2020-10-30 Thread Justin Pryzby
CONCURRENTLY. If it's interrupted, it leaves INVALID indexes, which can be cleaned up with DROP or REINDEX, same as CIC on a plain table. On Sat, Aug 08, 2020 at 01:37:44AM -0500, Justin Pryzby wrote: > On Mon, Jun 15, 2020 at 09:37:42PM +0900, Michael Paquier wrote: > > On Mon, Jun 15,

Re: Allow CLUSTER, VACUUM FULL and REINDEX to change tablespace on the fly

2020-10-31 Thread Justin Pryzby
On Wed, Sep 23, 2020 at 07:43:01PM +0300, Alexey Kondratov wrote: > On 2020-09-09 18:36, Justin Pryzby wrote: > > Rebased on a6642b3ae: Add support for partitioned tables and indexes in > > REINDEX > > > > So now this includes the new functionality and test for reindex

Re: Additional Chapter for Tutorial

2020-10-31 Thread Justin Pryzby
ils concerning xmin, xmax, and user data. @@ -1059,7 +1059,7 @@ The setting of the flags is silently done by VACUUM and Autovacuum during their bloat and freeze operations. This is done to speed up future vacuum actions, -regular accesses to heap pages, and some accesses to

Re: Add important info about ANALYZE after create Functional Index

2020-10-31 Thread Justin Pryzby
On Sun, Nov 01, 2020 at 10:11:06AM +0900, Michael Paquier wrote: > On Fri, Oct 30, 2020 at 10:30:13PM -0500, Justin Pryzby wrote: > > (I'm quoting from the commit message of the patch I wrote, which is same as > > your patch). > > (I may have missed something, but you d

reindex partitioned indexes: refactor ReindexRelationConcurrently ?

2020-11-01 Thread Justin Pryzby
te_index found 2453 heap tuples, 2453 index tuples; inserted 0 missing tuples |DEBUG: validate_index found 2453 heap tuples, 2453 index tuples; inserted 0 missing tuples |REINDEX I think the usual scenario is to have 100-1000 partitions, and 1-10 indexes per partition. It seems to me that at

Re: [PATCH] remove pg_archivecleanup and pg_standby

2020-11-02 Thread Justin Pryzby
On Thu, Oct 29, 2020 at 08:40:31PM +0100, Michael Banck wrote: > Am Mittwoch, den 28.10.2020, 21:44 -0500 schrieb Justin Pryzby: > > Forking this thread: > > https://www.postgresql.org/message-id/fd93f1c5-7818-a02c-01e5-1075ac0d4...@iki.fi > > I think these are old-fashio

Re: should INSERT SELECT use a BulkInsertState?

2020-11-02 Thread Justin Pryzby
On Mon, Nov 02, 2020 at 07:53:45AM +0100, Luc Vlaming wrote: > On 30.10.20 05:51, Justin Pryzby wrote: > > On Thu, Oct 22, 2020 at 01:29:53PM +0100, Simon Riggs wrote: > > > On Fri, 16 Oct 2020 at 22:05, Justin Pryzby wrote: > > > > > > > > > I mad

Re: CLUSTER on partitioned index

2020-11-04 Thread Justin Pryzby
@cfbot: rebased On Tue, Oct 27, 2020 at 07:33:12PM -0500, Justin Pryzby wrote: > I'm attaching a counter-proposal to your catalog change, which preserves > indisclustered on children of clustered, partitioned indexes, and invalidates > indisclustered when attaching unclustered index

Re: pg_ls_tmpdir to show directories and shared filesets (and pg_ls_*)

2020-11-05 Thread Justin Pryzby
On Wed, Oct 28, 2020 at 02:34:02PM -0500, Justin Pryzby wrote: > On Tue, Sep 08, 2020 at 02:51:26PM -0500, Justin Pryzby wrote: > > On Sat, Jul 18, 2020 at 03:15:32PM -0500, Justin Pryzby wrote: > > > Still waiting for feedback from a committer. > > > > This patch h

Re: Yet another fast GiST build

2020-11-05 Thread Justin Pryzby
On Thu, Nov 05, 2020 at 10:11:52PM +0500, Andrey Borodin wrote: > To test that functions are actually called for sorting build we should > support directive sorting build like "CREATE INDEX ON A USING GIST(B) > WITH(sorting=surely,and fail if not)". Maybe you could add a DEBUG1 message for that,

list_free() in index_get_partition()

2020-11-05 Thread Justin Pryzby
704e5be9233e319 Author: Justin Pryzby Date: Thu Nov 5 12:06:49 2020 -0600 list_free() in index_get_partition() which was added at: a6da0047158b8a227f883aeed19eb7fcfbef11fb diff --git a/src/backend/catalog/partition.c b/src/backend/catalog/partition.c index 239ac017fa..4dfac39adf 1

Re: Implementing Incremental View Maintenance

2020-11-05 Thread Justin Pryzby
maintenance (IVM)." -- Justin >From 568f8626e2d9ab0deb25ac9e10089a79abecdab0 Mon Sep 17 00:00:00 2001 From: Justin Pryzby Date: Thu, 5 Nov 2020 22:54:23 -0600 Subject: [PATCH] incremental view doc fixes --- doc/src/sgml/catalogs.sgml| 2 +- .../sgml/ref/create_materialized_view.sgml| 44 +++---

Re: bitmaps and correlation

2020-11-06 Thread Justin Pryzby
there's a reason why it's written like that, but (min-max) looks odd, so I wrote it like: pages_fetched = max - c**2 * (max-min) > The new status of this patch is: Waiting on Author >From af1e640af2b1a80430191a38b80dde1f2b750757 Mon Sep 17 00:00:00 2001 From: Justin Pryzby Date: Wed, 8

Re: Multi Inserts in CREATE TABLE AS - revived patch

2020-11-10 Thread Justin Pryzby
On Tue, Nov 10, 2020 at 10:17:15AM +, Paul Guo wrote: > Raw insert could be used on CTAS & Create MatView. For Refresh MatView the > code is a bit > different. I did not spend more time on this so not sure raw insert could be > used for that. > > But I think the previous multi insert work co

Re: Add important info about ANALYZE after create Functional Index

2020-11-12 Thread Justin Pryzby
indexes can immediately > +use these statistics to determine an index's usefulness. > +For new expression indexes, it is necessary to run +linkend="sql-analyze">ANALYZE or wait for > +the autovacuum daemon to analyze > + the table to generate stat

error_severity of brin work item

2020-11-13 Thread Justin Pryzby
I saw a bunch of these in my logs: log_time | 2020-10-25 22:59:45.619-07 database | left | could not open relation with OID 292103095 left | processing work entry for relation "ts.child.alarms_202010_alarm_clear_time_idx" Those happen following a REINDEX job on that index. I think that

Re: error_severity of brin work item

2020-11-13 Thread Justin Pryzby
On Fri, Nov 13, 2020 at 01:39:31PM -0300, Alvaro Herrera wrote: > On 2020-Nov-13, Justin Pryzby wrote: > > > I saw a bunch of these in my logs: > > > > log_time | 2020-10-25 22:59:45.619-07 > > database | > > left | could not open relation with OID 2921

Re: More time spending with "delete pending"

2020-11-14 Thread Justin Pryzby
On Sat, Nov 14, 2020 at 01:00:00PM +0300, Alexander Lakhin wrote: > As noted in [1], a sensible solution would be putting the same "retry on > ERROR_ACCESS_DENIED" action in a wrapper for stat(). > And bed90759f brought in master the _pgstat64() function, where such > error handling should be place

Re: CLUSTER on partitioned index

2020-11-15 Thread Justin Pryzby
On Wed, Nov 04, 2020 at 08:23:56PM -0600, Justin Pryzby wrote: > On Tue, Oct 27, 2020 at 07:33:12PM -0500, Justin Pryzby wrote: > > I'm attaching a counter-proposal to your catalog change, which preserves > > indisclustered on children of clustered, partitioned indexes,

Re: Split copy.c

2020-11-15 Thread Justin Pryzby
On Tue, Nov 03, 2020 at 03:15:27PM +1300, David Rowley wrote: > On Tue, 3 Nov 2020 at 07:35, Andres Freund wrote: > > > > On 2020-11-02 19:43:38 +0200, Heikki Linnakangas wrote: > > > On 02/11/2020 19:23, Andres Freund wrote: > > > > On 2020-11-02 11:03:29 +0200, Heikki Linnakangas wrote: > > > >

Re: Add important info about ANALYZE after create Functional Index

2020-11-16 Thread Justin Pryzby
On Thu, Nov 12, 2020 at 06:01:02PM -0500, Bruce Momjian wrote: > On Thu, Nov 12, 2020 at 03:11:43PM -0600, Justin Pryzby wrote: > > I guess it should say "The system regularly ..." > > > > Also, the last sentence begins "For new expression indexes" and en

Re: [PATCH] remove deprecated v8.2 containment operators

2020-11-16 Thread Justin Pryzby
On Fri, Nov 13, 2020 at 10:03:43AM -0500, Stephen Frost wrote: > * Magnus Hagander (mag...@hagander.net) wrote: > > On Thu, Nov 12, 2020 at 11:28 PM Tom Lane wrote: > > > > The changes to the contrib modules appear to be incomplete in some ways. > > > > In cube, hstore, and seg, there are no cha

Re: planner support functions: handle GROUP BY estimates ?

2020-11-17 Thread Justin Pryzby
t > is, this does not work, for example: > > test=# create table t (a pg_statistic[]); > ERROR: column "stavalues1" has pseudo-type anyarray It works during initdb for the reasons that it's allowed for pg_statistic. -- Justin >From b9dabd3b773b077e55bb5ea23b89eb3d650029ee Mon Sep 17 00:00:00 20

Re: proposal: possibility to read dumped table's name from file

2020-11-17 Thread Justin Pryzby
f option we need created foreign server or accept +# fail and check error + +open $inputfile, '>', "$tempdir/inputfile.txt"; + +print $inputfile "+f doesnt_exists\n"; +close $inputfile; + +command_fails_like( + [ "pg_dump", '-p', $port, "-f"

Re: error_severity of brin work item

2020-11-19 Thread Justin Pryzby
On Fri, Nov 13, 2020 at 12:11:21PM -0600, Justin Pryzby wrote: > On Fri, Nov 13, 2020 at 01:39:31PM -0300, Alvaro Herrera wrote: > > On 2020-Nov-13, Justin Pryzby wrote: > > > > > I saw a bunch of these in my logs: > > > > > > log_time | 2020-10-25 22

Re: error_severity of brin work item

2020-11-19 Thread Justin Pryzby
On Thu, Nov 19, 2020 at 03:15:21PM -0300, Alvaro Herrera wrote: > On 2020-Nov-19, Justin Pryzby wrote: > > > On Fri, Nov 13, 2020 at 12:11:21PM -0600, Justin Pryzby wrote: > > > > Your patch didn't actually say "try_relation_open", so didn't work. >

Re: pg_dump, ATTACH, and independently restorable child partitions

2020-11-20 Thread Justin Pryzby
On Fri, Nov 06, 2020 at 11:18:35PM -0300, Alvaro Herrera wrote: > On 2020-Oct-24, Justin Pryzby wrote: > > > On Fri, Oct 23, 2020 at 12:29:40AM -0500, Justin Pryzby wrote: > > > > Now that I look, it seems like this is calling PQexec(), which sends a > > > sin

Re: jit and explain nontext

2020-11-20 Thread Justin Pryzby
On Fri, Nov 20, 2020 at 04:56:38PM +0100, Peter Eisentraut wrote: > On 2020-10-17 21:21, Justin Pryzby wrote: > > Added at:https://commitfest.postgresql.org/30/2766/ > > > > diff --git a/src/backend/commands/explain.c b/src/backend/commands/explain.c > > index 41

Re: jit and explain nontext

2020-11-21 Thread Justin Pryzby
On Sat, Nov 21, 2020 at 08:39:11AM +0100, Peter Eisentraut wrote: > On 2020-11-20 17:16, Justin Pryzby wrote: > > It matters if it was planned with jit but executed without jit. > > > > postgres=# DEALLOCATE p; SET jit=on; SET jit_above_cost=0; prepare p as > > sele

Re: [PATCH] remove pg_standby

2020-11-21 Thread Justin Pryzby
On Fri, Nov 20, 2020 at 05:26:54PM +0100, Peter Eisentraut wrote: > On 2020-10-29 03:44, Justin Pryzby wrote: > > diff --git a/doc/src/sgml/contrib.sgml b/doc/src/sgml/contrib.sgml > > index 4e833d79ef..be4292ec33 100644 > > --- a/doc/src/sgml/contrib.sgml > > +++

optimizer/clauses.h needn't include access/htup.h

2020-11-23 Thread Justin Pryzby
It was only needed between these: commit a8677e3ff6bb8ef78a9ba676faa647bba237b1c4 Author: Peter Eisentraut Date: Fri Apr 13 17:06:28 2018 -0400 Support named and default arguments in CALL commit f09346a9c6218dd239fdf3a79a729716c0d305bd Author: Tom Lane Date: Tue Jan 29 15:48:51 2019 -0

Re: should INSERT SELECT use a BulkInsertState?

2020-11-23 Thread Justin Pryzby
On Mon, Nov 02, 2020 at 12:45:51PM -0600, Justin Pryzby wrote: > On Mon, Nov 02, 2020 at 07:53:45AM +0100, Luc Vlaming wrote: > > On 30.10.20 05:51, Justin Pryzby wrote: > > > On Thu, Oct 22, 2020 at 01:29:53PM +0100, Simon Riggs wrote: > > > > On Fri, 16 Oc

Re: Allow CLUSTER, VACUUM FULL and REINDEX to change tablespace on the fly

2020-11-24 Thread Justin Pryzby
On Sat, Oct 31, 2020 at 01:36:11PM -0500, Justin Pryzby wrote: > > > From the grammar perspective ANY option is available for any command > > > that uses parenthesized option list. All the checks and validations > > > are performed at the corresponding command code. &g

Re: PoC/WIP: Extended statistics on expressions

2020-11-24 Thread Justin Pryzby
On Mon, Nov 23, 2020 at 04:30:26AM +0100, Tomas Vondra wrote: > 0004 - Seems fine. IMHO not really "silly errors" but OK. This is one of the same issues you pointed out - shadowing a variable. Could be backpatched. On Mon, Nov 23, 2020 at 04:30:26AM +0100, Tomas Vondra wrote: > > +

Re: error_severity of brin work item

2020-11-25 Thread Justin Pryzby
On Mon, Nov 23, 2020 at 04:39:57PM -0300, Alvaro Herrera wrote: > I think this formulation (attached v3) has fewer moving parts. > > However, now that I did that, I wonder if this is really the best > approach to solve this problem. Maybe instead of doing this at the BRIN > level, it should be ha

Re: proposal: possibility to read dumped table's name from file

2020-11-28 Thread Justin Pryzby
I would almost certainly not use it if it were json. But it'd be swell if there were a standard config file format, that handled postgresql.conf and maybe pg_hba.conf. -- Justin >From d9bac559d235f568a3419070205f05d77853a87f Mon Sep 17 00:00:00 2001 From: Justin Pryzby Date: Sat, 28 Nov

Re: CLUSTER on partitioned index

2020-11-28 Thread Justin Pryzby
On Sun, Nov 15, 2020 at 07:53:35PM -0600, Justin Pryzby wrote: > On Wed, Nov 04, 2020 at 08:23:56PM -0600, Justin Pryzby wrote: > > On Tue, Oct 27, 2020 at 07:33:12PM -0500, Justin Pryzby wrote: > > > I'm attaching a counter-proposal to your catalog change, which preserves

Re: pg_ls_tmpdir to show directories and shared filesets (and pg_ls_*)

2020-11-29 Thread Justin Pryzby
On Mon, Nov 23, 2020 at 04:14:18PM -0500, Tom Lane wrote: > Justin Pryzby writes: > >> This patch has been waiting for input from a committer on the approach I've > >> taken with the patches since March 10, so I'm planning to set to "Ready" - > >

Re: [doc] remove reference to pg_dump pre-8.1 switch behaviour

2020-11-29 Thread Justin Pryzby
On Mon, Oct 26, 2020 at 09:18:00AM +0200, Heikki Linnakangas wrote: > On 25/10/2020 23:56, Justin Pryzby wrote: > > On Fri, Oct 23, 2020 at 11:09:26PM +0300, Heikki Linnakangas wrote: > > > Findings in detail follow. > > > > Are you working on a patch for the

Re: CREATE INDEX CONCURRENTLY on partitioned index

2020-11-29 Thread Justin Pryzby
On Sat, Oct 31, 2020 at 01:31:17AM -0500, Justin Pryzby wrote: > Forking this thread, since the existing CFs have been closed. > https://www.postgresql.org/message-id/flat/20200914143102.GX18552%40telsasoft.com#58b1056488451f8594b0f0ba40996afd > > The strategy is to create catalog ent

Re: should INSERT SELECT use a BulkInsertState?

2020-11-29 Thread Justin Pryzby
On Mon, Nov 23, 2020 at 08:00:20PM -0600, Justin Pryzby wrote: > On Mon, Nov 02, 2020 at 12:45:51PM -0600, Justin Pryzby wrote: > > On Mon, Nov 02, 2020 at 07:53:45AM +0100, Luc Vlaming wrote: > > > On 30.10.20 05:51, Justin Pryzby wrote: > > > > On Thu, Oct 22, 2

allow to \dtS+ pg_toast.*

2020-11-30 Thread Justin Pryzby
toast show its main table -- Justin >From 99317e354e0a2744d7f72930773ab4cf78733f26 Mon Sep 17 00:00:00 2001 From: Justin Pryzby Date: Wed, 28 Oct 2020 23:51:39 -0500 Subject: [PATCH v1] Allow to \dt+ pg_toast.* --- src/bin/psql/describe.c | 14 ++ 1 file changed, 6 insertions(+)

Re: jit and explain nontext

2020-11-30 Thread Justin Pryzby
On Sat, Nov 21, 2020 at 10:26:00AM -0600, Justin Pryzby wrote: > On Sat, Nov 21, 2020 at 08:39:11AM +0100, Peter Eisentraut wrote: > > On 2020-11-20 17:16, Justin Pryzby wrote: > > > It matters if it was planned with jit but executed without jit. > > > > > >

Re: [PATCH] remove deprecated v8.2 containment operators

2020-11-30 Thread Justin Pryzby
On Mon, Nov 30, 2020 at 09:51:12PM +0300, Anastasia Lubennikova wrote: > On 16.11.2020 23:55, Justin Pryzby wrote: > > On Fri, Nov 13, 2020 at 10:03:43AM -0500, Stephen Frost wrote: > > > * Magnus Hagander (mag...@hagander.net) wrote: > > > > On Thu, Nov 12, 20

Re: [HACKERS] Custom compression methods

2021-01-10 Thread Justin Pryzby
On Mon, Jan 11, 2021 at 12:11:54PM +0530, Dilip Kumar wrote: > On Mon, Jan 11, 2021 at 11:00 AM Dilip Kumar wrote: > > On Sun, Jan 10, 2021 at 10:59 PM Justin Pryzby wrote: > > > > > > On Mon, Jan 04, 2021 at 04:57:16PM +0530, Dilip Kumar wrote: > > > >

Re: libpq compression

2021-01-11 Thread Justin Pryzby
On Mon, Jan 11, 2021 at 04:53:51PM +0300, Konstantin Knizhnik wrote: > On 09.01.2021 23:31, Justin Pryzby wrote: > > I suggest that there should be an enum of algorithms, which is constant > > across > > all servers. They would be unconditionally included and not #ifdef

Re: pg_upgrade test for binary compatibility of core data types

2021-01-11 Thread Justin Pryzby
On Mon, Jan 11, 2021 at 03:28:08PM +0100, Peter Eisentraut wrote: > On 2020-12-27 20:07, Justin Pryzby wrote: > > On Wed, Dec 16, 2020 at 11:22:23AM -0600, Justin Pryzby wrote: > > > On Sun, Dec 06, 2020 at 12:02:48PM -0600, Justin Pryzby wrote: > > > > I meant to

Re: libpq compression

2021-01-12 Thread Justin Pryzby
On Tue, Jan 12, 2021 at 08:44:43AM +0300, Konstantin Knizhnik wrote: > On 11.01.2021 20:38, Tomas Vondra wrote: > > 1) Fixes the MSVC makefile. The list of files is sorted alphabetically, > > so I've added the file at the end. > Thank you This is still failing the windows build. I think you need

Re: pg_upgrade test for binary compatibility of core data types

2021-01-12 Thread Justin Pryzby
On Tue, Jan 12, 2021 at 12:15:59PM -0500, Bruce Momjian wrote: > On Mon, Jan 11, 2021 at 10:13:52PM -0600, Justin Pryzby wrote: > > On Mon, Jan 11, 2021 at 03:28:08PM +0100, Peter Eisentraut wrote: > > > I think these patches could use some in-place documentation of wh

Re: jit and explain nontext

2021-01-15 Thread Justin Pryzby
On Fri, Jan 15, 2021 at 02:53:49PM -0500, Tom Lane wrote: > On balance I agree with Peter's opinion that this isn't worth > changing. I would be for the patch if the executor had a little > more freedom of action, but as things stand there's not much > freedom there. Thanks for looking CF: withdr

Re: PoC/WIP: Extended statistics on expressions

2021-01-16 Thread Justin Pryzby
On Sat, Jan 16, 2021 at 05:48:43PM +0100, Tomas Vondra wrote: > + > + expr text > + > + > + Expression the extended statistics is defined on > + Expression the extended statistics ARE defined on Or maybe say "on which the extended statistics are defined" > +

Re: PoC/WIP: Extended statistics on expressions

2021-01-16 Thread Justin Pryzby
On Sun, Jan 17, 2021 at 01:23:39AM +0100, Tomas Vondra wrote: > diff --git a/doc/src/sgml/ref/create_statistics.sgml > b/doc/src/sgml/ref/create_statistics.sgml > index 4363be50c3..5b8eb8d248 100644 > --- a/doc/src/sgml/ref/create_statistics.sgml > +++ b/doc/src/sgml/ref/create_statistics.sgml > @

Re: list of extended statistics on psql

2021-01-17 Thread Justin Pryzby
On Sun, Jan 17, 2021 at 03:31:57PM +0100, Tomas Vondra wrote: > I've reverted the commit - once we find the right way to handle this, I'll > get it committed again. Please consider these doc changes for the next iteration. commit 1a69f648ce6c63ebb37b6d8ec7c6539b3cb70787 Autho

pg_collation_actual_version() ERROR: cache lookup failed for collation 123

2021-01-17 Thread Justin Pryzby
As of 257836a75, this returns: |postgres=# SELECT pg_collation_actual_version(123); |ERROR: cache lookup failed for collation 123 |postgres=# \errverbose |ERROR: XX000: cache lookup failed for collation 123 |LOCATION: get_collation_version_for_oid, pg_locale.c:1754 I'm of the impression that'

Re: PoC/WIP: Extended statistics on expressions

2021-01-17 Thread Justin Pryzby
On Sun, Jan 17, 2021 at 01:23:39AM +0100, Tomas Vondra wrote: > > CREATE TABLE t AS SELECT generate_series(1,9) AS i; > > CREATE STATISTICS s ON (i+1) ,(i+1+0) FROM t; > > ANALYZE t; > > SELECT i+1 FROM t GROUP BY 1; > > ERROR: corrupt MVNDistinct entry > > Thanks. There was a thinko in estimate_

Re: Allow CLUSTER, VACUUM FULL and REINDEX to change tablespace on the fly

2021-01-18 Thread Justin Pryzby
On Mon, Jan 18, 2021 at 02:18:44PM +0900, Michael Paquier wrote: > On Sat, Dec 12, 2020 at 01:45:26PM -0600, Justin Pryzby wrote: > > It's a lot like what I wrote as [PATCH v31 1/5] ExecReindex and > > ReindexParams > > In my v31 patch, I moved ReindexOptions

Re: CLUSTER on partitioned index

2021-01-18 Thread Justin Pryzby
On Sat, Nov 28, 2020 at 08:03:02PM -0600, Justin Pryzby wrote: > On Sun, Nov 15, 2020 at 07:53:35PM -0600, Justin Pryzby wrote: > > On Wed, Nov 04, 2020 at 08:23:56PM -0600, Justin Pryzby wrote: > > > On Tue, Oct 27, 2020 at 07:33:12PM -0500, Justin Pryzby wrote: > > >

Re: [HACKERS] Custom compression methods

2021-01-19 Thread Justin Pryzby
Thanks for updating the patch. On Mon, Jan 4, 2021 at 6:52 AM Justin Pryzby wrote: > The most recent patch doesn't compile --without-lz4: On Tue, Jan 05, 2021 at 11:19:33AM +0530, Dilip Kumar wrote: > On Mon, Jan 4, 2021 at 10:08 PM Justin Pryzby wrote: > > I think I first saw

compression libraries and CF bot

2021-01-19 Thread Justin Pryzby
Do you know if the old travis build environment had liblz4 installed ? I'm asking regarding Dilip's patch, which was getting to "check world" 2 weeks ago but now failing to even compile, not apparently due to any change in the patch. Also, are the historic logs available somewhere ? http://cfbot.

Re: create table like: ACCESS METHOD

2021-01-19 Thread Justin Pryzby
HOD" not just ACCESS METHOD. -- Justin >From f27fd6291aa10af1ca0be4bc72a656811c8e0c9f Mon Sep 17 00:00:00 2001 From: Justin Pryzby Date: Sun, 15 Nov 2020 16:54:53 -0600 Subject: [PATCH v3] create table (like .. including ACCESS METHOD) --- doc/src/sgml/ref/create_table.sgml

Re: should INSERT SELECT use a BulkInsertState?

2021-01-20 Thread Justin Pryzby
On Sat, Dec 05, 2020 at 01:59:41PM -0600, Justin Pryzby wrote: > On Thu, Dec 03, 2020 at 10:59:34AM +0530, Bharath Rupireddy wrote: > > On Wed, Dec 2, 2020 at 10:24 PM Justin Pryzby wrote: > > > > > > One loose end in this patch is how to check for volatile default &g

Re: Allow CLUSTER, VACUUM FULL and REINDEX to change tablespace on the fly

2021-01-21 Thread Justin Pryzby
On Thu, Jan 21, 2021 at 11:48:08PM +0300, Alexey Kondratov wrote: > Attached is a new patch set of first two patches, that should resolve all > the issues raised before (ACL, docs, tests) excepting TOAST. Double thanks > for suggestion to add more tests with nested partitioning. I have found and >

Re: PoC/WIP: Extended statistics on expressions

2021-01-21 Thread Justin Pryzby
This already needs to be rebased on 55dc86eca. And needs to update rules.out. And doesn't address this one: On Sun, Jan 17, 2021 at 10:53:31PM -0600, Justin Pryzby wrote: > | postgres=# CREATE TABLE t(i int); > | postgres=# CREATE STATISTICS s2 ON (i+1) ,(i+1+0) FROM t; > | p

Re: pglz compression performance, take two

2021-01-21 Thread Justin Pryzby
@cfbot: rebased >From 03fec5d2587cf34a1d1a75d7afdcfbad9cb7ec68 Mon Sep 17 00:00:00 2001 From: Andrey Date: Thu, 27 Jun 2019 23:18:21 +0500 Subject: [PATCH] Reorganize pglz compression code This patch accumulates several changes: 1. Convert macro-functions to regular functions for readability 2. U

<    1   2   3   4   5   6   7   8   9   10   >