Re: logical decoding and replication of sequences

2022-08-07 Thread Noah Misch
On Sun, Aug 07, 2022 at 03:18:52PM +0200, Tomas Vondra wrote: > On 8/7/22 02:36, Noah Misch wrote: > > On Thu, Apr 07, 2022 at 08:34:50PM +0200, Tomas Vondra wrote: > >> I've pushed a revert af all the commits related to this - decoding of > >> sequences and test

Re: AIX: Symbols are missing in libpq.a

2021-08-29 Thread Noah Misch
On Thu, Aug 26, 2021 at 12:49:01PM +, REIX, Tony wrote: > While porting postgresql-odbc v13 to AIX, we have found that (at least) 2 > symbols are missing in libpq.a provided by the port of PostgreSQL v13.1 to > AIX 7.1 by the BullFreeware project : > > pg_char_to_encoding > pg_encoding_to_ch

Re: AIX: Symbols are missing in libpq.a

2021-08-30 Thread Noah Misch
On Mon, Aug 30, 2021 at 02:33:32PM +, REIX, Tony wrote: > It appears that the Makefile in src/interfaces/libpq has been modified > between v12 and v13, removing encnames.o (and wchar.o) from the object files > being used for creating the static libpq.a file which is used for creating > the l

Re: AIX: Symbols are missing in libpq.a

2021-08-30 Thread Noah Misch
On Mon, Aug 30, 2021 at 03:35:23PM +, REIX, Tony wrote: > Yes, trying to use the create lib$(NAME).exp from $(SHLIB_EXPORTS) when it > exists was my first idea, too. > However, I do not master (or I forgot) this kind of "if" in a Makefile > and I was unable to find a solution by reading M

Re: replay of CREATE TABLESPACE eats data at wal_level=minimal

2021-09-02 Thread Noah Misch
On Thu, Sep 02, 2021 at 11:28:27AM -0400, Robert Haas wrote: > On Wed, Aug 25, 2021 at 8:03 AM Robert Haas wrote: > > On Wed, Aug 25, 2021 at 1:21 AM Noah Misch wrote: > > > Sounds good. I think the log message is the optimal place: > > > > Looks awesome. > &

Re: AIX: Symbols are missing in libpq.a

2021-09-02 Thread Noah Misch
s in the year since v13 appeared, particularly since those symbols are inaccessible on Linux. Our AIX export lists never included libpgport or libpgcommon symbols. Author: Noah Misch Commit: Noah Misch AIX: Fix missing libpq symbols by respecting SHLIB_EXPORTS. We make each AIX s

Re: Postgres perl module namespace

2021-09-03 Thread Noah Misch
On Fri, Sep 03, 2021 at 03:34:24PM -0400, Andrew Dunstan wrote: > On 8/25/21 10:08 AM, Robert Haas wrote: > > On Wed, Aug 25, 2021 at 1:48 AM Michael Paquier wrote: > >> On Mon, Aug 23, 2021 at 03:39:15PM -0400, Robert Haas wrote: > >>> On Mon, Aug 23, 2021 at 3:03 PM Andrew Dunstan > >>> wrote:

Re: public schema default ACL

2021-09-04 Thread Noah Misch
On Thu, Sep 02, 2021 at 12:36:51PM +0200, Peter Eisentraut wrote: > I think this patch represents the consensus. > > The documentation looks okay. Some places still refer to PostgreSQL 13, > which should now be changed to 14. Thanks. I'll update s/13/14/ and/or s/14/15/ before the next step. >

Re: Postgres perl module namespace

2021-09-07 Thread Noah Misch
On Tue, Sep 07, 2021 at 07:43:47AM -0400, Andrew Dunstan wrote: > On 9/6/21 1:08 AM, Michael Paquier wrote: > > On Sat, Sep 04, 2021 at 09:58:08AM -0400, Andrew Dunstan wrote: > >> On 9/4/21 2:19 AM, Noah Misch wrote: > >>> plperl uses PostgreSQL:: as the firs

Re: automatically generating node support functions

2021-09-07 Thread Noah Misch
On Tue, Sep 07, 2021 at 10:57:02AM +0200, Peter Eisentraut wrote: > On 02.09.21 20:53, Jacob Champion wrote: > >>0004-Make-node-output-prefix-match-node-structure-name.patch > >> > >>Some nodes' output/read functions use a label that is slightly different > >>from their node name, e.g., "NOTIFY" in

Re: Remove redundant initializations

2021-09-12 Thread Noah Misch
I'm +1 for the $SUBJECT concept, mostly because I take longer to read code where immaterial zero-initialization lines are diluting the code. A quick scan of the patch content is promising. If there's a decision to move forward, I'm happy to review it more closely. On Wed, Jun 30, 2021 at 09:28:1

Re: Timeout failure in 019_replslot_limit.pl

2021-09-17 Thread Noah Misch
On Fri, Sep 17, 2021 at 06:59:24PM -0300, Alvaro Herrera wrote: > On 2021-Sep-07, Kyotaro Horiguchi wrote: > > It seems like the "kill 'STOP'" in the script didn't suspend the > > processes before advancing WAL. The attached uses 'ps' command to > > check that since I didn't come up with the way to

Re: windows build slow due to windows.h includes

2021-09-21 Thread Noah Misch
On Tue, Sep 21, 2021 at 12:30:35PM -0700, Andres Freund wrote: > solution to windows.h being just so damn big, the delightfully named > WIN32_LEAN_AND_MEAN. > > This reduces the non-incremental buildtime in my 8 core windows VM from 187s > to > 140s. Cross compiling from linux it's > master: > re

Re: Fixing WAL instability in various TAP tests

2021-09-24 Thread Noah Misch
On Fri, Sep 24, 2021 at 05:33:13PM -0700, Mark Dilger wrote: > A few TAP tests in the project appear to be sensitive to reductions of the > PostgresNode's max_wal_size setting, resulting in tests failing due to wal > files having been removed too soon. The failures in the logs typically are > of t

Re: Fixing WAL instability in various TAP tests

2021-09-25 Thread Noah Misch
On Sat, Sep 25, 2021 at 08:20:06AM -0700, Mark Dilger wrote: > > On Sep 25, 2021, at 7:17 AM, Tom Lane wrote: > >> Leaving the tests brittle wastes developer time. > > > > Trying to make them proof against all possible settings would waste > > a lot more time, though. > > You may be right, but t

Re: Role Self-Administration

2021-10-04 Thread Noah Misch
On Mon, Oct 04, 2021 at 10:57:46PM -0400, Stephen Frost wrote: > "A role is not considered to hold WITH ADMIN OPTION on itself, but it > may grant or revoke membership in itself from a database session where > the session user matches the role." > Here's the thing - having looked back through the

Re: pgsql: Adjust configure to insist on Perl version >= 5.8.3.

2021-10-07 Thread Noah Misch
On Thu, Oct 07, 2021 at 03:44:48PM -0400, Tom Lane wrote: > [ cc'ing Craig and Noah, as author/committer of the existing text ] > > Daniel Gustafsson writes: > > On 7 Oct 2021, at 21:02, Tom Lane wrote: > >> BTW, looking at that a second time, I wonder if that advice is > >> really of any use. >

Re: pgsql: Adjust configure to insist on Perl version >= 5.8.3.

2021-10-07 Thread Noah Misch
On Thu, Oct 07, 2021 at 11:39:11PM -0400, Tom Lane wrote: > Noah Misch writes: > > On Thu, Oct 07, 2021 at 03:44:48PM -0400, Tom Lane wrote: > >>> (1) I'm distrustful of the idea that perl 5.8.x will compile > >>> cleanly, or at all, on modern platforms.

Re: pgsql: Adjust configure to insist on Perl version >= 5.8.3.

2021-10-09 Thread Noah Misch
On Fri, Oct 08, 2021 at 12:03:41PM -0400, Tom Lane wrote: > Daniel Gustafsson writes: > > On 8 Oct 2021, at 06:24, Noah Misch wrote: > >> That's obvious from "cpanm install IPC::Run". Surely if any other non-core > >> module were allowed, the recipe

Re: pgsql: Adjust configure to insist on Perl version >= 5.8.3.

2021-10-09 Thread Noah Misch
On Sat, Oct 09, 2021 at 03:44:17PM -0400, Tom Lane wrote: > > By the way, I suspect 93fb39e introduced a regression in the recipe. (I > > haven't tested, though.) Before commit 93fb39e, "cpanm install IPC::Run" > > would update Test::More. As of 5.8.3, the core version of Test::More is new > > e

Re: pgsql: Adjust configure to insist on Perl version >= 5.8.3.

2021-10-09 Thread Noah Misch
On Sat, Oct 09, 2021 at 04:34:46PM -0400, Tom Lane wrote: > Hah ... your backpan link led me to realize the actual problem with > Test::More. It got folded into Test::Simple at some point, and > evidently cpanm isn't smart enough to handle a request for a back > version in such cases. But this wo

Re: pgsql: Adjust configure to insist on Perl version >= 5.8.3.

2021-10-10 Thread Noah Misch
On Sun, Oct 10, 2021 at 01:17:10PM -0400, Tom Lane wrote: > However, back to the matter of the recipe. I'm feeling discouraged > again because experimentation shows that cpanm insists on updating > the ExtUtils suite to current while installing Test::Simple. You > can then downgrade that, but it'

Re: pgsql: Adjust configure to insist on Perl version >= 5.8.3.

2021-10-10 Thread Noah Misch
On Sun, Oct 10, 2021 at 04:10:38PM -0400, Tom Lane wrote: > Noah Misch writes: > > On Sun, Oct 10, 2021 at 01:17:10PM -0400, Tom Lane wrote: > >> The closest I can get to what we want using cpanm is with this recipe: > >> cpanm install Test::Simple@0.87_01 >

Re: Commitfest overflow

2021-08-04 Thread Noah Misch
On Tue, Aug 03, 2021 at 12:13:44PM -0400, Tom Lane wrote: > Bruce Momjian writes: > > On Tue, Aug 3, 2021 at 04:53:40PM +0100, Simon Riggs wrote: > >> There are 273 patches in the queue for the Sept Commitfest already, so > >> it seems clear the queue is not being cleared down each CF as it was >

Re: Commitfest overflow

2021-08-05 Thread Noah Misch
On Thu, Aug 05, 2021 at 03:06:54PM +0200, Tomas Vondra wrote: > On 8/5/21 8:39 AM, Andrey Borodin wrote: > >>... > >> > >>Early commitfests recognized a rule that patch authors owed one review per > >>patch registered in the commitfest. If authors were holding to that, then > >>both submissions an

Re: replay of CREATE TABLESPACE eats data at wal_level=minimal

2021-08-09 Thread Noah Misch
On Mon, Aug 09, 2021 at 01:08:42PM -0400, Robert Haas wrote: > To reproduce, initialize a cluster with wal_level=minimal and > max_wal_senders=0. Then from psql: > > \! mkdir /tmp/goose > > CHECKPOINT; > CREATE TABLESPACE goose LOCATION '/tmp/goose'; > SET wal_skip_threshold=0; > BEGIN; > CREATE

Re: replay of CREATE TABLESPACE eats data at wal_level=minimal

2021-08-18 Thread Noah Misch
e symlink, just in > > case. So I think your proposed patch might be all we need. > > Noah, do you plan to commit this? Yes. I feel it needs a test case, which is the main reason I've queued the task rather than just pushed what I posted last. On Mon, Aug 09, 2021 at 06:23:07PM -070

Re: replay of CREATE TABLESPACE eats data at wal_level=minimal

2021-08-22 Thread Noah Misch
On Wed, Aug 18, 2021 at 10:32:10PM -0700, Noah Misch wrote: > On Wed, Aug 18, 2021 at 10:47:24AM -0400, Robert Haas wrote: > > On Tue, Aug 10, 2021 at 9:35 AM Robert Haas wrote: > > > Oh, yeah, I think that works, actually. I was imagining a few problems > > > here, bu

Re: replay of CREATE TABLESPACE eats data at wal_level=minimal

2021-08-24 Thread Noah Misch
On Mon, Aug 23, 2021 at 09:08:44AM -0400, Robert Haas wrote: > On Sun, Aug 22, 2021 at 6:59 PM Noah Misch wrote: > > Here's what I plan to push. Besides adding a test, I modified things so > > CREATE TABLESPACE redo continues to report an error if a non-directory > >

Re: Mark all GUC variable as PGDLLIMPORT

2021-08-24 Thread Noah Misch
On Tue, Aug 24, 2021 at 05:06:54PM -0400, Chapman Flack wrote: > On 08/24/21 16:31, Robert Haas wrote: > > about adding PGDLLIMPORT, which ought to be totally uncontroversial, > > The thing is, I think I have somewhere a list of all the threads on this > topic that I've read through since the firs

Re: race condition in pg_class

2024-06-05 Thread Noah Misch
On Sun, May 12, 2024 at 04:29:23PM -0700, Noah Misch wrote: > I'm attaching patches implementing the LockTuple() design. Starting 2024-06-10, I plan to push the first seven of the ten patches: inplace005-UNEXPECTEDPASS-tap-meson-v1.patch inplace010-tests-v1.patch inplace040-waitfuncs-

Re: Assert in heapgettup_pagemode() fails due to underlying buffer change

2024-06-06 Thread Noah Misch
On Thu, Jun 06, 2024 at 12:36:32PM -0400, Robert Haas wrote: > On Thu, Jun 6, 2024 at 6:00 AM Alexander Lakhin wrote: > > Am I missing something or the the page buffer indeed lacks locking there? > > I don't know, but if the locks are really missing now, I feel like the > first question is "which

Re: race condition in pg_class

2024-06-10 Thread Noah Misch
On Fri, Jun 07, 2024 at 09:08:03AM -0400, Robert Haas wrote: > On Thu, Jun 6, 2024 at 7:20 PM Michael Paquier wrote: > > On Thu, Jun 06, 2024 at 09:48:51AM -0400, Robert Haas wrote: > > > It's not this patch set's fault, but I'm not very pleased to see that > > > the injection point wait events ha

Re: RFC: adding pytest as a supported test framework

2024-06-11 Thread Noah Misch
On Mon, Jun 10, 2024 at 06:49:11PM -0700, Andres Freund wrote: > On 2024-06-10 16:46:56 -0400, Andrew Dunstan wrote: > > On 2024-06-10 Mo 16:04, Andres Freund wrote: > > > Just for context for the rest the email: I think we desperately need to > > > move > > > off perl for tests. The infrastructur

Re: race condition in pg_class

2024-06-12 Thread Noah Misch
On Tue, Jun 11, 2024 at 01:37:21PM +0900, Michael Paquier wrote: > On Mon, Jun 10, 2024 at 07:19:27PM -0700, Noah Misch wrote: > > On Fri, Jun 07, 2024 at 09:08:03AM -0400, Robert Haas wrote: > >> I think the core code should provide an "Injection Point" wait event >

Re: race condition in pg_class

2024-06-12 Thread Noah Misch
On Wed, Jun 12, 2024 at 02:08:31PM -0400, Robert Haas wrote: > On Wed, Jun 12, 2024 at 1:54 PM Noah Misch wrote: > > If I were making a list of changes always welcome post-beta, it wouldn't > > include adding wait event types. But I don't hesitate to add one if it >

Re: race condition in pg_class

2024-06-12 Thread Noah Misch
On Wed, Jun 12, 2024 at 03:02:43PM +0200, Michail Nikolaev wrote: > I am not sure, but I think that issue may be related to the issue described > in > https://www.postgresql.org/message-id/CANtu0ojXmqjmEzp-%3DaJSxjsdE76iAsRgHBoK0QtYHimb_mEfsg%40mail.gmail.com > > It looks like REINDEX CONCURRENTLY

Re: RFC: adding pytest as a supported test framework

2024-06-12 Thread Noah Misch
On Wed, Jun 12, 2024 at 01:40:30PM +0200, Jelte Fennema-Nio wrote: > On Wed, 12 Jun 2024 at 01:48, Noah Misch wrote: > > I also want the initial scope to be the new language coexisting with the > > existing Perl tests. If a bulk translation ever happens, it should happen > >

Re: race condition in pg_class

2024-06-13 Thread Noah Misch
On Wed, Jun 12, 2024 at 10:02:00PM +0200, Michail Nikolaev wrote: > > Can you say more about the connection you see between $SUBJECT and that? > That > > looks like a valid report of an important bug, but I'm not following the > > potential relationship to $SUBJECT. > > I was guided by the followi

Re: race condition in pg_class

2024-06-13 Thread Noah Misch
On Fri, Jun 14, 2024 at 09:58:59AM +0900, Michael Paquier wrote: > Looking at inplace031-inj-wait-event.. > > The comment at the top of GetWaitEventCustomNames() requires an > update, still mentioning extensions. Thanks. Fixed locally. > GetWaitEventCustomIdentifier() is incorrect, and should r

Re: Inval reliability, especially for inplace updates

2024-06-15 Thread Noah Misch
On Wed, May 22, 2024 at 05:05:48PM -0700, Noah Misch wrote: > https://postgr.es/m/20240512232923.aa.nmi...@google.com wrote: > > Separable, nontrivial things not fixed in the attached patch stack: > > > > - Inplace update uses transactional CacheInvalidateHeapTuple(). ROL

IPC::Run accepts bug reports

2024-06-15 Thread Noah Misch
Separating this from the pytest thread: On Sat, Jun 15, 2024 at 01:26:57PM -0400, Robert Haas wrote: > The one > thing I know about that *I* think is a pretty big problem about Perl > is that IPC::Run is not really maintained. I don't see in https://github.com/cpan-authors/IPC-Run/issues anything

Re: race condition in pg_class

2024-06-16 Thread Noah Misch
On Sun, Jun 16, 2024 at 09:28:05AM +0900, Michael Paquier wrote: > On Thu, Jun 13, 2024 at 07:42:25PM -0700, Noah Misch wrote: > > On Fri, Jun 14, 2024 at 09:58:59AM +0900, Michael Paquier wrote: > >> GetWaitEventCustomIdentifier() is incorrect, and should return > >&

Re: Remove distprep

2024-06-16 Thread Noah Misch
On Thu, Oct 05, 2023 at 05:46:46PM +0200, Peter Eisentraut wrote: > --- a/src/backend/Makefile > +++ b/src/backend/Makefile > $(top_builddir)/src/include/storage/lwlocknames.h: storage/lmgr/lwlocknames.h > - prereqdir=`cd '$(dir $<)' >/dev/null && pwd` && \ > - cd '$(dir $@)' && rm -f $

Re: Inval reliability, especially for inplace updates

2024-06-16 Thread Noah Misch
On Sat, Jun 15, 2024 at 03:37:18PM -0700, Noah Misch wrote: > I'm attaching the implementation. I'm withdrawing inplace150-inval-durability-atcommit-v1.patch, having found two major problems so far: 1. It sends transactional invalidation messages before ProcArrayEndTransactio

Re: Inval reliability, especially for inplace updates

2024-06-17 Thread Noah Misch
On Sat, Jun 15, 2024 at 03:37:18PM -0700, Noah Misch wrote: > On Wed, May 22, 2024 at 05:05:48PM -0700, Noah Misch wrote: > > https://postgr.es/m/20240512232923.aa.nmi...@google.com wrote: > > > Separable, nontrivial things not fixed in the attached patch stack: > > >

Re: Inval reliability, especially for inplace updates

2024-06-18 Thread Noah Misch
On Mon, Jun 17, 2024 at 06:57:30PM -0700, Andres Freund wrote: > On 2024-06-17 16:58:54 -0700, Noah Misch wrote: > > On Sat, Jun 15, 2024 at 03:37:18PM -0700, Noah Misch wrote: > > > On Wed, May 22, 2024 at 05:05:48PM -0700, Noah Misch wrote: > > > > https://pos

Re: IPC::Run accepts bug reports

2024-06-18 Thread Noah Misch
On Mon, Jun 17, 2024 at 11:11:17AM -0700, Andres Freund wrote: > On 2024-06-15 16:48:24 -0700, Noah Misch wrote: > > On Sat, Jun 15, 2024 at 01:26:57PM -0400, Robert Haas wrote: > > > The one > > > thing I know about that *I* think is a pretty big problem about Perl &g

Re: Inval reliability, especially for inplace updates

2024-06-18 Thread Noah Misch
On Tue, Jun 18, 2024 at 08:23:49AM -0700, Noah Misch wrote: > On Mon, Jun 17, 2024 at 06:57:30PM -0700, Andres Freund wrote: > > On 2024-06-17 16:58:54 -0700, Noah Misch wrote: > > > On Sat, Jun 15, 2024 at 03:37:18PM -0700, Noah Misch wrote: > > > > On Wed, May 22,

Re: IPC::Run accepts bug reports

2024-06-19 Thread Noah Misch
moved (couldn't even rename the directory) > > The psql instance needs to be found and terminated first. Thanks for that recipe. I've put that in my queue to fix. On Tue, Jun 18, 2024 at 12:00:13PM -0700, Andres Freund wrote: > On 2024-06-18 10:10:17 -0700, Noah Misch wrote

datfrozenxid > relfrozenxid w/ crash before XLOG_HEAP_INPLACE

2024-06-19 Thread Noah Misch
m https://postgr.es/m/20240617235854.f8.nmi...@google.com. This gets key testing from 027_stream_regress.pl; when I commented out some memcpy lines of the heapam.c change, that test caught it. This resolves the last inplace update defect known to me. Thanks, nm Author: Noah Misch Commit: Noa

Re: Remove distprep

2024-06-20 Thread Noah Misch
On Thu, Jun 20, 2024 at 09:29:45AM +0200, Peter Eisentraut wrote: > On 16.06.24 21:34, Noah Misch wrote: > > On Thu, Oct 05, 2023 at 05:46:46PM +0200, Peter Eisentraut wrote: > > > --- a/src/backend/Makefile > > > +++ b/src/backend/Makefile > > > >

Re: datfrozenxid > relfrozenxid w/ crash before XLOG_HEAP_INPLACE

2024-06-20 Thread Noah Misch
On Thu, Jun 20, 2024 at 12:17:44PM +0500, Andrey M. Borodin wrote: > On 20 Jun 2024, at 06:29, Noah Misch wrote: > > This resolves the last inplace update defect known to me. > > That’s a huge amount of work, thank you! > > Do I get it right, that inplace updates are cata

Re: race condition in pg_class

2024-06-21 Thread Noah Misch
On Thu, Jun 13, 2024 at 05:35:49PM -0700, Noah Misch wrote: > On Mon, Jun 10, 2024 at 07:45:25PM -0700, Noah Misch wrote: > > On Thu, Jun 06, 2024 at 09:48:51AM -0400, Robert Haas wrote: > > > It's not this patch set's fault, but I'm not very pleased to see th

Re: speed up a logical replica setup

2024-06-22 Thread Noah Misch
On Mon, Mar 25, 2024 at 12:55:39PM +0100, Peter Eisentraut wrote: > I have committed your version v33. > commit d44032d > --- /dev/null > +++ b/src/bin/pg_basebackup/pg_createsubscriber.c > +static char * > +concat_conninfo_dbname(const char *conninfo, const char *dbname) > +{ > + PQExpBuffe

Re: speed up a logical replica setup

2024-06-24 Thread Noah Misch
On Mon, Jun 24, 2024 at 05:20:21PM +0530, Amit Kapila wrote: > On Sun, Jun 23, 2024 at 11:52 AM Noah Misch wrote: > > > > > +static void > > > +create_publication(PGconn *conn, struct LogicalRepInfo *dbinfo) > > > +{ > > > > > + appendPQE

Re: Vacuum ERRORs out considering freezing dead tuples from before OldestXmin

2024-06-24 Thread Noah Misch
On Mon, Jun 24, 2024 at 04:51:24PM -0400, Peter Geoghegan wrote: > On Mon, Jun 24, 2024 at 4:36 PM Robert Haas wrote: > > I'm not sure I understand. The most important thing here is fixing the > > bug. But if we have a choice of how to fix the bug, I'd prefer to do > > it by having the pruning cod

Re: Vacuum ERRORs out considering freezing dead tuples from before OldestXmin

2024-06-24 Thread Noah Misch
On Mon, Jun 24, 2024 at 09:49:53PM -0400, Peter Geoghegan wrote: > On Mon, Jun 24, 2024 at 9:30 PM Noah Misch wrote: > > On Mon, Jun 24, 2024 at 03:23:39PM -0400, Melanie Plageman wrote: > > > Right now, in master, we do use a single horizon when determining what > >

Re: Injection point locking

2024-06-24 Thread Noah Misch
On Mon, Jun 24, 2024 at 11:03:09AM -0400, Tom Lane wrote: > Heikki Linnakangas writes: > > ... I can't do that, because InjectionPointRun() requires a PGPROC > > entry, because it uses an LWLock. That also makes it impossible to use > > injection points in the postmaster. Any chance we could all

Re: Injection point locking

2024-06-25 Thread Noah Misch
On Tue, Jun 25, 2024 at 11:14:57AM +0900, Michael Paquier wrote: > On Mon, Jun 24, 2024 at 01:29:38PM +0300, Heikki Linnakangas wrote: > > InjectionPointRun() acquires InjectionPointLock, looks up the hash entry, > > and releases the lock: > > > > > LWLockAcquire(InjectionPointLock, LW_SHARED);

Re: IPC::Run accepts bug reports

2024-06-25 Thread Noah Misch
On Mon, Jun 17, 2024 at 01:56:46PM -0400, Robert Haas wrote: > On Sat, Jun 15, 2024 at 7:48 PM Noah Misch wrote: > > Separating this from the pytest thread: > > > > On Sat, Jun 15, 2024 at 01:26:57PM -0400, Robert Haas wrote: > > > The one > > > thing I kn

Re: XID formatting and SLRU refactorings (was: Add 64-bit XIDs into PostgreSQL 15)

2024-06-25 Thread Noah Misch
On Mon, Nov 27, 2023 at 01:43:26AM +0200, Alexander Korotkov wrote: > v61 looks good to me. I'm going to push it as long as there are no > objections. This yielded commit 4ed8f09 "Index SLRUs by 64-bit integers rather than by 32-bit integers" and left some expressions coercing SLRU page numbers

Re: XID formatting and SLRU refactorings (was: Add 64-bit XIDs into PostgreSQL 15)

2024-06-26 Thread Noah Misch
On Wed, Jun 26, 2024 at 02:09:58PM +0300, Aleksander Alekseev wrote: > > This yielded commit 4ed8f09 "Index SLRUs by 64-bit integers rather than by > > 32-bit integers" and left some expressions coercing SLRU page numbers to > > int. > > Two sources: > > > > grep -i 'int\b.*page' $(git grep -l Si

Re: speed up a logical replica setup

2024-06-26 Thread Noah Misch
On Tue, Jun 25, 2024 at 09:50:59PM -0300, Euler Taveira wrote: > On Tue, Jun 25, 2024, at 3:24 AM, Amit Kapila wrote: > > On Tue, Jun 25, 2024 at 3:38 AM Noah Misch wrote: > > > On Mon, Jun 24, 2024 at 05:20:21PM +0530, Amit Kapila wrote: > > > > On Sun, Jun 23, 2024

Re: race condition in pg_class

2024-06-27 Thread Noah Misch
On Fri, Jun 21, 2024 at 02:28:42PM -0700, Noah Misch wrote: > On Thu, Jun 13, 2024 at 05:35:49PM -0700, Noah Misch wrote: > > I think the attached covers all comments to date. I gave everything v3, but > > most patches have just a no-conflict rebase vs. v2. The exceptions are >

Re: race condition in pg_class

2024-06-28 Thread Noah Misch
On Fri, Jun 28, 2024 at 01:17:22AM -0400, Tom Lane wrote: > Noah Misch writes: > > Pushed. Buildfarm member prion is failing the new inplace-inval.spec, > > almost > > surely because prion uses -DCATCACHE_FORCE_RELEASE and inplace-inval.spec is > > testing an exta

Re: Inval reliability, especially for inplace updates

2024-06-28 Thread Noah Misch
On Mon, Jun 17, 2024 at 04:58:54PM -0700, Noah Misch wrote: > attached v2 patch stack. Rebased. This applies on top of three patches from https://postgr.es/m/20240629024251.03.nmi...@google.com. I'm attaching those to placate cfbot, but this thread is for review of the last patch only

Re: Built-in CTYPE provider

2024-06-29 Thread Noah Misch
On Wed, Mar 20, 2024 at 05:13:26PM -0700, Jeff Davis wrote: > On Tue, 2024-03-19 at 13:41 +0100, Peter Eisentraut wrote: > > * v25-0002-Support-C.UTF-8-locale-in-the-new-builtin-collat.patch > > > > Looks ok. > > Committed. > > + pg_c_utf8 > + > + > +This collati

Re: pg_ctl start may return 0 even if the postmaster has been already started on Windows

2024-06-29 Thread Noah Misch
On Thu, Jun 06, 2024 at 05:21:46PM +0900, Kyotaro Horiguchi wrote: > At Thu, 06 Jun 2024 17:15:15 +0900 (JST), Kyotaro Horiguchi > wrote in > > By the way, the need to shift by 2 seconds to tolerate clock skew > > suggests that the current launcher-postmaster association mechanism is > > somewha

Re: [PATCH] pg_stat_activity: make slow/hanging authentication more visible

2024-06-30 Thread Noah Misch
On Mon, May 06, 2024 at 02:23:38PM -0700, Jacob Champion wrote: > =# select * from pg_stat_activity where state = 'authenticating'; > -[ RECORD 1 ]+-- > datid| > datname | > pid | 745662 > leader_pid | >

Re: [EXTERNAL] Re: Add non-blocking version of PQcancel

2024-06-30 Thread Noah Misch
On Tue, Mar 12, 2024 at 05:50:48PM +0100, Alvaro Herrera wrote: > On 2024-Mar-12, Jelte Fennema-Nio wrote: > > On Tue, 12 Mar 2024 at 10:19, Alvaro Herrera > > wrote: > > > Here's a last one for the cfbot. > > > > Thanks for committing the first 3 patches btw. > > Thanks, I included it. PGcanc

Re: speed up a logical replica setup

2024-06-30 Thread Noah Misch
On Sun, Jun 30, 2024 at 02:58:00PM -0400, Tom Lane wrote: > I wrote: > > In hopes of moving things along as we approach the v18 branch, > > I went ahead and pushed Kuroda-san's patches (with a bit of > > further editorialization). > > So b3f5ccebd promptly blew up on fairywren [1]: > > connection

Re: speed up a logical replica setup

2024-06-30 Thread Noah Misch
On Sun, Jun 30, 2024 at 05:01:52PM -0400, Tom Lane wrote: > Noah Misch writes: > > On Sun, Jun 30, 2024 at 02:58:00PM -0400, Tom Lane wrote: > >> So b3f5ccebd promptly blew up on fairywren [1]: > > > It does look consistent with IPC::Run predating v20220807.0, hence

Re: MAINTAIN privilege -- what do we need to un-revert it?

2024-06-30 Thread Noah Misch
On Mon, Mar 04, 2024 at 07:52:05PM -0800, Jeff Davis wrote: > Committed. Commit 2af07e2 wrote: > --- a/src/backend/access/brin/brin.c > +++ b/src/backend/access/brin/brin.c > @@ -1412,6 +1412,8 @@ brin_summarize_range(PG_FUNCTION_ARGS) > SetUserIdAndSecContext(heapRel->rd_rel->relown

Re: Faster "SET search_path"

2024-06-30 Thread Noah Misch
On Tue, Nov 14, 2023 at 08:13:25PM -0800, Jeff Davis wrote: > On Thu, 2023-10-19 at 19:01 -0700, Jeff Davis wrote: > > 0003: Cache for recomputeNamespacePath. > > Committed Commit f26c236 wrote: > Add cache for recomputeNamespacePath(). > > When search_path is changed to something th

Re: collect_corrupt_items_vacuum.patch

2024-06-30 Thread Noah Misch
On Tue, Mar 12, 2024 at 02:10:59PM +0200, Alexander Korotkov wrote: > I'm going to push this if no objections. Commit e85662d wrote: > --- a/src/backend/storage/ipc/procarray.c > +++ b/src/backend/storage/ipc/procarray.c > @@ -2740,6 +2741,8 @@ GetRunningTransactionData(void) >*/ >

Re: speed up a logical replica setup

2024-06-30 Thread Noah Misch
On Sun, Jun 30, 2024 at 09:32:57PM -0400, Tom Lane wrote: > Noah Misch writes: > > On Sun, Jun 30, 2024 at 05:01:52PM -0400, Tom Lane wrote: > >> I'm tempted to lobotomize the new test case on Windows until > >> we have that resolved. > > > Sounds fin

Re: Relation bulk write facility

2024-07-01 Thread Noah Misch
On Fri, Feb 23, 2024 at 04:27:34PM +0200, Heikki Linnakangas wrote: > Committed this. Thanks everyone! Commit 8af2565 wrote: > --- /dev/null > +++ b/src/backend/storage/smgr/bulk_write.c > +/* > + * Finish bulk write operation. > + * > + * This WAL-logs and flushes any remaining pending writes to

Re: Built-in CTYPE provider

2024-07-01 Thread Noah Misch
On Mon, Jul 01, 2024 at 12:24:15PM -0700, Jeff Davis wrote: > On Sat, 2024-06-29 at 15:08 -0700, Noah Misch wrote: > > lower(), initcap(), upper(), and regexp_matches() are > > PROVOLATILE_IMMUTABLE. > > Until now, we've delegated that responsibility to the user.  The u

Re: Relation bulk write facility

2024-07-01 Thread Noah Misch
On Tue, Jul 02, 2024 at 12:53:05AM +0300, Heikki Linnakangas wrote: > On 01/07/2024 23:52, Noah Misch wrote: > > Commit 8af2565 wrote: > > > --- /dev/null > > > +++ b/src/backend/storage/smgr/bulk_write.c > > > > > +/* > > > + * Finish bulk wri

Re: Built-in CTYPE provider

2024-07-02 Thread Noah Misch
On Mon, Jul 01, 2024 at 06:19:08PM -0700, Jeff Davis wrote: > On Mon, 2024-07-01 at 16:03 -0700, Noah Misch wrote: > >   An alternative would be to make pg_upgrade reject > > operating on a cluster that contains use of $SUBJECT. > > That wouldn't help anyone. Can you

Re: collect_corrupt_items_vacuum.patch

2024-07-02 Thread Noah Misch
On Wed, Jul 03, 2024 at 12:31:48AM +0300, Alexander Korotkov wrote: > On Mon, Jul 1, 2024 at 2:18 AM Noah Misch wrote: > > Commit e85662d wrote: > > > --- a/src/backend/storage/ipc/procarray.c > > > +++ b/src/backend/storage/ipc/procarray.c &

Re: Built-in CTYPE provider

2024-07-02 Thread Noah Misch
On Wed, Jul 03, 2024 at 12:05:09AM +0200, Peter Eisentraut wrote: > On 02.07.24 18:51, Noah Misch wrote: > > On Mon, Jul 01, 2024 at 06:19:08PM -0700, Jeff Davis wrote: > > > On Mon, 2024-07-01 at 16:03 -0700, Noah Misch wrote: > > > >   An alternative woul

Re: Relation bulk write facility

2024-07-02 Thread Noah Misch
On Tue, Jul 02, 2024 at 02:42:50PM +0300, Heikki Linnakangas wrote: > On 02/07/2024 02:24, Noah Misch wrote: > > On Tue, Jul 02, 2024 at 12:53:05AM +0300, Heikki Linnakangas wrote: > log_newpage_range() loads the pages to the buffer > cache and dirties them. That kinds of sucks a

Re: cannot abort transaction 2737414167, it was already committed

2024-07-03 Thread Noah Misch
On Thu, May 09, 2024 at 05:19:47PM +1200, Thomas Munro wrote: > On Thu, Dec 28, 2023 at 11:42 AM Tom Lane wrote: > > Thomas Munro writes: > > > In CommitTransaction() there is a stretch of code beginning s->state = > > > TRANS_COMMIT and ending s->state = TRANS_DEFAULT, from which we call > > > o

Re: race condition in pg_class

2024-07-03 Thread Noah Misch
On Wed, Jul 03, 2024 at 06:00:00AM +0300, Alexander Lakhin wrote: > 29.06.2024 05:42, Noah Misch wrote: > > Good point, any effort on (2) would be wasted once the fixes get certified. > > I > > pushed (1). I'm attaching the rebased fix patches. > > Please look

Re: race condition in pg_class

2024-07-03 Thread Noah Misch
On Wed, Jul 03, 2024 at 04:09:54PM -0700, Noah Misch wrote: > On Wed, Jul 03, 2024 at 06:00:00AM +0300, Alexander Lakhin wrote: > > 29.06.2024 05:42, Noah Misch wrote: > > > Good point, any effort on (2) would be wasted once the fixes get > > > certified. I > >

Re: Built-in CTYPE provider

2024-07-04 Thread Noah Misch
On Wed, Jul 03, 2024 at 02:19:07PM -0700, Jeff Davis wrote: > * Unless I made a mistake, the last three releases of Unicode (14.0, > 15.0, and 15.1) all have the exact same behavior for UPPER() and > LOWER() -- even for unassigned code points. It would be silly to > promise to stay with 15.1 and th

Re: race condition in pg_class

2024-07-04 Thread Noah Misch
On Thu, Jul 04, 2024 at 08:00:00AM +0300, Alexander Lakhin wrote: > 28.06.2024 08:13, Noah Misch wrote: > > Pushed. ... > > Please look also at another anomaly, I've discovered. > > An Assert added with d5f788b41 may be falsified with: > CREATE TABLE t(a int PRIMARY

Re: Built-in CTYPE provider

2024-07-06 Thread Noah Misch
On Fri, Jul 05, 2024 at 02:38:45PM -0700, Jeff Davis wrote: > On Thu, 2024-07-04 at 14:26 -0700, Noah Misch wrote: > > I think you're saying that if some Unicode update changes the results > > of a > > STABLE function but does not change the result of any IMMUTABLE > &

Re: Vectored I/O in bulk_write.c

2024-07-06 Thread Noah Misch
On Tue, Apr 09, 2024 at 04:51:52PM +1200, Thomas Munro wrote: > Here's a rebase. I decided against committing this for v17 in the > end. There's not much wrong with it AFAIK, except perhaps an > unprincipled chopping up of writes with large io_combine_limit due to > simplistic flow control, and I

Re: Confine vacuum skip logic to lazy_scan_skip

2024-07-07 Thread Noah Misch
On Fri, Jun 28, 2024 at 05:36:25PM -0400, Melanie Plageman wrote: > I've attached a WIP v11 streaming vacuum patch set here that is > rebased over master (by Thomas), so that I could add a CF entry for > it. It still has the problem with the extra WAL write and fsync calls > investigated by Thomas

Re: [PATCH] pg_stat_activity: make slow/hanging authentication more visible

2024-07-08 Thread Noah Misch
On Mon, Jul 08, 2024 at 02:09:21PM -0700, Jacob Champion wrote: > On Sun, Jun 30, 2024 at 10:48 AM Noah Misch wrote: > > That said, it > > may be more fruitful to arrange for authentication timeout to cut through > > PAM > > etc. > > That seems mostly out of our

Re: Faster "SET search_path"

2024-07-08 Thread Noah Misch
On Mon, Jul 08, 2024 at 04:39:21PM -0700, Jeff Davis wrote: > On Sun, 2024-06-30 at 15:30 -0700, Noah Misch wrote: > > You're caching the result of object_aclcheck(NamespaceRelationId, > > ...), so > > pg_auth_members changes > > Thank you for the report. >

Re: Built-in CTYPE provider

2024-07-08 Thread Noah Misch
On Sat, Jul 06, 2024 at 04:19:21PM -0400, Tom Lane wrote: > Noah Misch writes: > > As a released feature, NORMALIZE() has a different set of remedies to choose > > from, and I'm not proposing one. I may have sidetracked this thread by > > talking about remedies

Re: Built-in CTYPE provider

2024-07-11 Thread Noah Misch
On Tue, Jul 09, 2024 at 04:20:12PM -0700, Jeff Davis wrote: > On Mon, 2024-07-08 at 18:05 -0700, Noah Misch wrote: > > I'm thinking about these > > aggravating factors for $SUBJECT: > > This is still marked as an open item for 17, but you've already > acknow

Re: MAINTAIN privilege -- what do we need to un-revert it?

2024-07-11 Thread Noah Misch
On Tue, Jul 09, 2024 at 05:47:36PM -0700, Jeff Davis wrote: > On Tue, 2024-07-09 at 15:20 +0900, Michael Paquier wrote: > > On Sun, Jun 30, 2024 at 03:23:44PM -0700, Noah Misch wrote: > > Hmm.  Is RestrictSearchPath() something that we should advertise more > > strongly

Re: Use read streams in CREATE DATABASE command when the strategy is wal_log

2024-07-11 Thread Noah Misch
On Tue, Apr 16, 2024 at 02:12:19PM +0300, Nazir Bilal Yavuz wrote: > I am working on using read streams in the CREATE DATABASE command when the > strategy is wal_log. RelationCopyStorageUsingBuffer() function is used in > this context. This function reads source buffers then copies them to the Ple

Re: race condition when writing pg_control

2024-07-12 Thread Noah Misch
On Sat, May 18, 2024 at 05:29:12PM +1200, Thomas Munro wrote: > On Fri, May 17, 2024 at 4:46 PM Thomas Munro wrote: > > The specific problem here is that LocalProcessControlFile() runs in > > every launched child for EXEC_BACKEND builds. Windows uses > > EXEC_BACKEND, and Windows' NTFS file syste

Re: MAINTAIN privilege -- what do we need to un-revert it?

2024-07-12 Thread Noah Misch
On Fri, Jul 12, 2024 at 02:50:52PM -0700, Jeff Davis wrote: > On Thu, 2024-07-11 at 05:52 -0700, Noah Misch wrote: > > > I could try to refactor it into two statements and execute them > > > separately, or I could try to rewrite the statement to use a fully- > > &g

<    2   3   4   5   6   7   8   9   10   11   >