Re: Log files polluted with permission denied error messages after every 10 seconds

2021-03-05 Thread Michael Paquier
On Fri, Mar 05, 2021 at 07:36:37PM +0200, Andrus wrote: > Then turned real-time protection off: > > Problem persists. New entry is written after every 10 seconds. On which files are those complaints? It seems to me that you may have more going on in this system that interacts with your data fold

Re: libpq pipelineing

2021-03-05 Thread Alvaro Herrera
Hello Samuel, On 2020-Jun-27, Samuel Williams wrote: > I found some discussion in the past relating to batch processing which > appears to support some kind of pipelining: > > https://2ndquadrant.github.io/postgres/libpq-batch-mode.html I just noticed this old thread of yours. I've been workin

Re: Unkillable processes creating millions of tiny temp files

2021-03-05 Thread Tom Lane
Jerry Sievers writes: > Tom Lane writes: >> The "unkillable" aspect is odd, but I wonder if that's just a red >> herring. A query that's generated lots of temp files will try to >> clean them up at termination, so maybe the backend is just sitting >> there removing temp files before it'll give c

Re: Unkillable processes creating millions of tiny temp files

2021-03-05 Thread Jerry Sievers
Hi Tom, thx for the quick response and a few remarks below... I work at the same site that Jeremy does and we're both looking at this today. Tom Lane writes: > Jeremy Finzel writes: > >> We are running postgres 11.9 (were running 11.7 prior to recent restart) on >> a large db (10s of TB) with

Re: Unkillable processes creating millions of tiny temp files

2021-03-05 Thread Tom Lane
Jeremy Finzel writes: > We are running postgres 11.9 (were running 11.7 prior to recent restart) on > a large db (10s of TB) with 5 or 6 tablespaces and 1000s of tables/indexes. > Within the past few days we have started to see a few queries running for > over 8 hours which we then attempt to ter

Unkillable processes creating millions of tiny temp files

2021-03-05 Thread Jeremy Finzel
Greetings! We are running postgres 11.9 (were running 11.7 prior to recent restart) on a large db (10s of TB) with 5 or 6 tablespaces and 1000s of tables/indexes. Within the past few days we have started to see a few queries running for over 8 hours which we then attempt to terminate, but will no

Re: Postgres Analog of Oracle APPEND hint

2021-03-05 Thread Merlin Moncure
On Thu, Feb 25, 2021 at 10:26 AM Rumpi Gravenstein wrote: > > Unfortunately, I am not looking to load from an external source. My process > is moving data from source PostgreSQL tables to target PostgreSQL tables. INSERT INTO ...SELECT ... is one of the fastest ways possible to move data aroun

Re: Log files polluted with permission denied error messages after every 10 seconds

2021-03-05 Thread Andrus
Hi! >Windows? Don't let anti-virus software mess with the data directory. Windows default Windows Defender is active. I excluded data, pg_wal folders and postgres process: Then turned real-time protection off: Problem persists. New entry is written after every 10 seconds. pg_wal also conta

Re: Postgres Analog of Oracle APPEND hint

2021-03-05 Thread Peter J. Holzer
On 2021-02-25 14:52:20 -0500, Rumpi Gravenstein wrote: > My use case involves complicated joins on source tables in one schema loading > a > target table in the same or a different schema. So source(s) and target are in the same database? That wasn't clear from your earlier mails. If you are doi

Re: Log files polluted with permission denied error messages after every 10 seconds

2021-03-05 Thread Laurenz Albe
On Fri, 2021-03-05 at 12:13 +0200, Andrus wrote: > Postgres 13.1 is installed in windows server. There are about 100 users. > > Log files contain huge number of permisson denied error messages in every day > like : > > 2021-03-04 01:38:49.818 EET [4580] LOG: could not rename file > "pg_wal/000

Log files polluted with permission denied error messages after every 10 seconds

2021-03-05 Thread Andrus
Hi! Postgres 13.1 is installed in windows server. There are about 100 users. Log files contain huge number of permisson denied error messages in every day like : 2021-03-04 01:38:49.818 EET [4580] LOG:  could not rename file "pg_wal/00010005001B": Permission denied 2021-03-04 01: