Re: Performance issues during pg_restore -j with big partitioned table

2025-04-05 Thread Adrian Klaver
On 4/2/25 10:39 AM, Adrian Klaver wrote: --clean will drop the object entirely not TRUNCATE. I'm guessing that this is being done by you per: https://www.postgresql.org/message-id/53760c70-4a87-a453-9e02-57abc9cb2e54%40gmx.net "After each failed attempt, I need to issue a TRUNCATE table

Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Dimitrios Apostolou
Hello list. My database includes one table with 1000 partitions, all of them rather sizeable. I run: pg_restore -j12 --no-tablespaces --disable-triggers --exit-on-error --no-owner --no-privileges -n public -d newdb custom_format_dump.pgdump Right now after 24h of restore, I notice weird beha

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Dimitrios Apostolou
On Wed, 2 Apr 2025, Dimitrios Apostolou wrote: Hello list. My database includes one table with 1000 partitions, all of them rather I was not clear here: my database dump has all that, and the database is brand new and empty. sizeable. I run: pg_restore -j12 --no-tablespaces --disable-trig

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Adrian Klaver
On 4/4/25 9:45 AM, Ron Johnson wrote: TRUNCATE statements inside of "toc.dat" files?  I'm skeptical. See my post here: https://www.postgresql.org/message-id/7be2dcc6-3ba4-4e3f-a154-8d13d816aa9b%40aklaver.com -- Adrian Klaver adrian.kla...@aklaver.com

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Ron Johnson
On Wed, Apr 2, 2025 at 1:32 PM Dimitrios Apostolou wrote: > Hello list. > > My database includes one table with 1000 partitions, all of them rather > sizeable. I run: > >pg_restore -j12 --no-tablespaces --disable-triggers --exit-on-error > --no-owner --no-privileges -n public -d newdb custom_

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Adrian Klaver
On 4/4/25 08:09, Dimitrios Apostolou wrote: On Fri, 4 Apr 2025, Adrian Klaver wrote: On 4/4/25 06:13, Dimitrios Apostolou wrote:  On Wed, 2 Apr 2025, Dimitrios Apostolou wrote:  Bug? This happened on a postgres compiled from last week's master branch. Are you talking about the dev versio

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Dimitrios Apostolou
On Fri, 4 Apr 2025, Adrian Klaver wrote: On 4/4/25 06:13, Dimitrios Apostolou wrote: On Wed, 2 Apr 2025, Dimitrios Apostolou wrote: Bug? This happened on a postgres compiled from last week's master branch. Are you talking about the dev version? In this thread, yes. My mistake I didn't

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Adrian Klaver
On 4/4/25 06:13, Dimitrios Apostolou wrote: On Wed, 2 Apr 2025, Dimitrios Apostolou wrote: Bug? This happened on a postgres compiled from last week's master branch. Are you talking about the dev version? The dump I'm trying to restore is from postgres 17.4. Thanks Dimitris -- Adria

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-02 Thread Dimitrios Apostolou
On Wed, 2 Apr 2025, Adrian Klaver wrote: On 4/2/25 10:39 AM, Adrian Klaver wrote: --clean will drop the object entirely not TRUNCATE. I'm guessing that this is being done by you per: https://www.postgresql.org/message-id/53760c70-4a87-a453-9e02-57abc9cb2e54%40gmx.net "After each fa

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-02 Thread Dimitrios Apostolou
On Wed, 2 Apr 2025, Adrian Klaver wrote: On 4/2/25 10:32 AM, Dimitrios Apostolou wrote: Hello list. My database includes one table with 1000 partitions, all of them rather sizeable. I run:   pg_restore -j12 --no-tablespaces --disable-triggers --exit-on-error --no-owner --no-privileges

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-02 Thread Adrian Klaver
On 4/2/25 10:32 AM, Dimitrios Apostolou wrote: Hello list. My database includes one table with 1000 partitions, all of them rather sizeable. I run:   pg_restore -j12 --no-tablespaces --disable-triggers --exit-on-error --no-owner --no-privileges -n public -d newdb custom_format_dump.pgdump