Re: alter table xxx set unlogged take long time

2022-07-26 Thread David G. Johnston
On Tue, Jul 26, 2022 at 5:45 AM James Pang (chaolpan) wrote: > Without step 3 , copy data take long time. Use wal_level=minimal can > help make COPY load data without logging ? > > I believe you are referring to: https://www.postgresql.org/docs/current/populate.html#POPULATE-COPY-FROM Since

RE: alter table xxx set unlogged take long time

2022-07-26 Thread James Pang (chaolpan)
We use JDBC to export data into csv ,then copy that to Postgres. Multiple sessions working on multiple tables. If not set unlogged , how to make COPY run fast ? possible to start a transaction include all of these “truncate table xxx; copy table ; create index on tables….” With wal_l

Re: alter table xxx set unlogged take long time

2022-07-26 Thread Jim Mlodgenski
On Tue, Jul 26, 2022 at 8:45 AM James Pang (chaolpan) wrote: > Without step 3 , copy data take long time. Use wal_level=minimal can > help make COPY load data without logging ? > > I assume that you're most concerned with the total time of moving the data from the source database into the fina

RE: alter table xxx set unlogged take long time

2022-07-26 Thread James Pang (chaolpan)
Without step 3 , copy data take long time. Use wal_level=minimal can help make COPY load data without logging ? Thanks, James -Original Message- From: Tom Lane Sent: Tuesday, July 26, 2022 8:43 PM To: James Pang (chaolpan) Cc: Jim Mlodgenski ; pgsql-performance@lists.postgresql.or

Re: alter table xxx set unlogged take long time

2022-07-26 Thread Tom Lane
"James Pang (chaolpan)" writes: > How to make it fast ? These are our steps about copy large data from Oracle > to Postgres > 1. Create table in Postgres 2. Extract data from Oracle to CSV 3. Alter > table set xxx unlogged, 4. Run copy command into Postgres db 5. Alter > table set xxx

RE: alter table xxx set unlogged take long time

2022-07-26 Thread James Pang (chaolpan)
How to make it fast ? These are our steps about copy large data from Oracle to Postgres 1. Create table in Postgres 2. Extract data from Oracle to CSV 3. Alter table set xxx unlogged, 4. Run copy command into Postgres db 5. Alter table set xxx logged 6. Create index … Step 5 took long

Re: alter table xxx set unlogged take long time

2022-07-26 Thread Jim Mlodgenski
On Tue, Jul 26, 2022 at 4:53 AM James Pang (chaolpan) wrote: > Hi , > > We have PG v13.6 in RHEL8.4, we try to set table unlogged before load > data. There are a lot of existing data in this table, when ‘alter table > xxx set unlogged’, we found it take long time and spend time on IO > datafile

alter table xxx set unlogged take long time

2022-07-26 Thread James Pang (chaolpan)
Hi , We have PG v13.6 in RHEL8.4, we try to set table unlogged before load data. There are a lot of existing data in this table, when 'alter table xxx set unlogged', we found it take long time and spend time on IO datafileread. Is it expected? Thanks, James