On Tue, Jul 26, 2022 at 5:45 AM James Pang (chaolpan)
wrote:
> Without step 3 , copy data take long time. Use wal_level=minimal can
> help make COPY load data without logging ?
>
>
I believe you are referring to:
https://www.postgresql.org/docs/current/populate.html#POPULATE-COPY-FROM
Since
We use JDBC to export data into csv ,then copy that to Postgres. Multiple
sessions working on multiple tables. If not set unlogged , how to make COPY
run fast ? possible to start a transaction include all of these “truncate
table xxx; copy table ; create index on tables….” With wal_l
On Tue, Jul 26, 2022 at 8:45 AM James Pang (chaolpan)
wrote:
> Without step 3 , copy data take long time. Use wal_level=minimal can
> help make COPY load data without logging ?
>
>
I assume that you're most concerned with the total time of moving the data
from the source database into the fina
Without step 3 , copy data take long time. Use wal_level=minimal can help
make COPY load data without logging ?
Thanks,
James
-Original Message-
From: Tom Lane
Sent: Tuesday, July 26, 2022 8:43 PM
To: James Pang (chaolpan)
Cc: Jim Mlodgenski ; pgsql-performance@lists.postgresql.or
"James Pang (chaolpan)" writes:
> How to make it fast ? These are our steps about copy large data from Oracle
> to Postgres
> 1. Create table in Postgres 2. Extract data from Oracle to CSV 3. Alter
> table set xxx unlogged, 4. Run copy command into Postgres db 5. Alter
> table set xxx
How to make it fast ? These are our steps about copy large data from Oracle to
Postgres
1. Create table in Postgres 2. Extract data from Oracle to CSV 3. Alter
table set xxx unlogged, 4. Run copy command into Postgres db 5. Alter table
set xxx logged 6. Create index …
Step 5 took long
On Tue, Jul 26, 2022 at 4:53 AM James Pang (chaolpan)
wrote:
> Hi ,
>
> We have PG v13.6 in RHEL8.4, we try to set table unlogged before load
> data. There are a lot of existing data in this table, when ‘alter table
> xxx set unlogged’, we found it take long time and spend time on IO
> datafile
Hi ,
We have PG v13.6 in RHEL8.4, we try to set table unlogged before load data.
There are a lot of existing data in this table, when 'alter table xxx set
unlogged', we found it take long time and spend time on IO datafileread. Is it
expected?
Thanks,
James