On Sun, Sep 8, 2024 at 8:27 PM Adrian Klaver wrote:
> > simple INSERT ... SELECT was more than twice as fast as 8 parallel COPY
> > operations (and about 8 times as fast as a single COPY).
>
> Yeah they seem to have changed a great deal. Though you are correct in
> saying COPY is not faster then
On 9/8/24 10:45, Peter J. Holzer wrote:
On 2024-09-06 01:44:00 +0530, Lok P wrote:
We are having a requirement to create approx 50 billion rows in a partition
table(~1 billion rows per partition, 200+gb size daily partitions) for a
performance test. We are currently using ' insert into
select..
On 2024-09-06 01:44:00 +0530, Lok P wrote:
> We are having a requirement to create approx 50 billion rows in a partition
> table(~1 billion rows per partition, 200+gb size daily partitions) for a
> performance test. We are currently using ' insert into table_partition>
> select.. From or ;' metho
On Fri, Sep 6, 2024 at 12:43 AM Lok P wrote:
> Also during index creation we are trying to do it multiple partitions at
> same time from multiple sessions.But seeing out of memory error in 5th or
> 6th session.
>
Had that same problem during pg_restore. Reduced maintenance_work_mem and
the prob
On Fri, 6 Sept, 2024, 9:20 am Muhammad Usman Khan,
wrote:
> Hi,
>
> You can use pg_partman. If your table is partitioned, you can manage
> partitions in parallel by distributing the load across partitions
> concurrently. Or you can use citus. It can be an excellent solution,
> especially for hand
Hi,
You can use pg_partman. If your table is partitioned, you can manage
partitions in parallel by distributing the load across partitions
concurrently. Or you can use citus. It can be an excellent solution,
especially for handling large data volumes and parallelizing data operations
On Fri, 6 S
On 9/5/24 14:14, Lok P wrote:
Hi,
We are having a requirement to create approx 50 billion rows in a
partition table(~1 billion rows per partition, 200+gb size daily
partitions) for a performance test. We are currently using ' insert
into select.. From
or ;' method . We have dropped all in
On Thu, Sep 5, 2024 at 4:14 PM Lok P wrote:
> Hi,
>
> We are having a requirement to create approx 50 billion rows in a
> partition table(~1 billion rows per partition, 200+gb size daily
> partitions) for a performance test. We are currently using ' insert into
> select.. From or transformed q
Hi,
We are having a requirement to create approx 50 billion rows in a partition
table(~1 billion rows per partition, 200+gb size daily partitions) for a
performance test. We are currently using ' insert into select.. From or ;' method . We have dropped all indexes and constraints
First and then
