Re: [PERFORM] DELETE taking too much memory

2011-07-10 Thread Vincent de Phily
ed around the initial problem by running the delete in smaller batches. Thanks. -- Vincent de Phily -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] [GENERAL] DELETE taking too much memory

2011-07-10 Thread Vincent de Phily
k-around for you might be to break your deletes up > into smaller chunks, say 100k or 1M rows at a time, eg: > > delete from t1 where t1id in (select t1id from t2 where foo=0 and bar > < '20101101' limit 10); Yes, that's what we ended up doing. We cancele

Re: [PERFORM] DELETE taking too much memory

2011-07-10 Thread Vincent de Phily
. We haven't tweaked effective cache size yet, it's on the TODO... like many other things :/ -- Vincent de Phily -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] [GENERAL] DELETE taking too much memory

2011-07-10 Thread Vincent de Phily
=0.00..52.38 rows=1 > >width=10) > > > > Index Cond: (t1.t1id = t2.t1id) > > > > (7 rows) > > > > > > Note that the estimate of 30849 rows is way off : there should be > > around 55M rows deleted from t1, and 2-3 times as

Re: [PERFORM] slow query : very simple delete, 100% cpu, nearly no disk activity

2009-09-21 Thread Vincent de Phily
On Monday 21 September 2009 17:00:36 Merlin Moncure wrote: > On Mon, Sep 21, 2009 at 10:50 AM, Vincent de Phily > > wrote: > > On Friday 11 September 2009 23:55:09 Merlin Moncure wrote: > >> On Mon, Sep 7, 2009 at 5:05 AM, Vincent d

Re: [PERFORM] slow query : very simple delete, 100% cpu, nearly no disk activity

2009-09-21 Thread Vincent de Phily
On Friday 11 September 2009 23:55:09 Merlin Moncure wrote: > On Mon, Sep 7, 2009 at 5:05 AM, Vincent de Phily > wrote: > >                                     Table "public.message" > >  Column   |            Type             |  

Re: [PERFORM] slow query : very simple delete, 100% cpu, nearly no disk activity

2009-09-21 Thread Vincent de Phily
On Friday 11 September 2009 23:30:37 Robert Haas wrote: > On Mon, Sep 7, 2009 at 5:05 AM, Vincent de Phily > wrote: > > On Monday 07 September 2009 03:25:23 Tom Lane wrote: > >> > >> 99% of the time, the reason a delete takes way longer than it seems like > &g

Re: [PERFORM] slow query : very simple delete, 100% cpu, nearly no disk activity

2009-09-10 Thread Vincent de Phily
On Monday 07 September 2009 03:25:23 Tom Lane wrote: > Vincent de Phily writes: > > I've been running this simple delete since yesterday afternoon : > >> db=# explain delete from message where datetime < '2009-03-03'; > >> Seq Scan on message (cost=0.

[PERFORM] slow query : very simple delete, 100% cpu, nearly no disk activity

2009-09-06 Thread Vincent de Phily
/' > log_filename = '%Y-%m-%d_%H%M%S.log' > log_rotation_size = 100MB > log_min_duration_statement = 3 > log_line_prefix = '%t %d %p ' > datestyle = 'iso, mdy' > lc_messages = 'C' > lc_monetary = 'C' > lc_numeric = &