Re: [PERFORM] problem with large inserts

2012-12-13 Thread Filip RembiaƂkowski
Hmm, so it is some kind of file / table locking issue, not general IO system malfunction. It would be interesting and useful to run this use case on other postgres instance (or several instances), including non-Windows ones. OTOH Pg on Windows housekeeping was always "fun" - I advise all my clien

Re: [PERFORM] problem with large inserts

2012-12-13 Thread Lutz Fischer
Thanks a lot you saved my day create temp table foo AS SELECT DISTINCT ... did take a mere 77464.744 ms And an additional Insert into LPP select * from foo; Just 576.909 ms I don't really understand why it's working via a temp table but not directly (or in any reasonable amount of time) - but at

Re: [PERFORM] problem with large inserts

2012-12-13 Thread Tom Lane
Lutz Fischer writes: > I have currently some trouble with inserts into a table > If I run only [ the select part ] > it returns 200620 rows in 170649 ms ( thats just under 3 minutes). I > stopped the actual insert after about 8h. It should not take 8h to insert 200k rows on any machine made thi

Re: [PERFORM] problem with large inserts

2012-12-13 Thread Filip RembiaƂkowski
Just an idea - how long does it take to run _only_ CREATE TEMP TABLE foo AS On Thu, Dec 13, 2012 at 4:37 PM, Lutz Fischer wrote: > Hi > > I have currently some trouble with inserts into a table > > INSERT INTO LPP (PPID, LID) > SELECT DISTINCT PPid, LID FROM > (SELECT * FROM PP WHERE

Re: [PERFORM] problem with large inserts

2012-12-13 Thread Willem Leenen
guess you've looked at http://wiki.postgresql.org/wiki/Slow_Query_Questions ?) > Date: Thu, 13 Dec 2012 15:37:33 + > From: lfisc...@staffmail.ed.ac.uk > To: pgsql-performance@postgresql.org > Subject: [PERFORM] problem with large inserts > > Hi > > I have curren

[PERFORM] problem with large inserts

2012-12-13 Thread Lutz Fischer
Hi I have currently some trouble with inserts into a table INSERT INTO LPP (PPID, LID) SELECT DISTINCT PPid, LID FROM (SELECT * FROM PP WHERE s_id = sid) pp INNER JOIN has_protein hp1 ON pp.p1id = hp1.pid INNER JOIN has_protein hp2