Re: [PERFORM] Occasional Really Slow Running Updates/Inserts

2015-09-17 Thread Dave Stibrany
Thanks Ken, I'll give that a try. On Thu, Sep 17, 2015 at 4:12 PM, k...@rice.edu wrote: > On Thu, Sep 17, 2015 at 03:14:43PM -0400, Dave Stibrany wrote: > > Hi all. I am occasionally seeing really slow update/inserts into a fairly > > large table. By really slow I mean around 10-40 seconds, > >

Re: [PERFORM] Occasional Really Slow Running Updates/Inserts

2015-09-17 Thread k...@rice.edu
On Thu, Sep 17, 2015 at 03:14:43PM -0400, Dave Stibrany wrote: > Hi all. I am occasionally seeing really slow update/inserts into a fairly > large table. By really slow I mean around 10-40 seconds, > while the majority of queries take milliseconds. I cannot reproduce this > problem myself, but it i

Re: [PERFORM] degrading inser performance

2015-09-17 Thread Dave Cramer
Nobody has asked what kind of machine this is ??? Hard disks, memory, etc. What are your relevant settings in postgresql.conf ? Shared buffers, checkpoints, etc. Also how big are the inserts ? What else is this machine doing ? Is it bare hardware, or a VM ? Dave Cramer dave.cramer(at)credativ(

[PERFORM] Occasional Really Slow Running Updates/Inserts

2015-09-17 Thread Dave Stibrany
Hi all. I am occasionally seeing really slow update/inserts into a fairly large table. By really slow I mean around 10-40 seconds, while the majority of queries take milliseconds. I cannot reproduce this problem myself, but it is occurring multiple times a day (maybe 30 times). System Info ---

Re: [PERFORM] degrading inser performance

2015-09-17 Thread Eildert Groeneveld
Thanks for your input! On Do, 2015-09-17 at 11:21 -0300, Matheus de Oliveira wrote: > > On Thu, Sep 17, 2015 at 9:19 AM, Eildert Groeneveld < > eildert.groenev...@fli.bund.de> wrote: > > > * one COPY per bulk (20 000 rows) > > copy does not fit so well, as it is not only initial populating. > >

Re: [PERFORM] degrading inser performance

2015-09-17 Thread Matheus de Oliveira
On Thu, Sep 17, 2015 at 9:19 AM, Eildert Groeneveld < eildert.groenev...@fli.bund.de> wrote: > > * one COPY per bulk (20 000 rows) > copy does not fit so well, as it is not only initial populating. > Why do you say COPY doesn't fit? It seems to me that COPY fits perfectly for your case, and woul

Re: [PERFORM] degrading inser performance

2015-09-17 Thread Eildert Groeneveld
On Do, 2015-09-17 at 14:11 +0200, Ladislav Lenart wrote: > On 17.9.2015 13:32, Eildert Groeneveld wrote: > > Dear list > > > > I am experiencing a rather severe degradation of insert performance > > starting from an empty database: > > > > > >120.000 mio SNPs imported in28.9 sec -

Re: [PERFORM] degrading inser performance

2015-09-17 Thread Ladislav Lenart
On 17.9.2015 13:32, Eildert Groeneveld wrote: > Dear list > > I am experiencing a rather severe degradation of insert performance > starting from an empty database: > > > 120.000 mio SNPs imported in28.9 sec -4.16 mio/sec > 120.000 mio SNPs imported in40.9 sec -

[PERFORM] degrading inser performance

2015-09-17 Thread Eildert Groeneveld
Dear list I am experiencing a rather severe degradation of insert performance starting from an empty database: 120.000 mio SNPs imported in28.9 sec -4.16 mio/sec 120.000 mio SNPs imported in40.9 sec -2.93 mio/sec 120.000 mio SNPs imported in49