Re: [PERFORM] Recursive query performance issue

2015-11-16 Thread Merlin Moncure
On Sat, Nov 14, 2015 at 12:58 AM, Jamie Koceniak wrote: > Had the issue again today. > > Here is vmstat : > procs ---memory-- ---swap-- -io -system-- cpu > r b swpd free buff cache si sobibo in cs us sy id wa > 24 0 0 1591718656 605656

Re: [PERFORM] Recursive query performance issue

2015-11-14 Thread Jamie Koceniak
@postgresql.org Subject: Re: [PERFORM] Recursive query performance issue On Fri, Oct 23, 2015 at 12:45 PM, Jamie Koceniak wrote: > Hi, > > We just had the performance problem again today. > Here is some of the top output. Unfortunately, we don't have perf top > installed. > >

Re: [PERFORM] Recursive query performance issue

2015-10-26 Thread Merlin Moncure
On Fri, Oct 23, 2015 at 12:45 PM, Jamie Koceniak wrote: > Hi, > > We just had the performance problem again today. > Here is some of the top output. Unfortunately, we don't have perf top > installed. > > top - 16:22:16 up 29 days, 13:00, 2 users, load average: 164.63, 158.62, > 148.52 > Tasks:

Re: [PERFORM] Recursive query performance issue

2015-10-25 Thread Jamie Koceniak
adama_prod=# SHOW shared_buffers; shared_buffers 64GB From: Pavel Stehule [mailto:pavel.steh...@gmail.com] Sent: Wednesday, October 21, 2015 12:26 PM To: Jamie Koceniak Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] Recursive query performance issue 2015-10-21 20

Re: [PERFORM] Recursive query performance issue

2015-10-25 Thread Jamie Koceniak
Subject: Re: [PERFORM] Recursive query performance issue 2015-10-21 19:55 GMT+02:00 Jamie Koceniak mailto:jkocen...@mediamath.com>>: Hi Pavel, Thanks for the reply. 1. The queries aren’t waiting on any locks. The query has a recursive join that uses a table with only 80k records and that

Re: [PERFORM] Recursive query performance issue

2015-10-25 Thread Jamie Koceniak
tgres: user1 db 0.0.0.3(36638) SELECT -Original Message- From: Merlin Moncure [mailto:mmonc...@gmail.com] Sent: Wednesday, October 21, 2015 12:50 PM To: Pavel Stehule Cc: Jamie Koceniak; pgsql-performance@postgresql.org Subject: Re: [PERFORM] Recursive query performance issue On Wed, O

Re: [PERFORM] Recursive query performance issue

2015-10-25 Thread Jamie Koceniak
Hi Pavel, Or were you referring to SHMMAX? Thanks From: Jamie Koceniak Sent: Wednesday, October 21, 2015 11:40 AM To: 'Pavel Stehule' Cc: pgsql-performance@postgresql.org Subject: RE: [PERFORM] Recursive query performance issue Ok df -h /dev/shm Filesystem Size Used Avail Us

Re: [PERFORM] Recursive query performance issue

2015-10-25 Thread Jamie Koceniak
effective_cache_size = 512GB (25% of total memory) Thanks, Jamie From: Pavel Stehule [mailto:pavel.steh...@gmail.com] Sent: Wednesday, October 21, 2015 12:04 AM To: Jamie Koceniak Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] Recursive query performance issue Hi 2015-10-20 19:34 GMT+02:00

Re: [PERFORM] Recursive query performance issue

2015-10-23 Thread Pavel Stehule
user1 db 0.0.0.2(37887) SELECT > 36714 postgres 20 0 65.7g 80m 56m R65 0.0 5:56.08 postgres: > user1 db 0.0.0.3(35177) SELECT > 43599 postgres 20 0 65.7g 80m 56m R65 0.0 5:05.03 postgres: > user1 db 0.0.0.3(36638) SELECT > > -Original Message- >

Re: [PERFORM] Recursive query performance issue

2015-10-22 Thread vincent elschot
On 20-10-15 19:34, Jamie Koceniak wrote: Version: --- PostgreSQL 9.1.14 on x86_64-unknown-linux-gnu, compiled by gcc (Debian 4.7.2-5) 4.7.2, 64-bit Query Plan http://explain.depesz.com/s/4s37 Nor

Re: [PERFORM] Recursive query performance issue

2015-10-21 Thread Pavel Stehule
s; > > Regards > > Pavel > > > > Thanks > > > > *From:* Jamie Koceniak > *Sent:* Wednesday, October 21, 2015 11:40 AM > *To:* 'Pavel Stehule' > *Cc:* pgsql-performance@postgresql.org > *Subject:* RE: [PERFORM] Recursive query performance issue

Re: [PERFORM] Recursive query performance issue

2015-10-21 Thread Merlin Moncure
On Wed, Oct 21, 2015 at 2:45 PM, Pavel Stehule wrote: > 2015-10-21 21:32 GMT+02:00 Jamie Koceniak : >> >> adama_prod=# SHOW shared_buffers; >> >> shared_buffers >> >> >> >> 64GB > > > can you try to increase shared buffers to 200GB and decrease effective cache > size to 180GB? If

Re: [PERFORM] Recursive query performance issue

2015-10-21 Thread Pavel Stehule
r 21, 2015 11:40 AM > *To:* 'Pavel Stehule' > *Cc:* pgsql-performance@postgresql.org > *Subject:* RE: [PERFORM] Recursive query performance issue > > > > Ok > > > > df -h /dev/shm > > Filesystem Size Used Avail Use% Mounted on > > tmpfs

Re: [PERFORM] Recursive query performance issue

2015-10-21 Thread Pavel Stehule
, 2015 12:04 AM > *To:* Jamie Koceniak > *Cc:* pgsql-performance@postgresql.org > *Subject:* Re: [PERFORM] Recursive query performance issue > > > > Hi > > > > 2015-10-20 19:34 GMT+02:00 Jamie Koceniak : > > Version: > > >

Re: [PERFORM] Recursive query performance issue

2015-10-21 Thread Merlin Moncure
On Tue, Oct 20, 2015 at 12:34 PM, Jamie Koceniak wrote: > Version: > > --- > > PostgreSQL 9.1.14 on x86_64-unknown-linux-gnu, compiled by gcc (Debian > 4.7.2-5) 4.7.2, 64-bit > > Query Plan > > http://expla

Re: [PERFORM] Recursive query performance issue

2015-10-21 Thread Pavel Stehule
Hi 2015-10-20 19:34 GMT+02:00 Jamie Koceniak : > Version: > > > --- > > PostgreSQL 9.1.14 on x86_64-unknown-linux-gnu, compiled by gcc (Debian > 4.7.2-5) 4.7.2, 64-bit > > > > Query Plan > > http://expla

[PERFORM] Recursive query performance issue

2015-10-20 Thread Jamie Koceniak
Version: --- PostgreSQL 9.1.14 on x86_64-unknown-linux-gnu, compiled by gcc (Debian 4.7.2-5) 4.7.2, 64-bit Query Plan http://explain.depesz.com/s/4s37 Normally, this query takes around 200-300 ms to execu