[PERFORM] One long transaction or multiple short transactions?

2015-10-05 Thread Carlo
We have a system which is constantly importing flat file data feeds into normalized tables in a DB warehouse over 10-20 connections. Each data feed row results in a single transaction of multiple single row writes to multiple normalized tables. The more columns in the feed row, the more write o

Re: [PERFORM] shared-buffers set to 24GB but the RAM only use 4-5 GB average

2015-10-05 Thread Igor Neyman
-Original Message- From: pgsql-performance-ow...@postgresql.org [mailto:pgsql-performance-ow...@postgresql.org] On Behalf Of Igor Neyman Sent: Monday, October 05, 2015 2:25 PM To: FattahRozzaq ; pgsql-performance@postgresql.org Subject: Re: [PERFORM] shared-buffers set to 24GB but the RA

Re: [PERFORM] shared-buffers set to 24GB but the RAM only use 4-5 GB average

2015-10-05 Thread Igor Neyman
-Original Message- From: pgsql-performance-ow...@postgresql.org [mailto:pgsql-performance-ow...@postgresql.org] On Behalf Of FattahRozzaq Sent: Monday, October 05, 2015 10:51 AM To: pgsql-performance@postgresql.org Subject: [PERFORM] shared-buffers set to 24GB but the RAM only use 4-5 GB

Re: [PERFORM] shared-buffers set to 24GB but the RAM only use 4-5 GB average

2015-10-05 Thread Merlin Moncure
On Mon, Oct 5, 2015 at 9:51 AM, FattahRozzaq wrote: > I have configured postgresql.conf with parameters as below: > > log_destination = 'stderr' > logging_collector = on > log_directory = 'pg_log' > listen_addresses = '*' > log_destination = 'stderr' > logging_collector = on > log_directory = 'pg_

[PERFORM] shared-buffers set to 24GB but the RAM only use 4-5 GB average

2015-10-05 Thread FattahRozzaq
I have configured postgresql.conf with parameters as below: log_destination = 'stderr' logging_collector = on log_directory = 'pg_log' listen_addresses = '*' log_destination = 'stderr' logging_collector = on log_directory = 'pg_log' log_rotation_age = 1d log_rotation_size = 1024MB listen_addresses