Re: Increased iowait and blk_read_time with higher shared_buffers

2022-12-14 Thread Jordan Hurwich
ferent values for your database. If I were you, I would > >- try to enable huge pages. You probably will see better performance >with bigger shared_buffers when you configure huge pages. -> >https://www.postgresql.org/docs/14/kernel-resources.html#LINUX-HUGE-PAGES >

Re: Increased iowait and blk_read_time with higher shared_buffers

2022-12-14 Thread Samed YILDIRIM
Hello Jordan, You don't have to set %25 for the best performance. You need to test different values for your database. If I were you, I would - try to enable huge pages. You probably will see better performance with bigger shared_buffers when you configure huge pages. ->

Re: Increased iowait and blk_read_time with higher shared_buffers

2022-12-14 Thread Jordan Hurwich
Thanks Tom, that makes a lot of sense. Given we're seeing low iowait and blk_read_time at 4GB shared_buffers, sounds like we should just declare victory here and be happy with that setting? On Wed, Dec 14, 2022 at 10:27 AM Tom Lane wrote: > Jordan Hurwich writes: > > I'

Re: Increased iowait and blk_read_time with higher shared_buffers

2022-12-14 Thread Tom Lane
Jordan Hurwich writes: > I'm familiar with the article you linked to, and part of my surprise is > that with these 32GB RAM machines we're seeing better performance at 12.5% > (4GB) than the commonly recommended 25% (8GB) of system memory for > shared_buffers. Your notes

Re: Increased iowait and blk_read_time with higher shared_buffers

2022-12-14 Thread Jordan Hurwich
Thanks for your thoughtful response Samed. I'm familiar with the article you linked to, and part of my surprise is that with these 32GB RAM machines we're seeing better performance at 12.5% (4GB) than the commonly recommended 25% (8GB) of system memory for shared_buffers. Your notes

Re: Increased iowait and blk_read_time with higher shared_buffers

2022-12-14 Thread Samed YILDIRIM
Hi Jordan, Increased shared buffer size does not necessarily mean an increased performance. Regarding the negative correlation between IOWait and shared_buffers' size; if you don't increase memory of the system, it is an expected result in my opinion. Because, PostgreSQL starts r

Re: Shared_buffers

2019-03-12 Thread MichaelDBA
Here's one cook article on using pg_buffercache... https://www.keithf4.com/a-large-database-does-not-mean-large-shared_buffers/ Regards, Michael Vitale Justin Pryzby <mailto:pry...@telsasoft.com> Tuesday, March 12, 2019 4:11 PM I've tuned ~40 postgres instances,

Re: Shared_buffers

2019-03-12 Thread Justin Pryzby
On Tue, Mar 12, 2019 at 04:03:11PM -0400, MichaelDBA wrote: > Set shared_buffers more accurately by using pg_buffercache extension and the > related queries during high load times. I've tuned ~40 postgres instances, primarily using log_checkpoints and pg_stat_bgwriter, with custom

Re: Shared_buffers

2019-03-12 Thread MichaelDBA
Set shared_buffers more accurately by using pg_buffercache extension and the related queries during high load times. Regards, Michael Vitale Michael Lewis <mailto:mle...@entrata.com> Tuesday, March 12, 2019 3:23 PM On Tue, Mar 12, 2019 at 2:29 AM Laurenz Albe <mailto:laurenz.a...@cy

Re: Shared_buffers

2019-03-12 Thread Michael Lewis
On Tue, Mar 12, 2019 at 2:29 AM Laurenz Albe wrote: > Daulat Ram wrote: > > I want to know about the working and importance of shared_buffers in > Postgresql? > > is it similar to the oracle database buffer cache? > > Yes, exactly. > > The main difference is tha

Re: Shared_buffers

2019-03-12 Thread Laurenz Albe
Daulat Ram wrote: > I want to know about the working and importance of shared_buffers in > Postgresql? > is it similar to the oracle database buffer cache? Yes, exactly. The main difference is that PostgreSQL uses buffered I/O, while Oracle usually uses direct I/O. Usually you s

Shared_buffers

2019-03-11 Thread Daulat Ram
Hi team, I want to know about the working and importance of shared_buffers in Postgresql? is it similar to the oracle database buffer cache? Regards, Daulat

Re: Will higher shared_buffers improve tpcb-like benchmarks?

2019-01-29 Thread Saurabh Nanda
I did one final test of increasing the shared_buffers=32GB. It seems to be having no impact on TPS (in fact, if I look closely there is a 10-15% **negative** impact on the TPS compared to shared_buffers=2G) I can confirm that **almost** the entire DB has been cached in the shared_buffers

Re: Interpreting shared_buffers setting

2019-01-29 Thread Jerry Sievers
Jerry Sievers writes: > Bob Jolliffe writes: > >> Excuse me if this is a silly question. I am trying to fiddle with >> shared_buffers setting on postgresql 10.6 on ubuntu 18.04 server. >> >> I have this at bottom of my config file: >> shared_buffers = 1G

Re: Interpreting shared_buffers setting

2019-01-29 Thread Jerry Sievers
Bob Jolliffe writes: > Excuse me if this is a silly question. I am trying to fiddle with > shared_buffers setting on postgresql 10.6 on ubuntu 18.04 server. > > I have this at bottom of my config file: > shared_buffers = 1GB > > Yet when I check the setting from pg_setting

Re: Will higher shared_buffers improve tpcb-like benchmarks?

2019-01-29 Thread Saurabh Nanda
> > That is likely correct, but the data will likely be stored in the OS file > cache, so reading it from there will still be pretty fast. > Right -- but increasing shared_buffers won't increase my TPS, right? Btw, I just realised that irrespective of shared_buffers, my entire

Re: Will higher shared_buffers improve tpcb-like benchmarks?

2019-01-29 Thread Jeff Janes
d understood the > impact of shared_buffers. > > IIUC, shared_buffers won't have any significant impact in the following > scenario, right? > > -- DB size = 30GB > -- shared_buffers = 2GB > -- workload = tpcb-like > > This is because the tpcb-like workload select

Re: Interpreting shared_buffers setting

2019-01-29 Thread Bob Jolliffe
Thank you Andrew and Thomas. All is now clear :-) On Tue, 29 Jan 2019 at 13:07, Andrew Gierth wrote: > > >>>>> "Bob" == Bob Jolliffe writes: > > Bob> Excuse me if this is a silly question. I am trying to fiddle with > Bob> shared_buffers set

Re: Interpreting shared_buffers setting

2019-01-29 Thread Andrew Gierth
>>>>> "Bob" == Bob Jolliffe writes: Bob> Excuse me if this is a silly question. I am trying to fiddle with Bob> shared_buffers setting on postgresql 10.6 on ubuntu 18.04 server. Bob> I have this at bottom of my config file: Bob> shared_buffers = 1GB B

Re: Interpreting shared_buffers setting

2019-01-29 Thread Thomas Markus
Hi, check for blocksize (8k) as factor. 8k*131072=1G regards Thomas Am 29.01.19 um 13:32 schrieb Bob Jolliffe: Excuse me if this is a silly question. I am trying to fiddle with shared_buffers setting on postgresql 10.6 on ubuntu 18.04 server. I have this at bottom of my config file

Interpreting shared_buffers setting

2019-01-29 Thread Bob Jolliffe
Excuse me if this is a silly question. I am trying to fiddle with shared_buffers setting on postgresql 10.6 on ubuntu 18.04 server. I have this at bottom of my config file: shared_buffers = 1GB Yet when I check the setting from pg_setting I see something quite different: postgres=# SELECT name

Re: Will higher shared_buffers improve tpcb-like benchmarks?

2019-01-29 Thread Joe Mirabal
eren't getting my anywhere, I > finally purchased PostgreSQL 10 - Higher Performance [2] and understood the > impact of shared_buffers. > > IIUC, shared_buffers won't have any significant impact in the following > scenario, right? > > -- DB size = 30GB > -- shared_

Will higher shared_buffers improve tpcb-like benchmarks?

2019-01-29 Thread Saurabh Nanda
Hi, I'm going crazy trying to optimise my Postgres config for a production setting [1] Once I realised random changes weren't getting my anywhere, I finally purchased PostgreSQL 10 - Higher Performance [2] and understood the impact of shared_buffers. IIUC, shared_buffers won&