Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Saurabh Nanda
> c) I tried another cloud hosting provider (E2E Networks) and just the raw > performance numbers (with default configuration) are blowing Hetzner out of > the water. > I noticed that on E2E, the root filesystem is mounted with the following options: /dev/xvda on / type ext4 (rw,noatime,nodi

Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Saurabh Nanda
Yet another update: a) I've tried everything with me EX41-SSD server on Hetzner and nothing is increasing the performance over & above the default configuration. b) I tried commissioning a new EX41-SSD server and was able to replicate the same pathetic performance numbers. c) I tried another cloud

Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Saurabh Nanda
> > Do you know which of the settings is causing lower TPS ? > > I suggest to check shared_buffers. > > If you haven't done it, disabling THP and KSM can resolve performance > issues, > esp. with large RAM like shared_buffers, at least with older kernels. > > https://www.postgresql.org/message-id/2

Re: dsa_allocate() faliure

2019-01-28 Thread Thomas Munro
On Tue, Jan 29, 2019 at 2:50 AM Arne Roland wrote: > does anybody have any idea what goes wrong here? Is there some additional > information that could be helpful? Hi Arne, This seems to be a bug; that error should not be reached. I wonder if it is a different manifestation of the bug reported

Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Saurabh Nanda
I've disabled transpare huge-pages and enabled huge_pages as given below. Let's see what happens. (I feel like a monkey pressing random buttons trying to turn a light bulb on... and I'm sure the monkey would've had it easier!) AnonHugePages: 0 kB ShmemHugePages:0 kB HugePages_Total

Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Saurabh Nanda
> > smartctl is a good start > Here's the output of `smartctl --xall /dev/sda` -- https://gist.github.com/saurabhnanda/ec3c95c1eb3896b3efe55181e7c78dde I've disabled RAID so /dev/sda is the only disk which is being currently used. I'm still seeing very weird numbers. There seems to be absolutely

RE: dsa_allocate() faliure

2019-01-28 Thread Arne Roland
Hello, does anybody have any idea what goes wrong here? Is there some additional information that could be helpful? All the best Arne Roland

Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Nicolas Charles
Le 28/01/2019 à 16:55, Saurabh Nanda a écrit : You should probably include the detailed hardware you are working on - especially for the SSD, the model can have a big impact, as well as its wear. What's the best tool to get meaningful information for SSD drives? smartctl

Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Saurabh Nanda
> > You should probably include the detailed hardware you are working on - > especially for the SSD, the model can have a big impact, as well as its > wear. > What's the best tool to get meaningful information for SSD drives? -- Saurabh.

Re: upgrade from 9.6 to 10/11

2019-01-28 Thread Justin Pryzby
On Mon, Jan 28, 2019 at 11:20:28AM +0100, Laurenz Albe wrote: > Mariel Cherkassky wrote: > > I'm planning our db upgrade from 9.6. Basically I wanted to check how stable > > is pg11 version. I'm considering upgrading from 9.6 to 10 and then to 11 > > immediatly. > > Is there a way to upgrade direc

Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Nicolas Charles
Le 28/01/2019 à 15:03, Saurabh Nanda a écrit : An update. It seems (to my untrained eye) that something is wrong with the second SSD in the RAID configuration. Here's my question on serverfault related to what I saw with iostat - https://serverfault.com/questions/951096/difference-in-utilisatio

Re: Benchmarking: How to identify bottleneck (limiting factor) and achieve "linear scalability"?

2019-01-28 Thread Saurabh Nanda
An update. It seems (to my untrained eye) that something is wrong with the second SSD in the RAID configuration. Here's my question on serverfault related to what I saw with iostat - https://serverfault.com/questions/951096/difference-in-utilisation-reported-by-iostat-for-two-identical-disks-in-rai

Re: upgrade from 9.6 to 10/11

2019-01-28 Thread Laurenz Albe
Mariel Cherkassky wrote: > I'm planning our db upgrade from 9.6. Basically I wanted to check how stable > is pg11 version. I'm considering upgrading from 9.6 to 10 and then to 11 > immediatly. > Is there a way to upgrade directly to 11 and jump on 10. v11 is stable, else the PGDG would not releas

upgrade from 9.6 to 10/11

2019-01-28 Thread Mariel Cherkassky
Hi, I'm planning our db upgrade from 9.6. Basically I wanted to check how stable is pg11 version. I'm considering upgrading from 9.6 to 10 and then to 11 immediatly. Is there a way to upgrade directly to 11 and jump on 10. Thanks.