Re: Inserts and bad performance

2021-11-24 Thread Kenneth Marshall
On Wed, Nov 24, 2021 at 07:15:31PM +, Godfrin, Philippe E wrote: > Greetings > I am inserting a large number of rows, 5,10, 15 million. The python code > commits every 5000 inserts. The table has partitioned children. > > At first, when there were a low number of rows inserted, the inserts wo

Re: optimization issue

2021-07-09 Thread Kenneth Marshall
On Fri, Jul 09, 2021 at 01:16:16PM +1000, rob stone wrote: > Hello, > > I am curious. > > NVL, DECODE and SELECT FROM dual are Oracle methods and these appear in > your code. > > How did you make these work in Postgres?  > > Cheers, > Rob Hi Rob, At a guess, they are using the Orafce PostgreS

Re: CONCAT function adding extra characters

2021-06-15 Thread Kenneth Marshall
> út 15. 6. 2021 v 20:56 odesílatel AI Rumman napsal: > I am using Postgresql 10 and seeing a strange behavior in CONCAT function > when I am concatenating double precision and int with a separator. > > select concat('41.1'::double precision,':', 20); >> Result: >> 41.1014:20 > > > Va

Re: Binary encoding of timetz type

2021-03-22 Thread Kenneth Marshall
On Mon, Mar 22, 2021 at 08:11:55PM -0500, Merlin Moncure wrote: > Check out libpqtypes -- it has client side send/receive functions for > binary format you can crib from. > > https://github.com/pgagarinov/libpqtypes/blob/master/source/src/datetime.c > > merlin Hi, I just wanted to +1 the libpqt

Re: Same query taking less time in low configuration machine

2020-07-14 Thread Kenneth Marshall
On Tue, Jul 14, 2020 at 09:27:56PM +0530, Vishwa Kalyankar wrote: > HI, > > OS cache is updated and I had run the query few times with almost the same > result each time. > > Regards, > Vishwa Hi Vishwa, What are the CPU speeds, memory bandwidth, I/O bandwidth? Often the lower core count CPUs h

Re: Oracle vs. PostgreSQL - a comment

2020-06-02 Thread Kenneth Marshall
On Tue, Jun 02, 2020 at 11:18:52PM +0200, Thomas Kellerer wrote: > Ron schrieb am 02.06.2020 um 20:38: > > > >>   PG's individual clusters are relatively lightweight, after all. > > > >But require a new port, and Enterprises have Processes that must be followed. > > I am not 100% sure, but I think

Re: surprisingly slow creation of gist index used in exclude constraint

2020-05-15 Thread Kenneth Marshall
> > > >Hi Chris, > > > >This sounds like a candidate for pg_logical replicating from the > >old to new system. > > Can you point me to a good guide as to how to easily set this up for > one database and would work between pg 9.4 and pg 11.5? > > cheers, > > Chris Hi Chris, Here is on for 9.4 t

Re: select * from test where name like 'co_%'

2020-03-10 Thread Kenneth Marshall
On Tue, Mar 10, 2020 at 12:49:01PM +, sivapostg...@yahoo.com wrote: > Hello, > What returns when I run a query like this; > Select * from test where name like 'co_%'; > I expect anything that starts with 'co_' and NOT 'co' only.  Am I right?  But > I get every names that starts with 'co'. Why

Re: Compression In Postgresql 9.6

2019-08-05 Thread Kenneth Marshall
> >Hi, > > > >On RHEL/Centos you can use VDO filesystem compression to make an archive > >tablespace to use for older data. That will compress everything. > > Doesn't this imply that either his table is partitioned or he > regularly moves records from the main table to the archive table? > Hi,

Re: Compression In Postgresql 9.6

2019-08-05 Thread Kenneth Marshall
On Mon, Aug 05, 2019 at 12:00:14PM +0530, Shital A wrote: > Hello, > > Need inputs on below: > > We are working on a setting up a new highly transactional (tps 100k) OLTP > system for payments using blockchain and postgresql 9.6 as DB on Rhel 7.6. > Postgres version is 9.6 and not latest because

Re: Rearchitecting for storage

2019-07-19 Thread Kenneth Marshall
Hi Matt, On Fri, Jul 19, 2019 at 10:41:31AM -0400, Matthew Pounsett wrote: > On Fri, 19 Jul 2019 at 04:21, Luca Ferrari wrote: > > > > > This could be trivial, but any chance you can partition the table > > and/or archive unused records (at least temporarly)? A 18 TB table > > quite frankly soun

Re: Rearchitecting for storage

2019-07-18 Thread Kenneth Marshall
Hi Matt, On Thu, Jul 18, 2019 at 09:44:04AM -0400, Matthew Pounsett wrote: > I've recently inherited a database that is dangerously close to outgrowing > the available storage on its existing hardware. I'm looking for (pointers > to) advice on scaling the storage in a financially constrained > no

Re: software or hardware RAID?

2019-03-23 Thread Kenneth Marshall
On Sat, Mar 23, 2019 at 12:09:11PM +, Rory Campbell-Lange wrote: > On 17/03/19, Rory Campbell-Lange (r...@campbell-lange.net) wrote: > > We aren't sure whether to use software MDRaid or a MegaRAID card. > > > > We're buying some new Postgres servers with > > > > 2 x 240GB Intel SSD S4610

Re: Script which shows performance of ByteA: ascii vs binary

2019-03-22 Thread Kenneth Marshall
On Fri, Mar 22, 2019 at 01:40:28PM +0100, Francisco Olarte wrote: > Thomas: > > On Fri, Mar 22, 2019 at 11:22 AM Thomas Güttler > wrote: > > Thank you for asking several times for a benchmark. > > I wrote it now and it is visible: inserting random bytes into bytea is much > > slower, > > if you

Re: Server upgrade advice

2019-03-05 Thread Kenneth Marshall
> > > Is there a reason not to consider an all flash solution? The AMD EPYC > > processor series supports enough NVMe channels to support your sizing. > > The 7401P single processor is a good value proposition. > > Hi Ken > > Thanks very much for your response. > > I'm completely naive about th

Re: Server upgrade advice

2019-03-05 Thread Kenneth Marshall
> > Consequently we're thinking of the following replacement servers: > > postgres 11 (planned) > supermicro 113TQ-R700W > LSI MegaRAID 9271-8i SAS/SATA RAID Controller, 1Gb DDR3 Cache (PCIE- Gen > 3) > 500gb raid 1 / > 2tb raid 10 /db > with "zero maintenanc

Re: Methods to quickly spin up copies of an existing databases

2019-03-01 Thread Kenneth Marshall
On Fri, Mar 01, 2019 at 11:57:30AM -0800, Kevin Wilkinson wrote: > if you are able/willing to use ZFS (rather than ext4, xfs, ...) to > store your database, then it might work for you. ZFS is > copy-on-write so it can very quickly clone a database. > > kevin Hi Arjun Redhat 7 does have LVM snaps

Query never completes with an OR condition

2018-12-03 Thread Kenneth Marshall
Hi, I was investigating a performance problem and found a query that never completes in a reasonable amount of time even though my expectation is that it should. I am running version 9.6.6. I do not see anything in the 9.6.* release notes that mention this problem. The individual queries run as ex

Re: Slow alter sequence with PG10.1

2018-01-22 Thread Kenneth Marshall
On Mon, Jan 22, 2018 at 04:40:54PM -0700, David G. Johnston wrote: > > > I guess - the reason I'm a bit disappointed from the new behavior is that > > we have used Postgresql for more than 10 years and it has never let us > > down. We have been able to improve our product with every new release of