Re: Issues of slow running queries when dealing with Big Data

2020-07-28 Thread Shaozhong SHI
On Tue, 28 Jul 2020 at 22:43, Michael Lewis wrote: > Many thanks. Is this way correct? I am learning what is meant by 'top >> posting'. >> > > Yes. > > On the subject of your settings, I don't see anything for work_mem, > random_page_cost and other commonly tuned parameters. That would be a goo

Re: Issues of slow running queries when dealing with Big Data

2020-07-28 Thread Michael Lewis
> > Many thanks. Is this way correct? I am learning what is meant by 'top > posting'. > Yes. On the subject of your settings, I don't see anything for work_mem, random_page_cost and other commonly tuned parameters. That would be a good start. What sort of machine specs are there for Postgres in

Re: Issues of slow running queries when dealing with Big Data

2020-07-28 Thread Shaozhong SHI
On Tue, 28 Jul 2020 at 20:36, Gavin Flower wrote: > On 29/07/2020 03:51, Shaozhong SHI wrote: > > Hi, > > > > Please find the result of select name, setting, source from > > pg_settings where source <> 'default'; > > > > Regards, > > > > Shao > > > > > > > > On Tue, 28 Jul 2020 at 16:42, Michael

Re: Issues of slow running queries when dealing with Big Data

2020-07-28 Thread Gavin Flower
On 29/07/2020 03:51, Shaozhong SHI wrote: Hi, Please find the result of select name, setting, source from pg_settings where source <> 'default'; Regards, Shao On Tue, 28 Jul 2020 at 16:42, Michael Lewis > wrote: On Tue, Jul 28, 2020 at 7:59 AM Shaozhong SH

Re: Issues of slow running queries when dealing with Big Data

2020-07-28 Thread Michael Lewis
On Tue, Jul 28, 2020 at 7:59 AM Shaozhong SHI wrote: > Hi, Gavin, > > PostgreSQL Version - 10.11. PostGIS Version - 2.4.7. Operating System - > Red Hat Enterprise Linux 7.7 . > > That is all I know at the moment. > > As I understand, our IT staff is building another one to sit on Azure. > Please

Re: Issues of slow running queries when dealing with Big Data

2020-07-28 Thread Shaozhong SHI
Hi, Gavin, PostgreSQL Version - 10.11. PostGIS Version - 2.4.7. Operating System - Red Hat Enterprise Linux 7.7 . That is all I know at the moment. As I understand, our IT staff is building another one to sit on Azure. Regards, Shao On Tue, 28 Jul 2020 at 12:31, Gavin Flower wrote: > On 28/

Re: Issues of slow running queries when dealing with Big Data

2020-07-28 Thread Gavin Flower
On 28/07/2020 22:54, Shaozhong SHI wrote: It has been found that issues occur when Big Data is being handled with PostGIS. Typically, queries can be killed by the system or memory is out.  Often, queries can be very slow.  Sometimes, it will take days or weeks to complete. What are the best a

Issues of slow running queries when dealing with Big Data

2020-07-28 Thread Shaozhong SHI
It has been found that issues occur when Big Data is being handled with PostGIS. Typically, queries can be killed by the system or memory is out. Often, queries can be very slow. Sometimes, it will take days or weeks to complete. What are the best approaches and means for improving the performan