Re: CVE-2019-9193 about COPY FROM/TO PROGRAM

2019-04-01 Thread Michael Paquier
On Mon, Apr 01, 2019 at 10:04:32AM -0400, Jonathan S. Katz wrote: > +1, though I’d want to see if people get noisier about it before we rule > out an official response. > > A blog post from a reputable author who can speak to security should > be good enough and we can make noise through our vario

Fwd: Postgresql with nextcloud in Windows Server

2019-04-01 Thread 김준형
보낸사람: 김준형 Date: 2019년 4월 2일 (화) 오후 2:02 Subject: Re: Postgresql with nextcloud in Windows Server To: Adrian Klaver Thanks for your reply and I hope this answers can help your questions 1) The nextcloud is running on PostgreSQL server. Cloud system needs PostgreSQL server. 2) Nextcloud system

Re: Gigantic load average spikes

2019-04-01 Thread Rene Romero Benavides
On Mon, Apr 1, 2019 at 10:35 AM rihad wrote: > On 04/01/2019 08:30 PM, Michel Pelletier wrote: > > > > On Sun, Mar 31, 2019 at 10:49 PM David Rowley < > david.row...@2ndquadrant.com> wrote: > >> >> Perhaps a bunch of processes waiting on the access exclusive lock on >> the materialized view being

Re: Postgresql with nextcloud in Windows Server

2019-04-01 Thread Adrian Klaver
On 4/1/19 6:21 PM, 김준형 wrote: Hi Community, I have problem so I wanna help from PostgreSQL community. My problem is using PostgreSQL with nextcloud(cloud system) and It can make no more connection to server. I checked log files and knew reason. PostgreSQL prevented to disconnecting connection b

Re: Table Export & Import

2019-04-01 Thread Rene Romero Benavides
Hi Sathish, as Michel Pelletier, pointed out, a trigger based approach (i.e slony-I, bucardo) or the pg_logical plugin (requires server restart) is the way to go, personally, I've worked with slony-I, the initial setup is somewhat tricky, but it works, depending on how transactional the table, stor

Re: stale WAL files?

2019-04-01 Thread Gmail
I’m under fighting a nasty cold. It may take a day or two for me to response to recent questions and suggestion.

Re: stale WAL files?

2019-04-01 Thread Rene Romero Benavides
On Mon, Apr 1, 2019 at 6:30 PM Rene Romero Benavides < rene.romer...@gmail.com> wrote: > > On Sat, Mar 30, 2019 at 5:03 PM Gmail wrote: > >> >> >> > On Mar 30, 2019, at 10:54 AM, Gmail wrote: >> > >> > >> On Mar 29, 2019, at 6:58 AM, Michael Paquier >> wrote: >> >>> >> >>> On Thu, Mar 28,

Re: Table Export & Import

2019-04-01 Thread Sathish Kumar
Hi All, Can you tell me a way for table replication or sync or to achieve minimal downtime from dbserver1 to dbserver2 on Postgresql 9.5 Table Size: 160gb 4VCPU, 16gb RAM On Tue, Apr 2, 2019, 12:19 AM Sathish Kumar wrote: > The table size is 160gb. We would like to move/copy this table fro one

Postgresql with nextcloud in Windows Server

2019-04-01 Thread 김준형
Hi Community, I have problem so I wanna help from PostgreSQL community. My problem is using PostgreSQL with nextcloud(cloud system) and It can make no more connection to server. I checked log files and knew reason. PostgreSQL prevented to disconnecting connection but still tried to connect PostgreS

Re: stale WAL files?

2019-04-01 Thread Rene Romero Benavides
On Sat, Mar 30, 2019 at 5:03 PM Gmail wrote: > > > > On Mar 30, 2019, at 10:54 AM, Gmail wrote: > > > > > On Mar 29, 2019, at 6:58 AM, Michael Paquier > wrote: > >>> > >>> On Thu, Mar 28, 2019 at 09:53:16AM -0600, Rob Sargent wrote: > >>> This is pg10 so it's pg_wal. ls -ltr > >>> > >>> >

Re: logical replication - negative bitmapset member not allowed

2019-04-01 Thread Alvaro Herrera
On 2019-Apr-01, Tom Lane wrote: > Tim Clarke writes: > > I'm getting this message every 5 seconds on a single-master, > > single-slave replication of PG10.7->PG10.7 both on Centos. Its over the > > 'net but otherwise seems to perform excellently. Any ideas what's > > causing it and how to fix? >

Re: Help with insert query

2019-04-01 Thread Michel Pelletier
Please reply-all to the list and not just me directly. I didn't realize you meant the table was empty when you did the full insert. As Adrian pointed out, run your select using explain, it will show you why you are producing no rows. Looking at your query just superficially, the outer join looks

Re: Help with insert query

2019-04-01 Thread Adrian Klaver
On 4/1/19 10:37 AM, Glenn Schultz wrote: All, The query below is designed to insert into a table.  This works when I have a single loan which I insert.  However, if remove the part of the where clause of a single loan the insert does not work.  The table fnmloan is a large table with 500mm +

Re: Help with insert query

2019-04-01 Thread Ron
On 4/1/19 12:37 PM, Glenn Schultz wrote: All, The query below is designed to insert into a table.  This works when I have a single loan which I insert. However, if remove the part of the where clause of a single loan the insert does not work.  The table fnmloan is a large table with 500mm + r

New LLVM JIT Features

2019-04-01 Thread preejackie
Hi I'm Praveen Velliengiri, student from India. I'm working on developing a Speculative compilation support in LLVM ORC JIT Infrastructure. As LLVM ORC supports compiling in multiple backend threads, it would be effective if we compile the functions speculatively before they are called by th

Re: Test mail for pgsql-general

2019-04-01 Thread preejackie
Hi I'm Praveen Velliengiri, student from India. I'm working on developing a Speculative compilation support in LLVM ORC JIT Infrastructure. As LLVM ORC supports compiling in multiple backend threads, it would be effective if we compile the functions speculatively before they are called by th

Re: Key encryption and relational integrity

2019-04-01 Thread Rory Campbell-Lange
On 01/04/19, Moreno Andreo (moreno.and...@evolu-s.it) wrote: ... > I'm not forced to use pseudonimysation if there's the risk to get > things worse in a system. I've got to speak about these"two opposing > forces at work" to a privacy expert (maybe choosing another one, as > Peter suggested :-) ) a

Re: Key encryption and relational integrity

2019-04-01 Thread Moreno Andreo
Il 29/03/2019 20:23, Adrian Klaver ha scritto: On 3/29/19 9:01 AM, Moreno Andreo wrote: And I tried to find a solution, and since I did not like that much what I found (and it seems that neither you do :-) ), I came here hoping that someone would share his experience to shed some light on the

Re: Help with insert query

2019-04-01 Thread Michel Pelletier
On Mon, Apr 1, 2019 at 10:37 AM Glenn Schultz wrote: > All, > > The query below is designed to insert into a table. This works when I > have a single loan which I insert. However, if remove the part of the > where clause of a single loan the insert does not work. The table fnmloan > is a large

Help with insert query

2019-04-01 Thread Glenn Schultz
All, The query below is designed to insert into a table. This works when I have a single loan which I insert. However, if remove the part of the where clause of a single loan the insert does not work. The table fnmloan is a large table with 500mm + rows and the query runs for about 4 hours. An

Re: Gigantic load average spikes

2019-04-01 Thread rihad
On 04/01/2019 08:30 PM, Michel Pelletier wrote: On Sun, Mar 31, 2019 at 10:49 PM David Rowley mailto:david.row...@2ndquadrant.com>> wrote: Perhaps a bunch of processes waiting on the access exclusive lock on the materialized view being released? log_lock_waits might help you i

Re: Gigantic load average spikes

2019-04-01 Thread Michel Pelletier
On Sun, Mar 31, 2019 at 10:49 PM David Rowley wrote: > > Perhaps a bunch of processes waiting on the access exclusive lock on > the materialized view being released? > > log_lock_waits might help you if the MV takes more than a second to > refresh, otherwise, you might need to have a look at ungr

Re: Table Export & Import

2019-04-01 Thread Sathish Kumar
The table size is 160gb. We would like to move/copy this table fro one db server to another db server. On Tue, Apr 2, 2019, 12:17 AM Michel Pelletier wrote: > On Mon, Apr 1, 2019 at 7:47 AM Sathish Kumar wrote: > >> Hi Adrian, >> We are exporting live table data to a new database, so we need to

Re: Table Export & Import

2019-04-01 Thread Michel Pelletier
On Mon, Apr 1, 2019 at 7:47 AM Sathish Kumar wrote: > Hi Adrian, > We are exporting live table data to a new database, so we need to stop our > application until the export/import is completed. We would like to minimise > this downtime. > It's more complicated if you want to keep your applicatio

Re: Gigantic load average spikes

2019-04-01 Thread Adrian Klaver
On 4/1/19 8:06 AM, rihad wrote: On 04/01/2019 06:17 PM, Adrian Klaver wrote: On 3/31/19 10:08 PM, rihad wrote: What exactly do you mean by "running processes"? I don't think I've ever seen a Unix with only 1 to 3 running processes in total, so you are probably referring to processes in a certa

Re: Table Export & Import

2019-04-01 Thread Ron
/"so we need to stop our application until the export/import is completed."/ Why? On 4/1/19 9:47 AM, Sathish Kumar wrote: Hi Adrian, We are exporting live table data to a new database, so we need to stop our application until the export/import is completed. We would like to minimise this down

Re: Gigantic load average spikes

2019-04-01 Thread rihad
On 04/01/2019 06:17 PM, Adrian Klaver wrote: On 3/31/19 10:08 PM, rihad wrote: What exactly do you mean by "running processes"? I don't think I've ever seen a Unix with only 1 to 3 running processes in total, so you are probably referring to processes in a certain state. Runnable (R)? Uninterru

Re: Table Export & Import

2019-04-01 Thread Sathish Kumar
Hi Adrian, We are exporting live table data to a new database, so we need to stop our application until the export/import is completed. We would like to minimise this downtime. On Mon, Apr 1, 2019, 10:22 PM Adrian Klaver wrote: > On 3/31/19 11:09 PM, Sathish Kumar wrote: > > Hi Team, > > > > We

Re: Table Export & Import

2019-04-01 Thread Michel Pelletier
As other have pointed out, you can take a pg_dump at anytime. You can provide arguments to pg_dump to only dump a subset of the database (like one table). Also mentioned is using a foreign data wrapper (FDW). yet another approach is to use the "copy to/from program" command to stream the table f

Re: Table Export & Import

2019-04-01 Thread Adrian Klaver
On 3/31/19 11:09 PM, Sathish Kumar wrote: Hi Team, We have a requirement to copy a table from one database server to another database server. We are looking for a solution to achieve this with lesser downtime on Prod. Can you help us with this? So what is creating the downtime now? In addit

Re: Gigantic load average spikes

2019-04-01 Thread Adrian Klaver
On 3/31/19 10:08 PM, rihad wrote: What exactly do you mean by "running processes"? I don't think I've ever seen a Unix with only 1 to 3 running processes in total, so you are probably referring to processes in a certain state. Runnable (R)? Uninterruptible sleep (D)? Both? Something else? Just

Re: CVE-2019-9193 about COPY FROM/TO PROGRAM

2019-04-01 Thread Alvaro Herrera
On 2019-Apr-01, Tom Lane wrote: > Magnus Hagander writes: > > On Sat, Mar 30, 2019 at 10:16 PM Tom Lane wrote: > >> Yeah; this is supposing that there is a security boundary between > >> Postgres superusers and the OS account running the server, which > >> there is not. We could hardly have fea

Re: CVE-2019-9193 about COPY FROM/TO PROGRAM

2019-04-01 Thread Jonathan S. Katz
> On Apr 1, 2019, at 9:55 AM, Tom Lane wrote: > > Magnus Hagander writes: >>> On Sat, Mar 30, 2019 at 10:16 PM Tom Lane wrote: >>> Yeah; this is supposing that there is a security boundary between >>> Postgres superusers and the OS account running the server, which >>> there is not. We could

Re: logical replication - negative bitmapset member not allowed

2019-04-01 Thread Tom Lane
Tim Clarke writes: > I'm getting this message every 5 seconds on a single-master, > single-slave replication of PG10.7->PG10.7 both on Centos. Its over the > 'net but otherwise seems to perform excellently. Any ideas what's > causing it and how to fix? That'd certainly be a bug, but we'd need to

Re: CVE-2019-9193 about COPY FROM/TO PROGRAM

2019-04-01 Thread Tom Lane
Magnus Hagander writes: > On Sat, Mar 30, 2019 at 10:16 PM Tom Lane wrote: >> Yeah; this is supposing that there is a security boundary between >> Postgres superusers and the OS account running the server, which >> there is not. We could hardly have features like untrusted PLs >> if we were tryi

logical replication - negative bitmapset member not allowed

2019-04-01 Thread Tim Clarke
I'm getting this message every 5 seconds on a single-master, single-slave replication of PG10.7->PG10.7 both on Centos. Its over the 'net but otherwise seems to perform excellently. Any ideas what's causing it and how to fix? -- Tim Clarke IT Director Direct: +44 (0)1376 504510 | Mobile: +44 (0)78

Re: CVE-2019-9193 about COPY FROM/TO PROGRAM

2019-04-01 Thread Magnus Hagander
On Sat, Mar 30, 2019 at 10:16 PM Tom Lane wrote: > "Daniel Verite" writes: > > I've noticed this post being currently shared on social media: > > > > https://www.trustwave.com/en-us/resources/blogs/spiderlabs-blog/cve-2019-9193-authenticated-arbitrary-command-execution-on-postgresql-9-3/ > > > T

Re: Table Export & Import

2019-04-01 Thread Sathish Kumar
Hi Ros, Using server on Cloud. On Mon, Apr 1, 2019, 5:26 PM ROS Didier wrote: > Hi > > One solution could be to use intel technology: FPGA : > https://www.intel.fr/content/www/fr/fr/products/programmable.html > > the principle is to add an PCI electronic card on the server with CPUs and > RAM.

RE: Table Export & Import

2019-04-01 Thread ROS Didier
Hi One solution could be to use intel technology: FPGA : https://www.intel.fr/content/www/fr/fr/products/programmable.html the principle is to add an PCI electronic card on the server with CPUs and RAM. this greatly speeds up the loading of the data into the database. Best Regards [cid:image002.

Re: Required postgreSQL 10.4 version for Suse enterprise

2019-04-01 Thread Ron
Go up a level from https://zypp.postgresql.org/10/suse/sles-12-x86_64/repoview/postgresql10-server.html to https://zypp.postgresql.org/10/suse/sles-12-x86_64/repoview/letter_p.group.html then get all the packages you need. On 4/1/19 2:42 AM, Ankit Trivedi wrote: Hello, We have tried to inst