Re: problems importing from csv

2019-09-19 Thread Michael Lewis
>I am trying to import some data from spreadsheets. Included in the data >sets are US monetary values. These appear in the CSV file, like this: $1.00 >The column is defined like this: NUMERIC(5,2) NOT NULL. 1) remove all $ characters from csv before import OR 2) import into text field (perhaps in

Re: PGPASSWORD in crypted form, for example BlowFish or SHA-256

2019-09-19 Thread rob stone
On Thu, 2019-09-19 at 15:23 +0200, Matthias Apitz wrote: > El día Thursday, September 19, 2019 a las 10:31:01PM +1000, rob stone > escribió: > > > > > https://www.postgresql.org/docs/11/auth-password.html > > > > Chapters 20.5 and 20.6 may give you more information. > > The form of the passw

Re: is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Ron
On 9/19/19 4:55 PM, Tom Lane wrote: Adrian Klaver writes: So this is the part I need some clarification on. If you start vacuuming the tables that are setting the min then that should buy you some time? Yes, if there are some small tables that have relfrozenxid even further back than the big o

Re: is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Tom Lane
Adrian Klaver writes: > So this is the part I need some clarification on. If you start vacuuming > the tables that are setting the min then that should buy you some time? Yes, if there are some small tables that have relfrozenxid even further back than the big ones, vacuuming them first would be

Re: FW: Re: FW: Re: Shouldn;t this trigger be called?

2019-09-19 Thread Michael Lewis
You can also look at citext type to avoid the casting. customer_keyinteger DEFAULT nextval('customer_key_serial') PRIMARY KEY , cust_no smallint NOT NULL UNIQUE , namevarchar UNIQUE , Why do you have a surrogate primary key g

Re: is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Adrian Klaver
On 9/19/19 2:42 PM, Tom Lane wrote: Adrian Klaver writes: On 9/19/19 2:24 PM, Julie Nishimura wrote: Or you meant we need to run vacuum on 'my_db_name' without parameters, that it runs for every table? I am just not sure how long it will take to run for 39 tb...:( Not sure. The bottom line

Re: is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Tom Lane
Adrian Klaver writes: > On 9/19/19 2:24 PM, Julie Nishimura wrote: >> Or you meant we need to run vacuum on 'my_db_name' without parameters, >> that it runs for every table? I am just not sure how long it will take >> to run for 39 tb...:( > Not sure. The bottom line is you are running out of

Re: is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Adrian Klaver
On 9/19/19 2:24 PM, Julie Nishimura wrote: Adrian, We do run vacuum w/o FULL every day: SYSTABLES="' pg_catalog.' || relname || ';' from pg_class a, pg_namespace b where a.relnamespace=b.oid and b.nspname='pg_catalog' an d a.relkind='r'" But it does not look like it frees up the space... Or y

Re: is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Adrian Klaver
stgresql.org ; pgsql-general *Subject:* Re: is it safe to drop 25 tb schema with cascade option? On 9/19/19 12:06 PM, Julie Nishimura wrote: Hello, we've recently inherited large Greenplum system (master with standby and 8 segment nodes), which is running old version of GP: 20190919:15

Re: is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Julie Nishimura
cade option? > On 9/19/19 12:06 PM, Julie Nishimura wrote: >> Hello, we've recently inherited large Greenplum system (master with >> standby and 8 segment nodes), which is running old version of GP: >> >> 20190919:15:22:01:122002 gpstate:hitw-mck-gp1-mdw-1:gpadmi

Re: is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Adrian Klaver
On 9/19/19 12:06 PM, Julie Nishimura wrote: Hello, we've recently inherited large Greenplum system (master with standby and 8 segment nodes), which is running old version of GP: 20190919:15:22:01:122002 gpstate:hitw-mck-gp1-mdw-1:gpadmin-[INFO]:- Greenplum initsystem version   = 4.

is it safe to drop 25 tb schema with cascade option?

2019-09-19 Thread Julie Nishimura
Hello, we've recently inherited large Greenplum system (master with standby and 8 segment nodes), which is running old version of GP: 20190919:15:22:01:122002 gpstate:hitw-mck-gp1-mdw-1:gpadmin-[INFO]:- Greenplum initsystem version = 4.3.4.0 build 1 20190919:15:22:01:122002 gpstate:hit

Re: PostgreSQL License

2019-09-19 Thread Steve Atkins
On 19/09/2019 13:48, Steve Litt wrote: My understanding is the PostgreSQL license is more like the MIT license, which actually allows one to modify the code and claim it as proprietary. You could do that, yes. :) https://wiki.postgresql.org/wiki/PostgreSQL_derived_databases Cheers,   Steve

Re: pgbackrest - question about restoring cluster to a new cluster on same server

2019-09-19 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > I've been a DBA for 20+ years, and restored a **lot** of **copies** of > production databases.  PostgreSQL has some seriously different concepts. > With every other system, it's: restore full backup to new location, restore > differential backup,

Re: pgbackrest - question about restoring cluster to a new cluster on same server

2019-09-19 Thread Ron
On 9/19/19 9:17 AM, Stephen Frost wrote: [snip] Ah, but you are talking about a cluster promotion, though you don't realize it. Any time there is a "at some point, I was to stop replaying WAL and start accepting new changes", there's a timeline switch and notionally a promotion. The point of t

Re: PGPASSWORD in crypted form, for example BlowFish or SHA-256

2019-09-19 Thread domenico febbo
Hi, maybe you want to use [1] pgcrypto encrypt/decrypt function using "secret" word stored outside database. See F.25.4. Raw Encryption Functions [1] https://www.postgresql.org/docs/11/pgcrypto.html Regards, Il giorno gio 19 set 2019 alle ore 16:19 Adrian Klaver < adrian.kla...@aklaver.com> ha

Re: PGPASSWORD in crypted form, for example BlowFish or SHA-256

2019-09-19 Thread Adrian Klaver
On 9/19/19 3:30 AM, Matthias Apitz wrote: Hello, Our software, a huge ILS, is running on Linux with DBS Sybase. To connect to the Sybase server (over the network, even on localhost), credentials must be known: a user (say 'sisis') and its password. For Sybase we have them stored on the disk of

Re: pgbackrest - question about restoring cluster to a new cluster on same server

2019-09-19 Thread Stephen Frost
Greetings, * Ron (ronljohnso...@gmail.com) wrote: > On 9/18/19 8:58 PM, David Steele wrote: > >On 9/18/19 9:40 PM, Ron wrote: > >>I'm concerned with one pgbackrest process stepping over another one and > >>the restore (or the "pg_ctl start" recovery phase) accidentally > >>corrupting the productio

Re: n_live_tup count increase after vacuum

2019-09-19 Thread Tom Lane
Jason Ralph writes: > I recently upgraded a neglected DB in our fleet that contains a huge table > (1.4B) rows. I ran a vacuum against the huge table, as expected it took a > long time, but it did finish. > I think I understand most of what the output is saying... one confusing > thing > T

Re: PGPASSWORD in crypted form, for example BlowFish or SHA-256

2019-09-19 Thread Tom Lane
Matthias Apitz writes: > Is there somehow an API in PG to use ciphered passwords and provide as a > shared library the blob to decrypt it? No. Consider a non-password auth mechanism, for instance SSL certificates. You might find that an SSL certificate file stored where libpq will find it is al

Re: PGPASSWORD in crypted form, for example BlowFish or SHA-256

2019-09-19 Thread Matthias Apitz
El día Thursday, September 19, 2019 a las 10:31:01PM +1000, rob stone escribió: > Hello, > > On Thu, 2019-09-19 at 12:30 +0200, Matthias Apitz wrote: > > Hello, > > > > Our software, a huge ILS, is running on Linux with DBS Sybase. To > > connect to the Sybase server (over the network, even on l

Re: How to safely remove a corrupted cluster?

2019-09-19 Thread Marco Ippolito
Solved by repeating the execution of (base) postgres@pc:~$ pg_dropcluster --stop 11 fabmnet : (base) postgres@pc:~$ pg_dropcluster --stop 11 fabmnet Error: specified cluster does not exist Marco Il giorno gio 19 set 2019 alle ore 13:02 Marco Ippolito < ippolito.ma...@gmail.com> ha scritto: > If

Re: PostgreSQL License

2019-09-19 Thread Steve Litt
On Wed, 18 Sep 2019 17:20:14 -0500 Ron wrote: > Charging for *installing* PostgreSQL is not the same as charging for > PostgreSQL. > > Bottom line: you charge for *services**you provide* not for software > that other people provide. That makes a lot of sense. A head gasket costs about $25.00. *

Re: PGPASSWORD in crypted form, for example BlowFish or SHA-256

2019-09-19 Thread rob stone
Hello, On Thu, 2019-09-19 at 12:30 +0200, Matthias Apitz wrote: > Hello, > > Our software, a huge ILS, is running on Linux with DBS Sybase. To > connect to the Sybase server (over the network, even on localhost), > credentials must be known: a user (say 'sisis') and its password. > > For Sybase

n_live_tup count increase after vacuum

2019-09-19 Thread Jason Ralph
Hello Lists, DB1=# select version(); -[ RECORD 1 ] version | PostgreSQL 11.5 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-23), 64-bit I recently upgraded a neglected

How to safely remove a corrupted cluster?

2019-09-19 Thread Marco Ippolito
If the saying "to learn you have to make mistakes", I'm "learning"...: I removed a cluster's folder without using pg_dropcluster... sio now I have a corrupted cluster. How can I safely remove it? (base) marco@pc:~$ pg_lsclusters Ver Cluster Port Status Owner Data directory Log

PGPASSWORD in crypted form, for example BlowFish or SHA-256

2019-09-19 Thread Matthias Apitz
Hello, Our software, a huge ILS, is running on Linux with DBS Sybase. To connect to the Sybase server (over the network, even on localhost), credentials must be known: a user (say 'sisis') and its password. For Sybase we have them stored on the disk of the system in a file syb.npw as: $ cat /o