Re: Changing default fillfactor for the whole database

2025-04-27 Thread Ron Johnson
On Sat, Apr 26, 2025 at 10:31 PM Marcelo Fernandes wrote: > Hi there, > > I have a scenario where virtually all user tables in the database will > need to > have a lower fill factor. > > It would have been handy to have a way to set this default, but as of now, > I > don't think the default can b

Re: Order of update

2025-04-20 Thread Ron Johnson
On Sun, Apr 20, 2025 at 5:35 AM Thiemo Kellner wrote: > Very interesting. But is the sort overhead worth it? Why not make the > constraint deferrable before the update and switch back afterwards? > The role which runs the UPDATE might not have the priv to ALTER TABLE ... ALTER CONSTRAINT. -- D

Re: verify checksums online

2025-04-18 Thread Ron Johnson
On Fri, Apr 18, 2025 at 5:18 PM Jeremy Schneider wrote: > i should know the answer to this... but asking anyway > > i think there had been some mailing list discussions years ago? the > pg_checksum utility in core still can't do an online check right? > https://www.postgresql.org/docs/17/app-pgc

Re: Cannot turn track_counts on

2025-04-17 Thread Ron Johnson
On Thu, Apr 17, 2025 at 5:13 AM Anton Shepelev wrote: > Daniel Gustafsson: > > > Also, is this by any chance a managed instance like Amazon > > RDS or Azure, or is it a local database under your > > control? > > It is a normal installation on a Linux machine, and my > company has full root access

Re: Best Tool for PostgreSQL Auditing and Storing Audit Logs Separately

2025-04-16 Thread Ron Johnson
On Wed, Apr 16, 2025 at 3:42 PM Nico Williams wrote: > On Wed, Apr 16, 2025 at 02:43:59PM -0400, Ron Johnson wrote: > > You'll have to bring that up with the PgAudit maintainer. Note, though, > > that the purpose of PgAudit is not "recreate the database from audi

Re: Best Tool for PostgreSQL Auditing and Storing Audit Logs Separately

2025-04-16 Thread Ron Johnson
On Wed, Apr 16, 2025 at 3:15 PM Achilleas Mantzios < a.mantz...@cloud.gatewaynet.com> wrote: > On 16/4/25 21:43, Ron Johnson wrote: > > > You'll have to bring that up with the PgAudit maintainer. Note, though, > that the purpose of PgAudit is not "recreate the da

Re: Best Tool for PostgreSQL Auditing and Storing Audit Logs Separately

2025-04-16 Thread Ron Johnson
n Wed, Apr 16, 2025 at 1:35 PM Achilleas Mantzios < a.mantz...@cloud.gatewaynet.com> wrote: > On 16/4/25 15:36, Ron Johnson wrote: > > > pgaudit is statement-level, not transaction-level; that's its nature. > This is the same as log_statement. > > ok, but log_statement p

Re: Best Tool for PostgreSQL Auditing and Storing Audit Logs Separately

2025-04-16 Thread Ron Johnson
pgaudit is statement-level, not transaction-level; that's its nature. This is the same as log_statement. On Wed, Apr 16, 2025 at 5:10 AM Achilleas Mantzios - cloud < a.mantz...@cloud.gatewaynet.com> wrote: > On 4/15/25 12:14, KENAN ÇİFTÇİ wrote: > > Hi, > > You can use pgaudit and pgauditlogtofi

Re: Fwd: Identify system databases

2025-04-15 Thread Ron Johnson
On Tue, Apr 15, 2025 at 3:11 PM Tom Lane wrote: > "David G. Johnston" writes: > > On Tue, Apr 15, 2025 at 11:20 AM Adrian Klaver < > adrian.kla...@aklaver.com> > > wrote: > >> If what you say is true why does initdb lack an option to not create > >> them on creating a cluster? > > > By creating

Re: To take backup of Postgresql Database without large objects

2025-04-11 Thread Ron Johnson
On Fri, Apr 11, 2025 at 8:56 AM sivapostg...@yahoo.com < sivapostg...@yahoo.com> wrote: > Hello, > > Using PostgreSQL 15.1, compiled by Visual C++ build 1914, 64-bit in > Windows 10. > That's 11 patch releases behind current. > Trying to take backup of a database, using pg_dump, where one table

Re: Archive logging not cleaning up pg_wal directory

2025-04-10 Thread Ron Johnson
On Thu, Apr 10, 2025 at 8:29 AM Justin Swanhart wrote: > Hi, > > I have the following in my postgresql.conf for archive logging: > archive_command='test ! -f /var/lib/postgresql/prod_archive_logs/%f && cp > %p /var/lib/postgresql/prod_archive_logs/%f' > > This command is properly copying the log

Re: PgBackRest fails due to filesystem full

2025-04-09 Thread Ron Johnson
Try creating a new stanza, and doing a full backup from it. On Wed, Apr 9, 2025 at 1:49 AM KK CHN wrote: > > > On Tue, Apr 8, 2025 at 10:28 PM Greg Sabino Mullane > wrote: > >> On Mon, Apr 7, 2025 at 5:32 AM KK CHN wrote: >> >>> *ERROR: [082]: WAL segment 000101EB00*4B was not arch

Re: Wal file query

2025-04-08 Thread Ron Johnson
You cannot connect to the Primary while connected to the Replica, except via postgres_fdw. Even then, it might not work, since the replica replicates _fdw definitions. These exist on the primary: pg_current_wal_lsn() pg_replication_slots pg_stat_replication These exist on the replica: pg_last_

Re: Any industry best practise to overcome this specific malware "pg_mem"

2025-04-05 Thread Ron Johnson
On Wed, Apr 2, 2025 at 11:31 AM Adrian Klaver wrote: > On 4/2/25 08:18, Bharani SV-forum wrote: > > Hello MVP's > > Good Morning > > Any industry best practise to overcome this specific malware "pg_mem". > > > > url = > > > https://www.aquasec.com/blog/pg_mem-a-malware-hidden-in-the-postgres-proc

Re: Bloated toast table with empty associated table

2025-04-05 Thread Ron Johnson
On Thu, Mar 20, 2025 at 7:40 AM Paul Allen wrote: > Hello. > > Preconditions. > > I have some empty table and constantly try to execute `insert ... on > conflict do update ...` on it. My data in row which I try to insert is > invalid by violation of foreing key constraint, so I am getting error >

Re: Performance issues during pg_restore -j with big partitioned table

2025-04-04 Thread Ron Johnson
On Wed, Apr 2, 2025 at 1:32 PM Dimitrios Apostolou wrote: > Hello list. > > My database includes one table with 1000 partitions, all of them rather > sizeable. I run: > >pg_restore -j12 --no-tablespaces --disable-triggers --exit-on-error > --no-owner --no-privileges -n public -d newdb custom_

Re: Issue installing postgis on RHEL9

2025-04-02 Thread Ron Johnson
On Wed, Apr 2, 2025 at 12:29 PM Danny Im wrote: > Hello, > > I am having issues trying to install the postgis30_13 package on a RHEL9 > host. Attempting to install the package gives me this error: > > $ sudo dnf install postgis30_13 > Updating Subscription Management repositories. > Zabbix 6.0 LT

Re: BTREE index: field ordering

2025-03-28 Thread Ron Johnson
On Fri, Mar 28, 2025 at 9:35 AM Laurenz Albe wrote: > On Fri, 2025-03-28 at 13:38 +0100, Moreno Andreo wrote: > > Postgres 16.4 (planning to go on 17.4) > > I'm creating some indexes based on some slow query reported by logs. > > These queries involve a WHERE with more than 5 fields, that are

Re: size of attributes table is too big

2025-03-25 Thread Ron Johnson
a table with size over 500GB. It is going to take a couple of hours I > presume. > > Also, I hope aggressive vacuuming will prevent us from this situation. > > Regards > Siraj > > > > > On Wed, Mar 19, 2025 at 11:27 PM Ron Johnson > wrote: > >> On Wed, M

Re: Experience and feedback on pg_restore --data-only

2025-03-24 Thread Ron Johnson
Why are you regularly having emergencies requiring the restoration of multi-TB tables to databases with lots of cruft? Fixing that would go a long way towards eliminating your problems with pg_restore. On Mon, Mar 24, 2025 at 11:51 AM Dimitrios Apostolou wrote: > On Mon, 24 Mar 2025, Adrian Kla

Re: Experience and feedback on pg_restore --data-only

2025-03-21 Thread Ron Johnson
On Fri, Mar 21, 2025 at 2:36 PM Dimitrios Apostolou wrote: > On Thu, 20 Mar 2025, Dimitrios Apostolou wrote: > > > Rationale: > > > > When restoring a backup in an emergency situation, it's fine to run > > pg_restore as superuser and get an exact replica of the dumped db. > How often do you have

Re: Export operation efficiency in read replica

2025-03-20 Thread Ron Johnson
On Thu, Mar 20, 2025 at 7:52 AM Siraj G wrote: > Hello Experts! > > I have a DB with 1TB in size serving needs of one of our critical > applications. I have a requirement to take export of the DB on a daily > basis, but want to carry out this operation in read replica. The postgresql > version is

Re: Bloated toast table with empty associated table

2025-03-20 Thread Ron Johnson
records. And... it did just that. But what *must* PG do when it discovers a constraint violation 99% of the way through inserting those 100 records? That's right: remove the records. Thus, you get bloat. > On Thu, Mar 20, 2025 at 4:28 PM Ron Johnson > wrote: > > > > On Th

Re: Bloated toast table with empty associated table

2025-03-20 Thread Ron Johnson
ot;vacuumdb -d the_db -t > controlzone_passage". How often you run it depends on how quickly it > bloats. > > Seems like it is the only solution for now. > The autovacuum daemon can't know/see everything. > On Thu, Mar 20, 2025 at 4:03 PM Ron Johnson > wrote: &

Re: size of attributes table is too big

2025-03-19 Thread Ron Johnson
On Wed, Mar 19, 2025 at 1:06 PM Siraj G wrote: > Hello! > > I have a PG (v16) instance which is occupying around 1TB of storage. Out > of this, around 350GB is occupied by the table pg_catalog.pg_attribute. > Why is the catalog table's size so big? > > Here are the sizes: > > pg_attribute > 338 G

Re: Cannot pg_dump_all anymore...

2025-03-18 Thread Ron Johnson
On Tue, Mar 18, 2025 at 5:14 AM E-BLOKOS wrote: > I got this error: > > pg_dump: error: query returned 0 rows instead of one: EXECUTE > dumpBaseType('794978') > > any clue to solve it? > PG version? Whole command line, including all error messages? -- Death to , and butter sauce. Don't boil m

Re: Creating a new database on a different file system

2025-03-17 Thread Ron Johnson
On Mon, Mar 17, 2025 at 4:30 PM Laurenz Albe wrote: > On Mon, 2025-03-17 at 14:33 -0400, Ron Johnson wrote: > > On Mon, Mar 17, 2025 at 11:18 AM Laurenz Albe > wrote: > > > On Mon, 2025-03-17 at 15:51 +0100, Luca Ferrari wrote: > > > > On Mon, Mar 17, 2025 at

Re: Creating a new database on a different file system

2025-03-17 Thread Ron Johnson
On Mon, Mar 17, 2025 at 11:18 AM Laurenz Albe wrote: > On Mon, 2025-03-17 at 15:51 +0100, Luca Ferrari wrote: > > On Mon, Mar 17, 2025 at 3:49 PM Ian Dauncey > wrote: > > > We have created a few databases on the file system defined in the > postgresql.conf, > > > but now I would like to create a

Re: #1 - Known bug (memory related) with respect to Aurora postgresql 13.16.3

2025-03-17 Thread Ron Johnson
Aurora is very nonstandard. Thus, "we" don't support it. Having said that... "report running out of memory" smells like work_mem is set too high. On Mon, Mar 17, 2025 at 3:12 PM Bharani SV-forum wrote: > Team > Any one faced similar issue with Ver 13.16.X > > > > - Forwarded Message -

Re: Query optimization

2025-03-13 Thread Ron Johnson
On Thu, Mar 13, 2025 at 11:48 PM Durgamahesh Manne < maheshpostgr...@gmail.com> wrote: > On Fri, 14 Mar, 2025, 09:11 Ron Johnson, wrote: > >> On Thu, Mar 13, 2025 at 11:25 PM Durgamahesh Manne < >> maheshpostgr...@gmail.com> wrote: >> >>> On Fri, M

Re: Query optimization

2025-03-13 Thread Ron Johnson
On Thu, Mar 13, 2025 at 11:25 PM Durgamahesh Manne < maheshpostgr...@gmail.com> wrote: > On Fri, Mar 14, 2025 at 8:19 AM Ron Johnson > wrote: > >> On Thu, Mar 13, 2025 at 10:16 PM Durgamahesh Manne < >> maheshpostgr...@gmail.com> wrote: >> [snip] >

Re: Query optimization

2025-03-13 Thread Ron Johnson
On Thu, Mar 13, 2025 at 10:16 PM Durgamahesh Manne < maheshpostgr...@gmail.com> wrote: [snip] > Hi Adrian Klaver > > 1) Postgres version. > select version(); > version > > -

Re: Moving from Linux to Linux?

2025-03-12 Thread Ron Johnson
On Wed, Mar 12, 2025 at 4:16 PM Paul Foerster wrote: > Hi Ron, > > > On 12 Mar 2025, at 17:59, Ron Johnson wrote: > > > > Developers making DDL changes on production databases? > > Of course not. But I can't block developer databases. That'd make a few

Re: Moving from Linux to Linux?

2025-03-12 Thread Ron Johnson
On Wed, Mar 12, 2025 at 12:48 PM Paul Foerster wrote: > Hi Christophe, > > > On 12 Mar 2025, at 12:16, Christophe Pettus wrote: > > > > You *can* apply DDL while logical replication is going on, as long as > you do so in a disciplined way. This generally means applying it to the > subscriber be

Re: hide data from admins

2025-03-11 Thread Ron Johnson
On Tue, Mar 11, 2025 at 9:48 PM Siraj G wrote: > Hello Experts! > > What are the features available in Postgresql to hide PII (personal > identifiable information) from the Admin team? Like in Oracle we have data > vault and data redaction, I am looking for similar features in > PostgreSQL.We do

Re: Moving from Linux to Linux?

2025-03-11 Thread Ron Johnson
On Tue, Mar 11, 2025 at 2:35 PM Paul Foerster wrote: > Hi Devrim, Thomas, Adrian, Ron, Joe, > > answering to myself as answering to five postings in one go is impossible. > 🤣 > > > Are there any obstacles that definitely make that a no-go? Do I risk > corruption?

Re: Moving from Linux to Linux?

2025-03-11 Thread Ron Johnson
On Tue, Mar 11, 2025 at 12:23 PM Paul Foerster wrote: > Hi, > > we are considering changing the PostgreSQL platform from SUSE SLE to Red > Hat. To keep service interruptions as short as possible, the idea is to set > up a streaming replication from the SUSE server to be replaced to a > temporary

Re: Duplicate Key Values

2025-03-11 Thread Ron Johnson
Do you *currently* take regular backups? We'd be glad to show you how to take regular logical backups. On Tue, Mar 11, 2025 at 10:29 AM mark bradley wrote: > An "interesting" effect of reindexing is that all the records that were > dups in the nodes table were deleted, both copies. > > Also, al

Re: psql and regex not like

2025-03-09 Thread Ron Johnson
On Thu, Mar 6, 2025 at 6:11 AM hubert depesz lubaczewski wrote: > On Thu, Mar 06, 2025 at 04:37:56AM -0500, Ron Johnson wrote: > > This statement runs great from the psql prompt. Does exactly what I > want. > > select datname from pg_database WHERE datname !~ 'template|p

Re: [EXTERNAL] Re: Asking for OK for a nasty trick to resolve PG CVE-2025-1094 i

2025-03-08 Thread Ron Johnson
Since it's a 24x7 app, you have database replication, virtual IPs and a fail-over manager in case a server crashes? Anyway, read through the PG 15 release notes. If none really affect you, then stay on 15.3. You're certain to miss *something*, though, or not understand the ramifications. And be

Re: Asking for OK for a nasty trick to resolve PG CVE-2025-1094 i

2025-03-08 Thread Ron Johnson
On Thu, Mar 6, 2025 at 3:12 AM Laurenz Albe wrote: > [redirecting to pgsql-general] > > On Thu, 2025-03-06 at 07:39 +, Abraham, Danny wrote: > > I have many customers using PG 15.3 happily, and I cannot just snap > upgrade them all to 15.12. > > Why do you think you cannot do that? > In the l

psql and regex not like

2025-03-07 Thread Ron Johnson
This statement runs great from the psql prompt. Does exactly what I want. select datname from pg_database WHERE datname !~ 'template|postgres' ORDER BY datname; But it doesn't work so well from the bash prompt. Not escaping the "!" generates a bunch of garbage, while escaping throws an sql synta

Re: No. Of wal files generated

2025-03-07 Thread Ron Johnson
overwritten, purges old ones when not needed etc. Even compresses and encrypts them if you want. > > > Regards. > > > > On Sat, 8 Mar 2025, 01:37 Ron Johnson, wrote: > >> inotifywait can log every file creation and deletion in a directory. >> >> Hones

Re: No. Of wal files generated

2025-03-07 Thread Ron Johnson
cess and > archival process. > > So I want to check how many wal file got created in x minutes and how many > .ready files got created in those x minutes. > > > > Regards, > Atul > > On Fri, 7 Mar 2025, 22:45 Ron Johnson, wrote: > >> On Fri, Mar 7, 2025 at 10:

Re: No. Of wal files generated

2025-03-07 Thread Ron Johnson
On Fri, Mar 7, 2025 at 10:59 AM Atul Kumar wrote: > Hi, > > Please could you help me by sharing any redhat linux command through which > I can count the no. of wal files and no. of ".ready" files generated in > last 10 minutes. > What problem are you trying to solve? -- Death to , and butter s

Re: Quesion about querying distributed databases

2025-03-06 Thread Ron Johnson
On Thu, Mar 6, 2025 at 10:47 AM Igor Korot wrote: > Hi, > > On Thu, Mar 6, 2025, 7:32 AM Greg Sabino Mullane > wrote: > >> On Wed, Mar 5, 2025 at 9:44 PM me nefcanto wrote: >> >>> Anyway, that's why I asked you guys. However, encouraging me to go back >>> to monolith without giving solutions on

Re: psql and regex not like

2025-03-06 Thread Ron Johnson
On Thu, Mar 6, 2025 at 4:59 AM Dominique Devienne wrote: > On Thu, Mar 6, 2025 at 10:38 AM Ron Johnson > wrote: > > This statement runs great from the psql prompt. Does exactly what I > want. > > select datname from pg_database WHERE datname !~ 'template|po

Re: Quesion about querying distributed databases

2025-03-05 Thread Ron Johnson
On Wed, Mar 5, 2025 at 9:44 PM me nefcanto wrote: > I once worked with a monolithic SQL Server database with more than 10 > billion records and about 8 Terabytes of data. A single backup took us more > than 21 days. It was a nightmare. > 25 years ago (meaning *much* slower hardware), I managed a

Re: Duplicate Key Values

2025-03-05 Thread Ron Johnson
records by specifying another column with a different value; On Wed, Mar 5, 2025 at 6:14 PM mark bradley wrote: > Hi Ron, > > The key is an integer. I'm using pGAdmin4 and recently updated to the > latest version. > > The records are not all identical, some have NULL values

Re: Duplicate Key Values

2025-03-05 Thread Ron Johnson
On Wed, Mar 5, 2025 at 12:36 PM mark bradley wrote: > Although I did not enter them, somehow duplicate primary key values have > appeared in one of my tables. > Is it a text/varchar column? Has the distro been upgraded "recently", or maybe streamed from an older Linux system to a newer Linux sy

Re: end of COPY

2025-03-05 Thread Ron Johnson
On Wed, Mar 5, 2025 at 10:53 AM Greg Sabino Mullane wrote: > On Wed, Mar 5, 2025 at 10:22 AM Marc Millas > wrote: > >> Then the flow contains a single line: \. to my understanding this means >> end of the copy >> >> but, Postgres generates an error : invalid input syntax for type numeric >> "\."

Re: end of COPY

2025-03-05 Thread Ron Johnson
On Wed, Mar 5, 2025 at 10:22 AM Marc Millas wrote: > Hi, > on a Postgres 16 DB running on a redhat 8.5 x86 machineI want to input > some data using copy from stdin > so.. more that 700 000 lines goes well. > Then the flow contains a single line: \. > to my understanding this means end of the copy

Re: Review my steps for rollback to restore point

2025-03-04 Thread Ron Johnson
Chandran, 1. For PITR, you should use a tool like PgBackRest. It handles all $PGDATA and WAL archiving. It's multithreaded, too, 2. pg_restore is just for logical backups. 3. Streaming Replication is for *hot standby*, not backups. On Tue, Mar 4, 2025 at 10:00 AM chandan Kumar wr

Re: create_immv issue on aws Ubuntu even after create extention

2025-03-02 Thread Ron Johnson
nt is this works perfectly on all local machines with > exact same versions and same data. > > Regards. > On 2/28/25 22:24, Ron Johnson wrote: > > On Fri, Feb 28, 2025 at 11:41 AM Krishnakant Mane > wrote: > >> Hello all. >> >> I am not able to use create_im

Re: create_immv issue on aws Ubuntu even after create extention

2025-02-28 Thread Ron Johnson
When you know that the SELECT statement runs on the local machines, then on each server, run these SQL statements: SHOW search_path; SELECT * FROM pg_extension; On Fri, Feb 28, 2025 at 12:26 PM Krishnakant Mane wrote: > > On 2/28/25 22:53, Ron Johnson wrote: > > > Differ

Re: create_immv issue on aws Ubuntu even after create extention

2025-02-28 Thread Ron Johnson
On Fri, Feb 28, 2025 at 11:41 AM Krishnakant Mane wrote: > Hello all. > > I am not able to use create_immv in postgresql 16.6 even after installing > it and doing create extention. > > I did a git clone of the repository and then make sudo make install to > install it. > > The issue is not happen

Re: Long Running query and trace potential issues

2025-02-28 Thread Ron Johnson
On Fri, Feb 28, 2025 at 6:50 AM KK CHN wrote: > List > > postgres=# SELECT PID, now() - pg_stat_activity.query_start AS duration, > query, state FROM pg_stat_activity WHERE (now() - pg > _stat_activity.query_start) > interval '5 minutes' AND state = 'active'; > pid |duration |

Re: Corruption of few tables

2025-02-26 Thread Ron Johnson
On Wed, Feb 26, 2025 at 9:06 AM Greg Sabino Mullane wrote: > On Wed, Feb 26, 2025 at 2:21 AM sivapostg...@yahoo.com < > sivapostg...@yahoo.com> wrote: > >> issue in PostgreSQL 15.7 >> > > Still missing a ton of bug fixes - Postgres 15 is on version 15.12. Try to > get that upgraded. > And it tak

Re: Deleting idle connections

2025-02-24 Thread Ron Johnson
On Mon, Feb 24, 2025 at 5:50 PM Yongye Serkfem wrote: > Hi Everyone! > I am having a series of idle connections and unable to delete them with a > single command. Any help in realizing this would be greatly appreciated. > This will kill idle connections older than two hours: select pid, pg_termi

Re: COLLATION update in 13.1

2025-02-24 Thread Ron Johnson
On Mon, Feb 24, 2025 at 6:53 AM Matthias Apitz wrote: [snip] > pgsql -Usisis sisis > > sisis=# REINDEX (VERBOSE) DATABASE sisis; > sisis=# ALTER COLLATION "de_DE.utf8" REFRESH VERSION; > ALTER COLLATION > > Correct? > > Just reindex those with text columns. create or replace view dba.all_indices

Re: v18 virtual columns

2025-02-20 Thread Ron Johnson
On Thu, Feb 20, 2025 at 8:07 AM Dominique Devienne wrote: > Hi. I've just read > https://www.dbi-services.com/blog/postgresql-18-virtual-generated-columns/ > > and I'm wondering whether there will be a way to ALTER existing STORED > generated columns, to be virtual? W/o rewriting the whole table

Re: Loading the latest N rows into the cache seems way too fast.

2025-02-17 Thread Ron Johnson
On Mon, Feb 17, 2025 at 4:51 PM Tom Lane wrote: > Ron Johnson writes: > > On Mon, Feb 17, 2025 at 4:36 PM Tom Lane wrote: > >> It's not pulling in the TOAST storage where the bytea column lives. > >> (pg_prewarm wouldn't have either, without special

Re: Loading the latest N rows into the cache seems way too fast.

2025-02-17 Thread Ron Johnson
On Mon, Feb 17, 2025 at 4:36 PM Tom Lane wrote: > Ron Johnson writes: > > The bigint "id" column in "mytbl" is populated from a sequence, and so is > > monotonically increasing: the newest records will have the biggest id > > values. > > The ta

Loading the latest N rows into the cache seems way too fast.

2025-02-17 Thread Ron Johnson
PG 9.6.24 and PG 14.15, if it matters. (Yes, 9.6 is really EOL. I don't control that.) (I could use pg_prewarm, but the table is much bigger than RAM, and last_block value only has the newest record if data has never been deleted. The oldest records regularly get deleted, and then the table is v

Re: The performance issues caused by upgrading PostgreSQL to version 16.3.

2025-02-17 Thread Ron Johnson
On Mon, Feb 17, 2025 at 2:55 AM 馬 騰飛 wrote: > Dear PostgreSQL Community, > > I hope this message finds you well. I am reaching out to seek your > technical assistance regarding a performance issue we encountered after > upgrading our PostgreSQL version from 12.19 to 16.3. > We have noticed a sign

Re: Help in vetting outcome of "vacuumdb --analyze-in-stages" - during DB Upgrade from EC2- PGS - Community Edn ver 13.X to 14.X

2025-02-16 Thread Ron Johnson
On Sun, Feb 16, 2025 at 8:13 AM Y_Bharani_mbsv wrote: > Team > Good Morning. > As part of DB upgrade from EC2 - PGS - community Edn Ver 13.X to 14.X > I followed steps of "pg_upgrade" and had executed the last step (post > successful db migration) > > vacuumdb --analyze-in-stages > > and later no

Re: Bash profile

2025-02-15 Thread Ron Johnson
at 2:17 PM Yongye Serkfem wrote: > I am upgrading from version 12.7 to 15.7 > > On Sat, Feb 15, 2025, 2:15 PM Ron Johnson wrote: > >> On Sat, Feb 15, 2025 at 2:01 PM Yongye Serkfem >> wrote: >> >>> Hi Everyone! >>> I would appreciate any assista

Re: Bash profile

2025-02-15 Thread Ron Johnson
On Sat, Feb 15, 2025 at 2:01 PM Yongye Serkfem wrote: > Hi Everyone! > I would appreciate any assistance with configuring the bash profile to run > two different postgresql versions. Specifically V12.7 and 15.7 > Create a bash function that exports PGDATA to the relevant directory, based on the

Re: psql command line editing

2025-02-13 Thread Ron Johnson
On Wed, Feb 12, 2025 at 3:29 PM Adrian Klaver wrote: > On 2/12/25 12:03, Ron Johnson wrote: > > On Wed, Feb 12, 2025 at 2:29 PM Tom Lane > <mailto:t...@sss.pgh.pa.us>> wrote: > > > There's got to be something in your shell config which says "use

Re: psql command line editing

2025-02-12 Thread Ron Johnson
On Wed, Feb 12, 2025 at 2:29 PM Tom Lane wrote: > Ron Johnson writes: > > On Wed, Feb 12, 2025 at 1:50 PM Rich Shepard > > wrote: > >> My web searches suggest that using the psql command line I'm limited to > >> moving the cursor one character at

Re: psql command line editing

2025-02-12 Thread Ron Johnson
On Wed, Feb 12, 2025 at 1:50 PM Rich Shepard wrote: > My web searches suggest that using the psql command line I'm limited to > moving the cursor one character at a time. Is there a way to use a small > editor, e.g., joe on linux, to move by words or to the begining and end of > the line? The P

Re: Table copy

2025-02-05 Thread Ron Johnson
Could there have been a network hiccup? Or some sort of timeout? If I needed to transfer 360GB of data, I'd probably do something old school like: 1. write a PowerShell script to export a set of rows into a csv file, 7zip compress it, then rsync or scp it to the target. 2. Write a bash script to

Re: old OS

2025-02-04 Thread Ron Johnson
https://ora2pg.darold.net/ It can access remote Oracle databases, and migrate LOB columns to bytea. Worked quite well for me on a database 3x that size. On Tue, Feb 4, 2025 at 3:28 PM Marc Millas wrote: > Hi Tom, > > the data in the redhat 6.5 machine is NOT in Postgres, its in an old > Oracle

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 12:05 PM Rob Sargent wrote: > > > > On 2/4/25 10:03, Ron Johnson wrote: > > On Tue, Feb 4, 2025 at 11:31 AM Michał Kłeczek wrote: > [snip] > >> >> The query to register a visit is: >> insert into restaurant_visit >> se

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 11:31 AM Michał Kłeczek wrote: [snip] > > The query to register a visit is: > insert into restaurant_visit > select $user, current_date, restaurant_id, $rating > from restaurant where name = $restaurant_name > > > It is now completely unclear what it means to change the nam

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 9:28 AM Rich Shepard wrote: > Should lookup tables have a numeric FK column as well as the description > column? > Does your lookup table just have one column? (That's what your question seems to imply, but that makes no sense, since the whole point of a lookup table is t

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 10:08 AM Rich Shepard wrote: > On Tue, 4 Feb 2025, David G. Johnston wrote: > > > The point of a lookup table is to provide a unique list of authoritative > > values for some purpose. Kinda like an enum. But having the label serve > as > > the unique value is reasonable - w

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 10:05 AM Rich Shepard wrote: > On Tue, 4 Feb 2025, Ron Johnson wrote: > > > Does your lookup table just have one column? (That's what your question > > seems to imply, but that makes no sense, since the whole point of a > lookup > > table

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 9:41 AM David G. Johnston wrote: > On Tuesday, February 4, 2025, Rich Shepard > wrote: > >> Should lookup tables have a numeric FK column as well as the description >> column? >> >> If so, how should I add an FK to the two lookup tables in my database? >> > > Most do (have

Re: Lookup tables

2025-02-04 Thread Ron Johnson
On Tue, Feb 4, 2025 at 9:59 AM David G. Johnston wrote: > On Tuesday, February 4, 2025, Ron Johnson wrote: > >> On Tue, Feb 4, 2025 at 9:41 AM David G. Johnston < >> david.g.johns...@gmail.com> wrote: >> >>> On Tuesday, February 4, 2025, Rich Shepard &

Re: Using psql's \prompt command

2025-01-30 Thread Ron Johnson
On Thu, Jan 30, 2025 at 5:28 PM Rich Shepard wrote: > On Thu, 30 Jan 2025, David G. Johnston wrote: > > > Prompt isn’t your issue. Prompt stores the value into a variable. Read > how > > to reference variables in a psql script. > > David, > > Thank you. I'll look into using the \set command. > I

Re: Help in vetting measuring egress/ingress w.r.to " pg_dumpall " - old vm to new vm

2025-01-28 Thread Ron Johnson
On Tue, Jan 28, 2025 at 3:13 PM Bharani SV-forum wrote: > TQ Adrian > another Question on the measuring egress (out bound traffic) /ingress > (inbound traffic) w.r.to " pg_dumpall " during usage of > > pg_dumpall -h-p 5432 | psql -p 5462 > > taking data from old_vm and copying to new_vm, as i

Re: Automatic deletion of orphaned rows

2025-01-22 Thread Ron Johnson
On Wed, Jan 22, 2025 at 9:37 AM David G. Johnston < david.g.johns...@gmail.com> wrote: > On Wednesday, January 22, 2025, Ron Johnson > wrote: >> >> >>> I therefore propose a feature, to be able to specify in a table schema >>> that a row should be d

Re: Automatic deletion of orphaned rows

2025-01-22 Thread Ron Johnson
On Wed, Jan 22, 2025 at 2:00 AM Runxi Yu wrote: > Hi, > > While writing a new program, I encountered the following: > > I have three tables: A, B, and X. Rows in X are referenced by A and/or B > via foreign keys, one or more times. I would like to delete all orphaned > rows in X, i.e. a row in X

Re: glibc 2.35-2.39 upgrade requirements

2025-01-17 Thread Ron Johnson
On Fri, Jan 17, 2025 at 1:12 AM Kamen Kalchev wrote: > Hi everyone, we're planning to upgrade the OS running Postgres from ubuntu > jammy to ubuntu noble. As part of the OS change, the glibc version will be > changed from glibc 2.35 to glibc 2.39.. > > Can someone confirm if changing the glibc be

Re: Postgresql database terminates abruptly with too many open files error

2025-01-14 Thread Ron Johnson
On Tue, Jan 14, 2025 at 7:58 AM Sri Mrudula Attili wrote: > Hello Team, > > We have a postgresql VDB(virtual database- Delphix) that keeps > terminating due "to too many open files". > > Below are few alerts that we could see from the postgresql.log > > > < 2025-01-14 11:37:20.724 GMT >LOG: ou

Re: Automatic upgrade of passwords from md5 to scram-sha256

2025-01-13 Thread Ron Johnson
On Mon, Jan 13, 2025 at 3:41 PM Peter J. Holzer wrote: > On 2025-01-13 12:19:06 -0500, Ron Johnson wrote: > > On Sun, Jan 12, 2025 at 5:59 PM Tom Lane wrote: > > [snip] > > > > I think this idea is a nonstarter, TLS or not. We're generally > movin

Re: Automatic upgrade of passwords from md5 to scram-sha256

2025-01-13 Thread Ron Johnson
On Sun, Jan 12, 2025 at 5:59 PM Tom Lane wrote: [snip] > I think this idea is a nonstarter, TLS or not. We're generally moving > in the direction of never letting the server see cleartext passwords. > It's already possible to configure libpq to refuse such requests > (see require_auth parameter

Re: Display Bytea field

2025-01-11 Thread Ron Johnson
I bet Image*Source* doesn't contain what you think it does. I'd query that table using SSMS, to see what's really in that column. On Sat, Jan 11, 2025 at 6:49 PM Andy Hartman wrote: > I still have csv files and loaded right into PG no decoding and look like > this little snippet and I did the C

Re: Display Bytea field

2025-01-11 Thread Ron Johnson
1. Do you still have the CSV file (or can you regenerate it from the still-existing MSSQL DB)? 2. Did you load the base64 string into PG, or did you decode before loading into PG? 3. A base64 string would be about 62KB. Either you did something wrong when loading, or the programmer is doing someth

Re: Display Bytea field

2025-01-10 Thread Ron Johnson
On Fri, Jan 10, 2025 at 7:49 AM Daniel Verite wrote: [snip] > Alternatively, you could compare image checksums before and > after moving them into postgres. The advantage is that you > don't need to export or view any file, and you compare globally > all your images. If the checksums are identica

Re: Display Bytea field

2025-01-09 Thread Ron Johnson
Sure. There's at least one Postgresql driver for PS, and Google says there are 3rd party libraries to display images. It's just a Simple Matter Of Programming! On Thu, Jan 9, 2025 at 3:31 PM Andy Hartman wrote: > could it be done using Powershell? > > On Thu, Jan 9,

Re: Display Bytea field

2025-01-09 Thread Ron Johnson
On Thu, Jan 9, 2025 at 3:17 PM Andy Hartman wrote: > How thru a simple query can I make sure data matches and I can display it > > On Thu, Jan 9, 2025 at 3:16 PM Andy Hartman > wrote: > >> I have migrated over a Table from Mssql that had an Image column I now >> have it in Postgres >> > Did SSMS

Re: recovery error while running any statement

2025-01-09 Thread Ron Johnson
On Thu, Jan 9, 2025 at 12:01 PM yudhi s wrote: > > On Thu, Jan 9, 2025 at 10:21 PM Adrian Klaver > wrote: > >> On 1/9/25 08:42, yudhi s wrote: >> > Hello Experts, >> > It's postgres aurora version 16. While running the ALTER command on >> any >> > object we see an error "/Only RowExclusiveLock

Re: recovery error while running any statement

2025-01-09 Thread Ron Johnson
On Thu, Jan 9, 2025 at 11:42 AM yudhi s wrote: > Hello Experts, > It's postgres aurora version 16. While running the ALTER command on any > object we see an error "*Only RowExclusiveLock or less can be acquired on > database objects during recovery*". If I run any DML it gives an error > stating

Re: Alter table fast

2025-01-09 Thread Ron Johnson
On Thu, Jan 9, 2025 at 11:25 AM veem v wrote: > Hello, > It's postgres version 16.1, we want to convert an existing column data > type from integer to numeric and it's taking a long time. The size of the > table is ~50GB and the table has ~150million rows in it and it's not > partitioned. We trie

Re: INTERVAL MINUTE TO SECOND didn't do what I thought it would do

2025-01-08 Thread Ron Johnson
On Wed, Jan 8, 2025 at 3:07 PM Adrian Klaver wrote: > > > On 1/8/25 11:58 AM, Ron Johnson wrote: > > On Wed, Jan 8, 2025 at 2:43 PM Adrian Klaver > <mailto:adrian.kla...@aklaver.com>> wrote: > > > > > > I'd hoped that ::INTERVAL MINUTE TO S

Re: INTERVAL MINUTE TO SECOND didn't do what I thought it would do

2025-01-08 Thread Ron Johnson
On Wed, Jan 8, 2025 at 2:43 PM Adrian Klaver wrote: > > > On 1/8/25 11:00 AM, Ron Johnson wrote: > > PG 14.13 > > > > The goal of "(now() - query_start)::INTERVAL MINUTE TO SECOND" column is > > to see how many minutes and seconds ago that the query s

INTERVAL MINUTE TO SECOND didn't do what I thought it would do

2025-01-08 Thread Ron Johnson
PG 14.13 The goal of "(now() - query_start)::INTERVAL MINUTE TO SECOND" column is to see how many minutes and seconds ago that the query started. (Why? Because that's useful to me, and the people I show the output to when queries run for more than a few minutes. We don't need to see hours and da

Re: Postgres do not support tinyint?

2025-01-07 Thread Ron Johnson
On Wed, Jan 8, 2025 at 12:06 AM Igor Korot wrote: > Hi, ALL, > According to https://www.postgresql.org/docs/9.1/datatype-numeric.html, > the > smallest numeric type supports numbers from -32768 to 32767/ > > My data will be in a range of [0..4], and so I guess my DB table will waste > space, righ

  1   2   3   4   5   6   7   8   9   10   >