Re: concatenating hstores in a group by?

2025-01-19 Thread Tom Lane
"David G. Johnston" writes: > On Friday, January 17, 2025, Brent Wood wrote: >> I want to concatenate the hstores, > There are no hstore aggregate functions. It would be trivial to make a user-defined one. More or less (untested) create aggregate hstore_agg(hstore) ( sfunc = hs_concat, sty

Re: concatenating hstores in a group by?

2025-01-19 Thread Adrian Klaver
On 1/17/25 12:43, Brent Wood wrote: Hi, I have a table with a timestamp and hstore columns with times in milliseconds. I want to concatenate the hstores, grouped by timestamp, with the timestamps truncated to whole seconds: date_trunc('seconds', timer). How can I concatenate all the hstore

Re: Design of a reliable task processing queue

2025-01-19 Thread auxsvr
On Saturday, 18 January 2025 12:44:07 EET Alex Burkhart wrote: > Hey team, > > I'm looking for help to organize locks and transaction for a reliable task > queue. > > REQUIREMENTS > > 1. Pending actions are persisted to a database. There's a trace once they > are done. > 2. Application workers p

concatenating hstores in a group by?

2025-01-19 Thread David G. Johnston
On Friday, January 17, 2025, Brent Wood wrote: > > I want to concatenate the hstores, > > There are no hstore aggregate functions. You’ll want to convert them to,json first then use the json_objectagg aggregate function. David J.

Re: Design of a reliable task processing queue

2025-01-19 Thread Shaheed Haque
As with all things distributed, it's useful to start with some notion of what the word "reliable" means to you. For example, when your pseudo code, is replaced by the real code, can that fail? And if it fails, is it known that the work in hand can simply be redone? Those answers will need to be un

Re: pg_repack and locks

2025-01-19 Thread Boris Zentner
Hi there, I think you can use -T 3600 -D If you don't want to kill the backends. -- Boris > Am 19.01.2025 um 13:52 schrieb nicolas75...@yahoo.fr: > > Hi > > Thanks for the help but this will not help, killing other process is not safe > The good way will be that pg_repack tools include a ti

RE: pg_repack and locks

2025-01-19 Thread nicolas75_fr
Hi Thanks for the help but this will not help, killing other process is not safe The good way will be that pg_repack tools include a timeout so, that after expiration delay, he will stop waiting and discard the repack action But thanks again for your proposition. Regards, Nicolas -Message d

Re: Design of a reliable task processing queue

2025-01-19 Thread Peter J. Holzer
On 2025-01-18 19:44:07 +0900, Alex Burkhart wrote: > REQUIREMENTS > > 1. Pending actions are persisted to a database. There's a trace once they are > done. > 2. Application workers pick actions one by one. At any given time, each action > can be assigned to at most one worker (transaction). > 3. I

Re: Postgresql database terminates abruptly with too many open files error

2025-01-19 Thread Peter J. Holzer
On 2025-01-15 11:42:30 +, Sri Mrudula Attili wrote: > The max_connections =200 and max_files_per_process =1000 as you mentioned. > > So should a max_files_per_process =500 helps? > > > I could see from the number of connections to the databaseis not exceeding > 20. But still these 20 are cau

Re: Postgresql database terminates abruptly with too many open files error

2025-01-19 Thread Durgamahesh Manne
-- Forwarded message - From: Sri Mrudula Attili Date: Wed, 15 Jan, 2025, 17:12 Subject: Re: Postgresql database terminates abruptly with too many open files error To: Tom Lane Cc: Hello Tom, The max_connections =200 and max_files_per_process =1000 as you mentioned. So should

Design of a reliable task processing queue

2025-01-19 Thread Alex Burkhart
Hey team, I'm looking for help to organize locks and transaction for a reliable task queue. REQUIREMENTS 1. Pending actions are persisted to a database. There's a trace once they are done. 2. Application workers pick actions one by one. At any given time, each action can be assigned to at most o

concatenating hstores in a group by?

2025-01-19 Thread Brent Wood
Hi, I have a table with a timestamp and hstore columns with times in milliseconds. I want to concatenate the hstores, grouped by timestamp, with the timestamps truncated to whole seconds: date_trunc('seconds', timer). How can I concatenate all the hstores within a one second interval, ie, som