That sounds like something that is good to handle with PgQ that is part of
SkyTools package.
PgQ is very efficient event processing system for PostgreSQL. Each event
queue may have several consumers.
What may interest you is that PgQ takes care of processed events by keeping
them in rotated tables
Dear,
I'm looking for an efficient way to process data that I have stored in a
staging table. This is syslog output, so it consists of text, where I
need regexes to filter it out. The data will be split into several/a lot
of tables.
I currently have a set of queries that
* read from staging a
