On Tue, 8 Dec 2020 at 17:54, Andrey Borodin wrote:
> > In pglogical3 we already support streaming decoded WAL data to
> alternative writer downstreams including RabbitMQ and Kafka via writer
> plugins.
> Yes, Yandex.Cloud Transfer Manger supports it too. But it has to be
> resynced after physica
Thanks Craig!
Probably, I should better ask in your nearby thread about logical replication,
it just seemed to me that logical archiving is somewhat small independent piece
of functionality...
> 7 дек. 2020 г., в 08:05, Craig Ringer
> написал(а):
>
> Reply follows inline. I addressed your las
On Mon, Dec 7, 2020 at 8:35 AM Craig Ringer
wrote:
>
> Reply follows inline. I addressed your last point first, so it's out of order.
>
> On Fri, 4 Dec 2020 at 15:33, Andrey Borodin wrote
>
> We'd also need to separate the existing apply worker into a "receiver" and
> "apply/writer" part, so the
Actually CC'd Petr this time.
On Mon, 7 Dec 2020 at 11:05, Craig Ringer
wrote:
> Reply follows inline. I addressed your last point first, so it's out of
> order.
>
> On Fri, 4 Dec 2020 at 15:33, Andrey Borodin wrote
>
> > If OLAP cannot consume data fast enough - we are out of space due to
> re
Reply follows inline. I addressed your last point first, so it's out of
order.
On Fri, 4 Dec 2020 at 15:33, Andrey Borodin wrote
> If OLAP cannot consume data fast enough - we are out of space due to repl
slot.
There is a much simpler solution to this than logical PITR.
What we should be doing
On Fri, 4 Dec 2020 at 14:36, Andrey Borodin wrote:
> >
> > The most time consuming process is logical decoding, mainly due to long
> running transactions.
> Currently I do not experience problem of high CPU utilisation.
>
> I'm wondering why the LSN isn't moving fast enough for your use case.
>
Hi Euler!
Thanks for your response.
> 4 дек. 2020 г., в 22:14, Euler Taveira
> написал(а):
>
> On Fri, 4 Dec 2020 at 04:33, Andrey Borodin wrote:
>
> I was discussing problems of CDC with scientific community and they asked
> this simple question: "So you have efficient WAL archive on a ver
On Fri, 4 Dec 2020 at 04:33, Andrey Borodin wrote:
>
> I was discussing problems of CDC with scientific community and they asked
> this simple question: "So you have efficient WAL archive on a very cheap
> storage, why don't you have a logical archive too?"
>
WAL archive doesn't process data; it
