Re: How the Async Exuecution Model improved the throughtput

Hi Enric, Seems that versions before 2.0-preview just handle the state I/O with the > user thread? That's true. It's a single-thread model. Best, Zakelly On Tue, Nov 26, 2024 at 3:42 PM Enric Ott <243816...@qq.com> wrote: > Thank you,Zakelly. > Seems that versions before 2.0-preview just han

[ANNOUNCE] Apache flink-connector-kafka 3.4.0 released

The Apache Flink community is very happy to announce the release of Apache flink-connector-kafka 3.4.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available for download a

S3 Timeout waiting for connection from pool

hi My Flink cluster uses S3 for storing the state backend. However, an exception occurs when the task runs for a long period of time. The content of the exception is "Timeout waiting for connection from pool". What could be the reason for this? The following is the specific error message. ja

Re: Cdc on HA postgresql

I don't think you necessarily need two sources. You could put a proxy in front of Postgres (e.g. pgbouncer) which has one fixed address, encapsulating the fact that a failover happens. That's at least what I am exploring/demoing in this blog post. Hit me up off-list if you want to take a preview at

Re: Cdc on HA postgresql

Thanks for all the feedback. As I see it Flink cdc only support one host or. Source. This means we have to create at least two sources in Flink. But if one node is down Flink is failing and we don’t have a HA solution. We have concluded it isn’t possible with the current state of Flink cdc to suppo

Re: Cdc on HA postgresql

Thanks Gunnar for sharing the information, looking forward to your blogpost. Best, Leonard > On Nov 26, 2024, at 3:13 PM, Gunnar Morling > wrote: > > Hey all, > > Postgres 17 supports failover slots, i.e. a replication slot can be created > on the primary instance and its state will be sync

[ANNOUNCE] Apache Celeborn 0.5.2 available

Hello all, Apache Celeborn community is glad to announce the new release of Apache Celeborn 0.5.2. Celeborn is dedicated to improving the efficiency and elasticity of different map-reduce engines and provides an elastic, highly efficient service for intermediate data including shuffle data, spill