Re: Mysql CDC: support for parallelism

our cdc table to > let the source close the idle subtasks. > ps: There is a limit when opening this option. Please see more in its > description. > > Best, > Hang > > [1] > https://nightlies.apache.org/flink/flink-cdc-docs-release-3.2/docs/connectors/flink-sources/mysql-cdc/

Re: Mysql CDC: support for parallelism

, however, not really ideal, is there any way to scale CDC without this hard restart? Thanks, Mike On Thu, Oct 24, 2024 at 12:25 PM Michael Marino wrote: > Hey all, > > We are working to scale one of our Flink Jobs (using Table API mostly, > some DataStream) where we are using a MySQL CD

Mysql CDC: support for parallelism

be forced to use the DataStream API, set the parallelism explicitly and then convert to a table. Thanks! Cheers, Mike -- Michael Marino Principal Data Science & Analytics Phone: +49 89 7167786 - 14 linkedin.com/company/tadogmbh <https://www.linkedin.com/company/tadogmbh> | facebook.com

Re: Suggestions for aggregating records to a Kinesis Sink, (or generic Async Sink)?

h" items > out of a custom window on snapshot action. > > Hope the above helps. > > Regards, > Hong > > On Mon, Apr 29, 2024 at 11:15 AM Michael Marino > wrote: > >> Hi all, >> >> We are currently using Flink 1.18.1 (AWS Managed Flink) and are

Suggestions for aggregating records to a Kinesis Sink, (or generic Async Sink)?

the documentation? I was thinking about moving the logic to use window functions (either in the Table or DataStream API), but here I think I'd need to "close" the window based not only on time, but also on record number. Anyways, any thoughts are appreciated! Thanks, Mike --

Re: Dealing with incompatible state in Temporal Left Join on Schema Evolution (Table API)

t think we should try to fix just one > case: this should have a proper solution, something that has been brought > up in our conversation for Flink 2.0. > > Best regards, > > Martijn > > > > On Fri, Jul 7, 2023 at 11:40 AM Michael Marino > wrote: > >> Hi Mar

Re: Dealing with incompatible state in Temporal Left Join on Schema Evolution (Table API)

e-1.17/docs/ops/upgrading/#table-api--sql > > Best regards, > > Martijn > > On Fri, Jul 7, 2023 at 9:23 AM Michael Marino > wrote: > >> Hi all, >> >> I had a question about how to allow a migration of state in a temporal >> left join. Let me fi

Dealing with incompatible state in Temporal Left Join on Schema Evolution (Table API)

;m looking forward to your input, thanks for your help! Cheers, Mike -- Michael Marino Principal Data Science & Analytics Phone: +49 89 7167786 - 14 linkedin.com/company/tadogmbh <https://www.linkedin.com/company/tadogmbh> | facebook.com/tado <http://www.facebook.com/tado> |