Re: Re: [YAML] ReadFromKafka with yaml

2024-01-11 Thread Chamikara Jayalath via dev
To use "ReadFromKafka" from Flink, you additionally need to specify pipeline option "--experiments=use_deprecated_read" I believe. This is due to a known issue: https://github.com/apache/beam/issues/20979 Thanks, Cham On Wed, Jan 10, 2024 at 9:56 PM Yarden BenMoshe wrote: > Thanks for the detai

RE: Re: [YAML] ReadFromKafka with yaml

2024-01-10 Thread Yarden BenMoshe
Thanks for the detailed answer. I forgot to mention that I am using FlinkRunner as my Setup. Will this work with this runner as well? On 2024/01/10 13:34:28 Ferran Fernández Garrido wrote: > Hi Yarden, > > If you are using Dataflow as a runner, you can already use > ReadFromKafka (introduced or