To use "ReadFromKafka" from Flink, you additionally need to
specify pipeline option "--experiments=use_deprecated_read" I believe. This
is due to a known issue: https://github.com/apache/beam/issues/20979
Thanks,
Cham
On Wed, Jan 10, 2024 at 9:56 PM Yarden BenMoshe wrote:
> Thanks for the detai
Thanks for the detailed answer.
I forgot to mention that I am using FlinkRunner as my Setup. Will this
work with this runner as well?
On 2024/01/10 13:34:28 Ferran Fernández Garrido wrote:
> Hi Yarden,
>
> If you are using Dataflow as a runner, you can already use
> ReadFromKafka (introduced or
Hi Yarden,
If you are using Dataflow as a runner, you can already use
ReadFromKafka (introduced originally in version 2.52). Dataflow will
handle the expansion service automatically, so you don't have to do
anything.
If you want to run it locally for development purposes, you'll have to
build the
