Hi,
I’m investigating a slowness of our beam pipelines, and as part of that I tried
to compare a very simple beam pipeline with an equivalent flink-native
pipeline. Both pipelines should read strings from one kafka topic and write
them to another topic. I’m using beam 2.38.0 and flink 1.13.
I t
at this issue: https://issues.apache.org/jira/browse/BEAM-11146
Thanks
On Mon, May 2, 2022 at 12:57 AM Afek, Ifat (Nokia - IL/Kfar Sava)
mailto:ifat.a...@nokia.com>> wrote:
Hi,
I’m investigating a slowness of our beam pipelines, and as part of that I tried
to compare a very simple beam p
use_deprecated_read".
Jan
On 5/11/22 16:20, Afek, Ifat (Nokia - IL/Kfar Sava) wrote:
Hi,
Thanks for the tip. I enabled the fasterCopy parameter and the performance
improved from 30,000 strings per second to 35,000-40,000. There is still a huge
difference compared to native flink (15
Hi,
I’m running a HOP pipeline that reads from Kafka using Beam Kafka Consume and
writes to Kafka using Beam Kafka Produce.
How can I modify the value of “auto.offset.reset” to be “earliest”? I tried to
add it as a configuration option of the Beam Kafka Consume, as well as a
variable in the Fli
Sorry.. sent it to the wrong group 😊
Ifat
From: "Afek, Ifat (Nokia - IL/Kfar Sava)"
Reply-To: "user@beam.apache.org"
Date: Sunday, 24 July 2022 at 15:26
To: "user@beam.apache.org"
Subject: Suspected SPAM - Running Beam Kafka Consume with auto.offset.reset
&quo
