Cc: user@flink.apache.org
Subject: Re: Flink Batch Execution Mode
Hi Irakli
What version of flink-connector-kafka are you using?
You may have encountered a bug [1] in the old version that prevents the source
task from entering the finished state.
[1].
https://issues.apache.org/jira/browse/FLINK-3
Hi Irakli
What version of flink-connector-kafka are you using?
You may have encountered a bug [1] in the old version that prevents the
source task from entering the finished state.
[1]. https://issues.apache.org/jira/browse/FLINK-31319
Best,
Feng
On Tue, Mar 12, 2024 at 7:21 PM irakli.keshel.
Hello,
I have a Flink job that is running in the Batch mode. The source for the job is
a Kafka topic which has limited number of events. I can see that the job starts
running fine and consumes the events, but never makes it past the first task
and becomes idle. The Kafka source is defined to be
Hi Lu,
At present, Flink is still based on row format in the runtime execution
layer and vectorization relies mostly on automatic compiler optimizations
of the JVM.
Best regards,
Weijie
Shammon FY 于2023年4月27日周四 10:52写道：
> Hi Lu,
>
> Currently, Flink does not have official benchmark results
Thanks! Shammon! Do you also have insights on the first 2 questions as
well? Thanks!
1. Does flink batch mode use columnar in-memory format?
2. Does flink batch mode use vectorization technique?
Best
Lu
On Wed, Apr 26, 2023 at 7:51 PM Shammon FY wrote:
> Hi Lu,
>
> Currently, Flink does not h
Hi Lu,
Currently, Flink does not have official benchmark results compared to Spark
and Presto. You can run the TPC-DS benchmark yourself to compare to
different engines, Flink supports all queries for TPC-DS, for example, the
benchmark project [1]. Of course, other companies have made similar
comp
Hi, Flink users
I am trying to understand the internals of flink batch mode. some questions:
1. Does flink batch mode use columnar in-memory format?
2. Does flink batch mode use vectorization technique?
3. any performance benchmark available compared with batch engines like
spark or presto?
Some
