Re: Flink Batch Execution Mode

2024-03-13 Thread irakli.keshel...@sony.com
Cc: user@flink.apache.org Subject: Re: Flink Batch Execution Mode Hi Irakli What version of flink-connector-kafka are you using? You may have encountered a bug [1] in the old version that prevents the source task from entering the finished state. [1]. https://issues.apache.org/jira/browse/FLINK-3

Re: Flink Batch Execution Mode

2024-03-12 Thread Feng Jin
Hi Irakli What version of flink-connector-kafka are you using? You may have encountered a bug [1] in the old version that prevents the source task from entering the finished state. [1]. https://issues.apache.org/jira/browse/FLINK-31319 Best, Feng On Tue, Mar 12, 2024 at 7:21 PM irakli.keshel.

Re: flink batch execution mode

2023-04-26 Thread weijie guo
Hi Lu, At present, Flink is still based on row format in the runtime execution layer and vectorization relies mostly on automatic compiler optimizations of the JVM. Best regards, Weijie Shammon FY 于2023年4月27日周四 10:52写道: > Hi Lu, > > Currently, Flink does not have official benchmark results

Re: flink batch execution mode

2023-04-26 Thread Lu Niu
Thanks! Shammon! Do you also have insights on the first 2 questions as well? Thanks! 1. Does flink batch mode use columnar in-memory format? 2. Does flink batch mode use vectorization technique? Best Lu On Wed, Apr 26, 2023 at 7:51 PM Shammon FY wrote: > Hi Lu, > > Currently, Flink does not h

Re: flink batch execution mode

2023-04-26 Thread Shammon FY
Hi Lu, Currently, Flink does not have official benchmark results compared to Spark and Presto. You can run the TPC-DS benchmark yourself to compare to different engines, Flink supports all queries for TPC-DS, for example, the benchmark project [1]. Of course, other companies have made similar comp