Re: Long execution of SQL query to Kafka + Hive (q77 TPC-DS)

One of the MultiInput operators works for 12 minutes. The screenshot shows all stages of Flink job. [image: 3.png] Q77 Query of TPC-DS Benchmark. All *_sales and *_returns tables(6 tables) are read from Kafka, and the remaining 3 tables ( date_dim, web_page, store) from Hive. with ss as (select

Re: Long execution of SQL query to Kafka + Hive (q77 TPC-DS)

Hi, Can you help to explain the q77 execution plan? And find which operator takes a long time in flink UI? Best Ron Вова Фролов 于2024年1月24日周三 09:09写道： > Hello, > > I am executing a heterogeneous SQL query (part of the data is in Hive > and part in Kafka. The query utilizes TPC-DS benchmark 10

Long execution of SQL query to Kafka + Hive (q77 TPC-DS)

Hello, I am executing a heterogeneous SQL query (part of the data is in Hive and part in Kafka. The query utilizes TPC-DS benchmark 100GB data.) in BatchMode. However, the execution time is excessively long, taking approximately 11 minutes to complete , although the request to Hive only (without