回复：Re: Fwd: [DISCUSS] Flink's supported APIs and Hive query syntax

.-- 发件人：Jark Wu 日　期：2022年03月10日 19:59:30 收件人：Francesco Guardiani; dev 抄　送：Martijn Visser; User; 罗宇侠(莫辞) 主　题：Re: Fwd: [DISCUSS] Flink's supported APIs and Hive query syntax Hi Francesco, Yes. The Hive syntax is a syntax plugin provided by

Re: Fwd: [DISCUSS] Flink's supported APIs and Hive query syntax

cate the old Hive versions in 1.15, and we can discuss dropping >>> it in 1.16 or 1.17. >>> >>> Best, >>> Jark >>> >>> >>> On Thu, 10 Mar 2022 at 14:19, 罗宇侠(莫辞) >>> wrote: >>> >>>> Thanks Martijn for your insights. >>&g

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

geId=165227316 > [2] https://issues.apache.org/jira/browse/FLINK-21529 > [3] https://issues.apache.org/jira/browse/FLINK-21531 > Best regards, > Yuxia. > > > --原始邮件 -- > *发件人:*Martijn Visser > *发送时间:*Mon Mar 7 19:23:15 2022 > *收件人:*dev

回复：[DISCUSS] Flink's supported APIs and Hive query syntax

/confluence/pages/viewpage.action?pageId=165227316 [2] https://issues.apache.org/jira/browse/FLINK-21529 [3] https://issues.apache.org/jira/browse/FLINK-21531 Best regards, Yuxia. ​ --原始邮件 -- 发件人:Martijn Visser 发送时间:Mon Mar 7 19:23:15 2022 收件人:dev , User 主题:[DISCUS

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Thanks all for your discussions. I'll share my opinion here: 1. Hive SQL and Hive-like SQL are the absolute mainstay of current Batch ETL in China. Hive+Spark (HiveSQL-like)+Databricks also occupies a large market worldwide. - Unlike OLAP SQL (such as presto, which is ansi-sql rather than hive s

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for bringing this up. Hive SQL (using in Hive & Spark) plays an important role in batch processing, it has almost become de facto standard in batch processing. In our company, there are hundreds of thousands of spark jobs each day. IMO, if we want to promote Flink batch, Hive s

Re: Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for starting this discussion. I think it's great for the community to to reach a consensus on the roadmap of Hive query syntax. I agree that the Hive project is not actively developed nowadays. However, Hive still occupies the majority of the batch market and the Hive ecosystem

Re:Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for driving this discussion. +1 on efforts on more hive/spark syntax compatibility.The hive/spark syntax is the most popular in batch computing.Within our company, many users have the desire to use Flink to realize the integration of streaming and batching,and some users hav

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi, Thanks Martijn for driving this discussion. Your concerns are very rational. We should do our best to keep the Flink development on the right track. I would suggest discussing it in a vision/goal oriented way. Since Flink has a clear vision of unified batch and stream processing, supporting b

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for driving this discussion. +1 on efforts on more hive syntax compatibility. With the efforts on batch processing in recent versions(1.10~1.15), many users have run batch processing jobs based on Flink. In our team, we are trying to migrate most of the existing online batch j

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi, thanks Martijn for bringing this up and raising very valid concerns. I agree with the notion that Flink supporting Hive should come with a proper commitment, and otherwise we should consider not supporting it at all (in Flink itself, that is). Given that Hive is an Apache project, my fir

[DISCUSS] Flink's supported APIs and Hive query syntax

Hi everyone, Flink currently has 4 APIs with multiple language support which can be used to develop applications: * DataStream API, both Java and Scala * Table API, both Java and Scala * Flink SQL, both in Flink query syntax and Hive query syntax (partially) * Python API Since FLIP-152 [1] the F