Re: [DISCUSS] FLIP-223: Support HiveServer2 Endpoint

2022-04-24 Thread Shengkai Fang
Hi, Jiang. Thanks for your feedback! > Integrating the Hive ecosystem should not require changing the service interface I move the API change to the FLIP-91. But I think it's possible we add more interfaces to intergrate the new endpoints in the future because every endpoints's functionality is

[jira] [Created] (FLINK-27363) Support EXCHANGE PARTITION statement for partitioned table

2022-04-24 Thread dalongliu (Jira)
dalongliu created FLINK-27363: - Summary: Support EXCHANGE PARTITION statement for partitioned table Key: FLINK-27363 URL: https://issues.apache.org/jira/browse/FLINK-27363 Project: Flink Issue Ty

[jira] [Created] (FLINK-27364) Support DESC EXTENDED partition statement for partitioned table

2022-04-24 Thread dalongliu (Jira)
dalongliu created FLINK-27364: - Summary: Support DESC EXTENDED partition statement for partitioned table Key: FLINK-27364 URL: https://issues.apache.org/jira/browse/FLINK-27364 Project: Flink Is

Re: [DISCUSS] Maintain a Calcite repository for Flink to accelerate the development for Flink SQL features

2022-04-24 Thread godfrey he
Hi, Jing Thanks for sharing the Calcite experiences. About Calcite version upgrading, we should try not use the latest Calcite version to avoid the bugs introduced by the new version if possible. This may be a best practice. Hi, Yun Thanks for the detailed explanation for the experiences regardi

Re: [DISCUSS] FLIP-220: Temporal State

2022-04-24 Thread Jiangang Liu
Thanks for the discussion. I think that this is a very good question to flink and we can benefit a lot from it. The default IntervalJoinOperator is really inefficient. We have optimized the problem by using Rocksdb's upper bound and lower bound which detail can refer to https://issues.apache.org/ji

[jira] [Created] (FLINK-27365) [umbrella] Schema evolution on table store

2022-04-24 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-27365: Summary: [umbrella] Schema evolution on table store Key: FLINK-27365 URL: https://issues.apache.org/jira/browse/FLINK-27365 Project: Flink Issue Type: New Fe

[jira] [Created] (FLINK-27366) Record metadata on filesystem path

2022-04-24 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-27366: Summary: Record metadata on filesystem path Key: FLINK-27366 URL: https://issues.apache.org/jira/browse/FLINK-27366 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-217 Support watermark alignment of source splits

2022-04-24 Thread Becket Qin
Hi Dawid, Thanks for the explanation. Apologies that I somehow misread a bunch of "align" and thought they were "assign". Regarding 1, by default implementation, I was thinking of the default no-op implementation. I am a little worried about the proliferation of decorative interfaces. I think the

[jira] [Created] (FLINK-27367) CAST between INT and DATE is broken

2022-04-24 Thread Jark Wu (Jira)
Jark Wu created FLINK-27367: --- Summary: CAST between INT and DATE is broken Key: FLINK-27367 URL: https://issues.apache.org/jira/browse/FLINK-27367 Project: Flink Issue Type: Bug Component

[jira] [Created] (FLINK-27368) CAST(' 1 ' as BIGINT) reutrns wrong result

2022-04-24 Thread Jark Wu (Jira)
Jark Wu created FLINK-27368: --- Summary: CAST(' 1 ' as BIGINT) reutrns wrong result Key: FLINK-27368 URL: https://issues.apache.org/jira/browse/FLINK-27368 Project: Flink Issue Type: Bug Co

[jira] [Created] (FLINK-27369) COALESCE('1', CAST(NULL as varchar)) throws expression type mismatch

2022-04-24 Thread Jark Wu (Jira)
Jark Wu created FLINK-27369: --- Summary: COALESCE('1', CAST(NULL as varchar)) throws expression type mismatch Key: FLINK-27369 URL: https://issues.apache.org/jira/browse/FLINK-27369 Project: Flink I

Re: [VOTE] Release 1.15.0, release candidate #4

2022-04-24 Thread Jark Wu
I started a local standalone cluster and run several queries using SQL CLI. But found some issues [1][2][3]. They are all related to the correctness of results or backward compatibility. I didn't set them as block issues, if we have a next RC, we should get them merged, if not, we can release a mi

[jira] [Created] (FLINK-27370) Add a new SessionJobState - Failed

2022-04-24 Thread Xin Hao (Jira)
Xin Hao created FLINK-27370: --- Summary: Add a new SessionJobState - Failed Key: FLINK-27370 URL: https://issues.apache.org/jira/browse/FLINK-27370 Project: Flink Issue Type: Improvement Co

Re: [DISCUSS] FLIP-217 Support watermark alignment of source splits

2022-04-24 Thread Jark Wu
Thanks for the effort, Dawid and Sebastian! I just have some minor questions (maybe I missed something). 1. Will the framework always align with watermarks when the source implements the interface? I'm afraid not every case needs watermark alignment even if Kafka implements the interface, and thi

Re: [VOTE] Release 1.15.0, release candidate #4

2022-04-24 Thread Peter Schrott
Hi all, Unfortunately I could not extract the logs in time today - the ordering in the csv was wrong and the csv was not parsable due to extra commas in the logs... I discovered the issue in a pre-production cluster. I am gone for the weekend - I don't have access to the systems - but I will retr

[jira] [Created] (FLINK-27371) Record schema id in snapshot and manifestFileMeta and SstFileMeta

2022-04-24 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-27371: Summary: Record schema id in snapshot and manifestFileMeta and SstFileMeta Key: FLINK-27371 URL: https://issues.apache.org/jira/browse/FLINK-27371 Project: Flink

Re: [VOTE] Release 1.15.0, release candidate #4

2022-04-24 Thread Yun Gao
Very thanks Jark for the checking! I also agree with that if possible let's first try to close this version and have a minor version soon. Best, Yun Gao -- From:Jark Wu Send Time:2022 Apr. 24 (Sun.) 21:07 To:dev ; Yun Gao ; Timo

Re: [VOTE] Release 1.15.0, release candidate #4

2022-04-24 Thread Yun Gao
Very thanks Peter for the help! The vote time would exclude the weekend, thus no worry for that. Best, Yun Gao -- From:Peter Schrott Send Time:2022 Apr. 25 (Mon.) 09:17 To:Matthias Pohl Cc:dev ; Yun Gao Subject:Re: [VOTE] Relea

[jira] [Created] (FLINK-27372) Make SstFileMeta and ManifestFileMeta schemaless

2022-04-24 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-27372: Summary: Make SstFileMeta and ManifestFileMeta schemaless Key: FLINK-27372 URL: https://issues.apache.org/jira/browse/FLINK-27372 Project: Flink Issue Type:

[jira] [Created] (FLINK-27373) Disable installing PyFlink using `python setup.py install`

2022-04-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-27373: --- Summary: Disable installing PyFlink using `python setup.py install` Key: FLINK-27373 URL: https://issues.apache.org/jira/browse/FLINK-27373 Project: Flink Issue Type:

[jira] [Created] (FLINK-27374) Convert Hive's void type to Flink's string type

2022-04-24 Thread luoyuxia (Jira)
luoyuxia created FLINK-27374: Summary: Convert Hive's void type to Flink's string type Key: FLINK-27374 URL: https://issues.apache.org/jira/browse/FLINK-27374 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-27375) Hive dialect support "over() without order keys inside"

2022-04-24 Thread luoyuxia (Jira)
luoyuxia created FLINK-27375: Summary: Hive dialect support "over() without order keys inside" Key: FLINK-27375 URL: https://issues.apache.org/jira/browse/FLINK-27375 Project: Flink Issue Type: S

[jira] [Created] (FLINK-27376) Hive dialect supports "select current_database()"

2022-04-24 Thread luoyuxia (Jira)
luoyuxia created FLINK-27376: Summary: Hive dialect supports "select current_database()" Key: FLINK-27376 URL: https://issues.apache.org/jira/browse/FLINK-27376 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-27377) Job manager blocks on marking vertex finished

2022-04-24 Thread Yi Tang (Jira)
Yi Tang created FLINK-27377: --- Summary: Job manager blocks on marking vertex finished Key: FLINK-27377 URL: https://issues.apache.org/jira/browse/FLINK-27377 Project: Flink Issue Type: Bug

Re: [DISCUSS] Maintain a Calcite repository for Flink to accelerate the development for Flink SQL features

2022-04-24 Thread Jark Wu
Thanks, Godfrey, for starting this discussion, I understand the motivation behind it. No bugfix releases, slow feature reviewing, and no compatibility guaranteed are genuinely blocking the development of Flink SQL. I think a fork is the last choice before trying our best to cooperate with the Cal

[jira] [Created] (FLINK-27378) Unexpected rexnode : org.apache.calcite.rex.RexFieldAccess

2022-04-24 Thread tartarus (Jira)
tartarus created FLINK-27378: Summary: Unexpected rexnode : org.apache.calcite.rex.RexFieldAccess Key: FLINK-27378 URL: https://issues.apache.org/jira/browse/FLINK-27378 Project: Flink Issue Type

[jira] [Created] (FLINK-27379) CodeGenException: Unable to find common type of

2022-04-24 Thread tartarus (Jira)
tartarus created FLINK-27379: Summary: CodeGenException: Unable to find common type of Key: FLINK-27379 URL: https://issues.apache.org/jira/browse/FLINK-27379 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-27380) Failed to get Hive result type from org.apache.hadoop.hive.ql.udf.generic.GenericUDAFPercentileApprox

2022-04-24 Thread tartarus (Jira)
tartarus created FLINK-27380: Summary: Failed to get Hive result type from org.apache.hadoop.hive.ql.udf.generic.GenericUDAFPercentileApprox Key: FLINK-27380 URL: https://issues.apache.org/jira/browse/FLINK-27380