Re: Deadlock in Subtask in the FlinkKinesisConsumer

Hi Seth, I think the global watermark / mark as idle is one of the reasons why the FLIP-27 [1] interfaces were created, while FLIP-180 [2] is also relevant here. Unfortunately, the FlinkKinesisConsumer is still using the old interface. I'm not sure it can be properly fixed with the old interfaces.

[jira] [Created] (FLINK-29135) After updating to calcite 1.30.0 and janino 3.1.6 some tests started to fail with compilation issues in generated code

Sergey Nuyanzin created FLINK-29135: --- Summary: After updating to calcite 1.30.0 and janino 3.1.6 some tests started to fail with compilation issues in generated code Key: FLINK-29135 URL: https://issues.apache.o

[jira] [Created] (FLINK-29136) Cast of integer array to string stopped working after upgrade to calcite 1.30

Sergey Nuyanzin created FLINK-29136: --- Summary: Cast of integer array to string stopped working after upgrade to calcite 1.30 Key: FLINK-29136 URL: https://issues.apache.org/jira/browse/FLINK-29136 P

Re: [flink-connector-elasticsearch] Supporting ElasticSearch 8 & Dropping ES 6 ?

Hi Niels, With regards to ES support, we should follow the supported version that ES supports [1]. So if we add support for ES8, we drop support for ES6. With regards to the used clients, we can't upgrade to the latest version of `RestHighLevelClient`. That's because Elasticsearch has changed the

[jira] [Created] (FLINK-29137) Switch docker images to eclipse temurin base

Chesnay Schepler created FLINK-29137: Summary: Switch docker images to eclipse temurin base Key: FLINK-29137 URL: https://issues.apache.org/jira/browse/FLINK-29137 Project: Flink Issue Ty

[SUMMARY] Flink 1.16 release sync of 2022-08-30

I would like to give you a brief update of the Flink 1.16 release sync meating of 2022-08-30. *Since the feature freeze(9th of August 2022, end of business CEST), we have started release-testing[1] in the last three weeks. We're almost done with half of the test issues. The remaining test issues a

[jira] [Created] (FLINK-29138) Project pushdown not work for lookup source

lincoln lee created FLINK-29138: --- Summary: Project pushdown not work for lookup source Key: FLINK-29138 URL: https://issues.apache.org/jira/browse/FLINK-29138 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29139) Almost every test inside FlinkSqlParserImplTest is failing after uprgade to calcite of higher versions

Sergey Nuyanzin created FLINK-29139: --- Summary: Almost every test inside FlinkSqlParserImplTest is failing after uprgade to calcite of higher versions Key: FLINK-29139 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-29140) Add basic podtemplate validation

Gyula Fora created FLINK-29140: -- Summary: Add basic podtemplate validation Key: FLINK-29140 URL: https://issues.apache.org/jira/browse/FLINK-29140 Project: Flink Issue Type: Improvement

[DISCUSS] Switch docker iamge base to Eclipse Temurin

Hello, during the release of the 1.15.2 images it was noted that we use the openjdk:8/11 images, which have been deprecated and thus no longer receive any updates. There are

[jira] [Created] (FLINK-29141) Remove Scala Suffix from flink-ml download instructions

Chesnay Schepler created FLINK-29141: Summary: Remove Scala Suffix from flink-ml download instructions Key: FLINK-29141 URL: https://issues.apache.org/jira/browse/FLINK-29141 Project: Flink

[jira] [Created] (FLINK-29142) round(float, int) fails to compile in Flink 1.14

Caizhi Weng created FLINK-29142: --- Summary: round(float, int) fails to compile in Flink 1.14 Key: FLINK-29142 URL: https://issues.apache.org/jira/browse/FLINK-29142 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-29143) NPE after calcite upgrade at org.apache.calcite.tools.RelBuilder.groupKey(RelBuilder.java:1287)

Sergey Nuyanzin created FLINK-29143: --- Summary: NPE after calcite upgrade at org.apache.calcite.tools.RelBuilder.groupKey(RelBuilder.java:1287) Key: FLINK-29143 URL: https://issues.apache.org/jira/browse/FLINK-2

Re: [DISCUSS] Support 'DYNAMIC MetadataColumn' in flink table

Thank you Ran for the explanation. The column DEFAULT is a reasonable feature and can also help in other cases. I’m fine with adding this feature. Do you want to prepare a FLIP for it? Best, Jark > 2022年8月29日 15:02，Ran Tao 写道： > > Hi Jack. Timo summed it up very well. In fact, my problem is

Re: [DISCUSS] Switch docker iamge base to Eclipse Temurin

Thanks for bringing this up, Chesnay. Can you elaborate a bit more on what you mean when referring to Alpine as being "not as user-friendly"? Doesn't it come with the same issue that switching to CentOS comes with that we have to update our scripts (I'm thinking of apt in particular)? Or what else

Re: [DISCUSS] Switch docker iamge base to Eclipse Temurin

yes, alpine would have similar issues as CentOS. As for usability, from personal experience it has always been a bit of a drag to extend or use manually because it is such a minimal image. On 30/08/2022 14:45, Matthias Pohl wrote: Thanks for bringing this up, Chesnay. Can you elaborate a bit m

[jira] [Created] (FLINK-29144) Enable multiple jar entries for jarURI

Arseniy Tashoyan created FLINK-29144: Summary: Enable multiple jar entries for jarURI Key: FLINK-29144 URL: https://issues.apache.org/jira/browse/FLINK-29144 Project: Flink Issue Type: Im

Re: [Discuss] KafkaSink making low level components PublicEvolving

Hi Mason, I would be against making them part of the Public API. It would be against our current conventions and it would make future changes in this connector much more difficult. It's difficult to support Public APIs, even if they are `@PublicEvolving`. Best, Piotrek pon., 29 sie 2022 o 19:17

[jira] [Created] (FLINK-29145) docker-entrypoint.sh - Read-only file system

Arseniy Tashoyan created FLINK-29145: Summary: docker-entrypoint.sh - Read-only file system Key: FLINK-29145 URL: https://issues.apache.org/jira/browse/FLINK-29145 Project: Flink Issue Ty

Re: [Discuss] KafkaSink making low level components PublicEvolving

Hi Piotr, The reasoning makes sense to me. I probably meant to say `public` class visibility and `@Internal` in my proposal, similar to other connector interface components (e.g. KafkaSourceReader). However, I actually found a workaround using the Public API sink builder and factory classes to cr

[jira] [Created] (FLINK-29146) User set job configuration can not be retirieved from JobGraph and ExecutionGraph

Shuiqiang Chen created FLINK-29146: -- Summary: User set job configuration can not be retirieved from JobGraph and ExecutionGraph Key: FLINK-29146 URL: https://issues.apache.org/jira/browse/FLINK-29146

[jira] [Created] (FLINK-29147) ChangelogLocalRecoveryITCase.testRestartTM failed with CheckpointException

Xingbo Huang created FLINK-29147: Summary: ChangelogLocalRecoveryITCase.testRestartTM failed with CheckpointException Key: FLINK-29147 URL: https://issues.apache.org/jira/browse/FLINK-29147 Project: F

[jira] [Created] (FLINK-29148) Add docs for SQL Gateway

Shengkai Fang created FLINK-29148: - Summary: Add docs for SQL Gateway Key: FLINK-29148 URL: https://issues.apache.org/jira/browse/FLINK-29148 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29149) Migrate E2E tests to catalog-based

Jane Chan created FLINK-29149: - Summary: Migrate E2E tests to catalog-based Key: FLINK-29149 URL: https://issues.apache.org/jira/browse/FLINK-29149 Project: Flink Issue Type: Sub-task C

[jira] [Created] (FLINK-29150) TIMESTAMPDIFF microsecond unit for table api

jackylau created FLINK-29150: Summary: TIMESTAMPDIFF microsecond unit for table api Key: FLINK-29150 URL: https://issues.apache.org/jira/browse/FLINK-29150 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29151) SHOW CREATE TABLE doesn't work for Hive dialect

Shengkai Fang created FLINK-29151: - Summary: SHOW CREATE TABLE doesn't work for Hive dialect Key: FLINK-29151 URL: https://issues.apache.org/jira/browse/FLINK-29151 Project: Flink Issue Type:

[jira] [Created] (FLINK-29152) Describe statement resutls is different from the Hive

Shengkai Fang created FLINK-29152: - Summary: Describe statement resutls is different from the Hive Key: FLINK-29152 URL: https://issues.apache.org/jira/browse/FLINK-29152 Project: Flink Issu