[jira] [Created] (FLINK-29438) Setup DynamoDB Connector Project Structure

2022-09-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29438: - Summary: Setup DynamoDB Connector Project Structure Key: FLINK-29438 URL: https://issues.apache.org/jira/browse/FLINK-29438 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-29439) Add DynamoDB project readme

2022-09-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29439: - Summary: Add DynamoDB project readme Key: FLINK-29439 URL: https://issues.apache.org/jira/browse/FLINK-29439 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-29440) Setup CI Logging

2022-09-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29440: - Summary: Setup CI Logging Key: FLINK-29440 URL: https://issues.apache.org/jira/browse/FLINK-29440 Project: Flink Issue Type: Sub-task Reporter:

[jira] [Created] (FLINK-29441) Setup dependency convergence check

2022-09-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29441: - Summary: Setup dependency convergence check Key: FLINK-29441 URL: https://issues.apache.org/jira/browse/FLINK-29441 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-29442) Setup license checks

2022-09-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29442: - Summary: Setup license checks Key: FLINK-29442 URL: https://issues.apache.org/jira/browse/FLINK-29442 Project: Flink Issue Type: Sub-task Repor

[jira] [Created] (FLINK-29443) Replicate packaging tests

2022-09-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29443: - Summary: Replicate packaging tests Key: FLINK-29443 URL: https://issues.apache.org/jira/browse/FLINK-29443 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-29444) Setup release scripts

2022-09-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29444: - Summary: Setup release scripts Key: FLINK-29444 URL: https://issues.apache.org/jira/browse/FLINK-29444 Project: Flink Issue Type: Sub-task Repo

[jira] [Created] (FLINK-29445) When the decimal table column field is printed,program is error

2022-09-28 Thread liuzhiyong (Jira)
liuzhiyong created FLINK-29445: -- Summary: When the decimal table column field is printed,program is error Key: FLINK-29445 URL: https://issues.apache.org/jira/browse/FLINK-29445 Project: Flink

[jira] [Created] (FLINK-29446) Remove Calcite classes which were fixed in 1.24

2022-09-28 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-29446: --- Summary: Remove Calcite classes which were fixed in 1.24 Key: FLINK-29446 URL: https://issues.apache.org/jira/browse/FLINK-29446 Project: Flink Issue T

[jira] [Created] (FLINK-29447) Add doc for federation query using Hive dialect

2022-09-28 Thread luoyuxia (Jira)
luoyuxia created FLINK-29447: Summary: Add doc for federation query using Hive dialect Key: FLINK-29447 URL: https://issues.apache.org/jira/browse/FLINK-29447 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-29448) Aggregate (Min/Max/Count) push down for ORC

2022-09-28 Thread dalongliu (Jira)
dalongliu created FLINK-29448: - Summary: Aggregate (Min/Max/Count) push down for ORC Key: FLINK-29448 URL: https://issues.apache.org/jira/browse/FLINK-29448 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-29449) Aggregate (Min/Max/Count) push down for Parquet

2022-09-28 Thread dalongliu (Jira)
dalongliu created FLINK-29449: - Summary: Aggregate (Min/Max/Count) push down for Parquet Key: FLINK-29449 URL: https://issues.apache.org/jira/browse/FLINK-29449 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-29450) Push down filter by partition column for Aggregate (Min/Max/Count) for Parquet

2022-09-28 Thread dalongliu (Jira)
dalongliu created FLINK-29450: - Summary: Push down filter by partition column for Aggregate (Min/Max/Count) for Parquet Key: FLINK-29450 URL: https://issues.apache.org/jira/browse/FLINK-29450 Project: Fli

[jira] [Created] (FLINK-29451) Push down group by partition column for Aggregate (Min/Max/Count) for Parquet and Orc

2022-09-28 Thread dalongliu (Jira)
dalongliu created FLINK-29451: - Summary: Push down group by partition column for Aggregate (Min/Max/Count) for Parquet and Orc Key: FLINK-29451 URL: https://issues.apache.org/jira/browse/FLINK-29451 Proje

Re: [VOTE] Apache Flink Table Store 0.2.1, release candidate #1

2022-09-28 Thread Jingsong Li
-1 https://issues.apache.org/jira/browse/FLINK-29345 brings orc bugs. The orc writer has memory management and needs to be initialized in the writing thread to avoid thread safety conflicts caused by memory management. Best, Jingsong On Tue, Sep 27, 2022 at 11:00 AM Jingsong Li wrote: > > Hi ev

Re: [DISCUSS] FLIP-262 MongoDB Connector

2022-09-28 Thread Qingsheng Ren
Thanks for the update Jiabao. c. It’ll be nice to have all metrics defined in FLIP-33 in the connector. Also it’s better to have some MongoDB specific metrics, which will be very helpful for users to monitor their jobs. Best, Qingsheng > On Sep 27, 2022, at 11:59, Jiabao Sun

[jira] [Created] (FLINK-29452) RetryOnExceptionExtensionTest is implemented in a way that doesn't allow the successful execution of individual tests

2022-09-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-29452: - Summary: RetryOnExceptionExtensionTest is implemented in a way that doesn't allow the successful execution of individual tests Key: FLINK-29452 URL: https://issues.apache.org/ji

[jira] [Created] (FLINK-29453) Add uidHash support to State Processor API

2022-09-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29453: Summary: Add uidHash support to State Processor API Key: FLINK-29453 URL: https://issues.apache.org/jira/browse/FLINK-29453 Project: Flink Issue Typ

[jira] [Created] (FLINK-29454) Deduplicate code in SavepointReader

2022-09-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29454: Summary: Deduplicate code in SavepointReader Key: FLINK-29454 URL: https://issues.apache.org/jira/browse/FLINK-29454 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-29455) Add OperatorIdentifier

2022-09-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29455: Summary: Add OperatorIdentifier Key: FLINK-29455 URL: https://issues.apache.org/jira/browse/FLINK-29455 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-29456) Add methods that acept OperatorIdentifier

2022-09-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29456: Summary: Add methods that acept OperatorIdentifier Key: FLINK-29456 URL: https://issues.apache.org/jira/browse/FLINK-29456 Project: Flink Issue Type:

[jira] [Created] (FLINK-29457) Add a uid(hash) remapping function

2022-09-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29457: Summary: Add a uid(hash) remapping function Key: FLINK-29457 URL: https://issues.apache.org/jira/browse/FLINK-29457 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-29458) When two tables have the same field, do not specify the table name,Exception will be thrown:SqlValidatorException :Column 'currency' is ambiguous

2022-09-28 Thread ZuoYan (Jira)
ZuoYan created FLINK-29458: -- Summary: When two tables have the same field, do not specify the table name,Exception will be thrown:SqlValidatorException :Column 'currency' is ambiguous Key: FLINK-29458 URL: https://issue

Re: [ANNOUNCE] Apache Flink 1.14.6 released

2022-09-28 Thread Jingsong Li
Thanks Xingbo for releasing it. Best, Jingsong On Wed, Sep 28, 2022 at 10:52 AM Xingbo Huang wrote: > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.14.6, which is the fifth bugfix release for the Apache Flink 1.14 > series. > > Apache Flink® is an open-

[VOTE] Apache Flink Kubernetes Operator Release 1.2.0, release candidate #1

2022-09-28 Thread Gyula Fóra
Hi everyone, Please review and vote on the release candidate #1 for the version 1.2.0 of Apache Flink Kubernetes Operator, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Release Overview** As an overview, the release consists of th

[DISCUSS] Repeatable cleanup of checkpoint data

2022-09-28 Thread Matthias Pohl
Hi everyone, I’d like to start a discussion on repeatable cleanup of checkpoint data. In FLIP-194 [1] we introduced repeatable cleanup of HA data along the introduction of the JobResultStore component. The goal was to make Flink being in charge of cleanup for the data it owns. The Flink cluster sh

Re: [VOTE] Release flink-shaded 16.0, release candidate #1

2022-09-28 Thread Gabor Somogyi
+1 (non-binding) * compiled from source * downloaded the artifacts * verified signatures * verified that the source archives do not contain any binaries G On Wed, Sep 28, 2022 at 8:58 AM Matthias Pohl wrote: > +1 (non-binding) > > * downloaded the artifacts > * compiled from source > * verifi

[jira] [Created] (FLINK-29459) Sink v2 has bugs in supporting legacy v1 implementations with global committer

2022-09-28 Thread Yun Gao (Jira)
Yun Gao created FLINK-29459: --- Summary: Sink v2 has bugs in supporting legacy v1 implementations with global committer Key: FLINK-29459 URL: https://issues.apache.org/jira/browse/FLINK-29459 Project: Flink

Re: Migrating Sink v1 to v2

2022-09-28 Thread Yun Gao
Hi Krzysztof, Very sorry for the long delay for it takes a bit of time to have a full investigation, the issue should be caused by the implementation bugs and I have filed an issue for the bugs. For the following actions, let's move to the thread of [2] for global synchronization. Very sorry for

Re: Migrating Sink v1 to v2

2022-09-28 Thread Krzysztof Chmielewski
Yun Gao, Thank you very much for this. Do you see this ticked be picked up any time soon? For a moment I was thinking about trying to take my change with it but I guessing it would be rather hard without deeper understanding of Flink's internals, plus its marked as "major" Regards, Krzysztof Chmi

Re: Sink V2 interface replacement for GlobalCommitter

2022-09-28 Thread Yun Gao
Hi all, Very sorry for the long delay for it took a bit of time to do the investigation. @Krzysztof For the current unexpected behavior of GlobalCommitter after failover, it is indeed caused by the bugs in implementation, I filed an issue[1] for these bugs and I think we may fix the issue for 1

Re: Migrating Sink v1 to v2

2022-09-28 Thread Yun Gao
Hi Krzysztof, I'll continue tracking the issue and hopefully it could be fixed before the next minor releases for 1.15.x, 1.16.x and 1.17. Best, Yun Gao -- From:Krzysztof Chmielewski Send Time:2022 Sep. 28 (Wed.) 23:46 To:dev ; Yun G

Re: Sink V2 interface replacement for GlobalCommitter

2022-09-28 Thread Steven Wu
Yun, > `writer (parallelism = n) -> committer (parallelism = 1)` Yes, a single-parallelism committer would work for Iceberg (and probably other similar global transaction storage). This is how Iceberg sink is implemented today. > When we are refactoring the job finish process in FLIP-147 toensur

[jira] [Created] (FLINK-29460) HsResultPartitionTest.testRelease failed with AssertionFailedError

2022-09-28 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-29460: Summary: HsResultPartitionTest.testRelease failed with AssertionFailedError Key: FLINK-29460 URL: https://issues.apache.org/jira/browse/FLINK-29460 Project: Flink

[jira] [Created] (FLINK-29461) ProcessDataStreamStreamingTests.test_process_function unstable

2022-09-28 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-29461: Summary: ProcessDataStreamStreamingTests.test_process_function unstable Key: FLINK-29461 URL: https://issues.apache.org/jira/browse/FLINK-29461 Project: Flink

[jira] [Created] (FLINK-29462) LookupJoinITCase failed on azure due to classloader leaking

2022-09-28 Thread Yun Gao (Jira)
Yun Gao created FLINK-29462: --- Summary: LookupJoinITCase failed on azure due to classloader leaking Key: FLINK-29462 URL: https://issues.apache.org/jira/browse/FLINK-29462 Project: Flink Issue Type

[jira] [Created] (FLINK-29463) InputFormatCacheLoaderTest.checkCounter failed with AssertionError

2022-09-28 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-29463: Summary: InputFormatCacheLoaderTest.checkCounter failed with AssertionError Key: FLINK-29463 URL: https://issues.apache.org/jira/browse/FLINK-29463 Project: Flink