Re: Re: [DISCUSS] FLIP-415: Introduce a new join operator to support minibatch

2024-01-12 Thread Jane Chan
Hi shuai, Thanks for the update! Regarding the newly introduced configuration, I hold the same concern with Benchao and Xuyang. First of all, in most cases, the fact that users choose to enable mini-batch configuration indicates they are aware of the trade-off between throughput and completeness

Re: [FLIP-412] Add the time-consuming span of each stage when starting the Flink job to TraceReporter

2024-01-12 Thread Eason Qin
Thank you, Piotr and Rui. Best, Eason Rui Fan <1996fan...@gmail.com> 于2024年1月12日周五 12:42写道: > The permission is added by Piotr, thank you Piotr. > > Best, > Rui > > On Thu, Jan 11, 2024 at 9:15 PM Eason Qin wrote: > > > Hi all, > > > > Currently, I am working on the FLIP-412: Add the time-consu

Re: [VOTE] Release 1.18.1, release candidate #2

2024-01-12 Thread Jing Ge
Thank you all! I will post the vote result soon. Best regards, Jing On Wed, Jan 10, 2024 at 12:34 PM Sergey Nuyanzin wrote: > +1 (non-binding) > > -verified checksums > -verified signatures > -checked release tag > -verified that there is no binary in source > -built from sources > > On Wed, Ja

Re: [ANNOUNCE] Apache Flink-shaded 18.0 released

2024-01-12 Thread Matthias Pohl
Thanks for driving this release, Sergey. I reported it to the Apache foundation based on the release information in Jira [1]. [1] https://issues.apache.org/jira/projects/FLINK/versions/12353081 On Fri, Jan 12, 2024 at 1:01 AM Sergey Nuyanzin wrote: > The Apache Flink community is very happy to

Re: [DISCUSS] FLIP-415: Introduce a new join operator to support minibatch

2024-01-12 Thread shuai xu
Hi all. The point I want to highlight is that minibatch join could potentially yield incomplete changelog which existing jobs are not supposed to be. For example, the scenario that joins two CDC sources after de-duplicating them and the output would be used for audit analysis could not accept

[RESULT] [VOTE] Release 1.18.1, release candidate #2

2024-01-12 Thread Jing Ge
I'm happy to announce that we have unanimously approved this release. There are 10 approving votes, 4 of which are binding: - Jiabao Sun - Hang Ruan - Gongzhong Qiang - Martijn Visser (binding) - Rui Fan - Yun Tang - Jark Wu (binding) - Qingsheng Ren (binding) - Leonard Xu (binding) - Sergey Nuya

Re: [VOTE] Release flink-connector-hbase, release candidate #1

2024-01-12 Thread Martijn Visser
Hi Sergey, Yep, you're right. I used the wrong JDK when building :( I'll cancel this RC and make a new one! Thanks, Martijn On Wed, Jan 10, 2024 at 10:20 PM Sergey Nuyanzin wrote: > > Thanks for driving this Martijn > > based on the info in MANIFEST.MF of jars it seems it was built with jdk11

[jira] [Created] (FLINK-34068) build_wheels_on_macos fails due to OSError

2024-01-12 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34068: - Summary: build_wheels_on_macos fails due to OSError Key: FLINK-34068 URL: https://issues.apache.org/jira/browse/FLINK-34068 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-34069) build_wheels_on_macos times out and gets cancelled

2024-01-12 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34069: - Summary: build_wheels_on_macos times out and gets cancelled Key: FLINK-34069 URL: https://issues.apache.org/jira/browse/FLINK-34069 Project: Flink Issue Ty

[jira] [Created] (FLINK-34070) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails for the AdaptiveScheduler

2024-01-12 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34070: - Summary: MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails for the AdaptiveScheduler Key: FLINK-34070 URL: https://issues.apache.org/jira/browse/FLINK-34070

[VOTE] Release flink-connector-hbase v3.0.1, release candidate #2

2024-01-12 Thread Martijn Visser
Hi everyone, Please review and vote on the release candidate #2 for the flink-connector-hbase version 3.0.1, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This version is compatible with Flink 1.16.x, 1.17.x and 1.18.x The complete s

[VOTE] Release flink-connector-rabbitmq, v3.0.2 release candidate #1

2024-01-12 Thread Martijn Visser
Hi everyone, Please review and vote on the release candidate #1 for the version 3.0.2, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This version is compatible with Flink 1.16.x, 1.17.x and 1.18.x. The complete staging area is availa

Re: [VOTE] Release flink-connector-opensearch v1.1.0, release candidate #1

2024-01-12 Thread Martijn Visser
One non blocking nit: the version for flink.version in the main POM is set to 1.17.1. I think this should be 1.17.0 (since that's the lowest possible Flink version that's supported). +1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Bui

Re:Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-12 Thread Zhijiang
+1 (binding) Best, Zhijiang -- From:Kurt Yang Send Time:2024年1月12日(星期五) 15:31 To:dev Subject:Re: Re: Re: [VOTE] Accept Flink CDC into Apache Flink +1 (binding) Best, Kurt On Fri, Jan 12, 2024 at 2:21 PM Hequn Cheng wrote: > +1 (bindi

Re: Flink pending record metric weired after autoscaler rescaling

2024-01-12 Thread Gyula Fóra
Could this be related to the issue reported here? https://issues.apache.org/jira/browse/FLINK-34063 Gyula On Wed, Jan 10, 2024 at 4:04 PM Yang LI wrote: > Just to give more context, my setup uses Apache Flink 1.18 with the > adaptive scheduler enabled, issues happen randomly particularly > post

Re: [VOTE] Release flink-connector-opensearch v1.1.0, release candidate #1

2024-01-12 Thread Danny Cranmer
Thanks all, this vote is now closed, I will announce the results on a separate thread. Thanks, Danny On Fri, Jan 12, 2024 at 3:43 PM Danny Cranmer wrote: > +1 (binding) > > - Verified signatures and checksums > - Reviewed release notes > - Verified no binaries in the source archive > - Source b

Re: [VOTE] Release flink-connector-opensearch v1.1.0, release candidate #1

2024-01-12 Thread Danny Cranmer
+1 (binding) - Verified signatures and checksums - Reviewed release notes - Verified no binaries in the source archive - Source builds using Maven - Reviewed NOTICE files (I suppose the copyright needs to be 2024 now!) Thanks, Danny On Fri, Jan 12, 2024 at 12:56 PM Martijn Visser wrote: > One

Re: Flink pending record metric weired after autoscaler rescaling

2024-01-12 Thread Yang LI
Yes, https://issues.apache.org/jira/browse/FLINK-34063 does match quite well the issues I have encountered. I'll leave a comment in that ticket then. Thanks, Yang On Fri, 12 Jan 2024 at 15:39, Gyula Fóra wrote: > Could this be related to the is

Re: [VOTE] Release flink-connector-opensearch v1.1.0, release candidate #1

2024-01-12 Thread Danny Cranmer
Apologies I jumped the gun on this one. We only have 2 binding votes. Reopening the thread. On Fri, Jan 12, 2024 at 3:43 PM Danny Cranmer wrote: > Thanks all, this vote is now closed, I will announce the results on a > separate thread. > > Thanks, > Danny > > On Fri, Jan 12, 2024 at 3:43 PM Dann

Re: Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-12 Thread Becket Qin
+1 (binding) Thanks, Jiangjie (Becket) Qin On Fri, Jan 12, 2024 at 5:58 AM Zhijiang wrote: > +1 (binding) > Best, > Zhijiang > -- > From:Kurt Yang > Send Time:2024年1月12日(星期五) 15:31 > To:dev > Subject:Re: Re: Re: [VOTE] Accept Fli

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.2, release candidate #2

2024-01-12 Thread Danny Cranmer
+1 (binding) - Verified signatures and checksums - Reviewed release notes - Verified contents of Maven repo - Verified no binaries in the source archive - Source builds using Maven - Reviewed NOTICE files (I suppose the copyright needs to be 2024 now!) - Verified the tag exists in Github Thanks,

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.2, release candidate #2

2024-01-12 Thread Danny Cranmer
Thanks all, This vote is now closed, I will announce the results in a separate thread. Danny. On Fri, Jan 12, 2024 at 4:53 PM Danny Cranmer wrote: > +1 (binding) > > - Verified signatures and checksums > - Reviewed release notes > - Verified contents of Maven repo > - Verified no binaries in t

[RESULT][VOTE] flink-connector-gcp-pubsub v3.0.2, release candidate #2

2024-01-12 Thread Danny Cranmer
I'm happy to announce that we have unanimously approved this release. There are 4 approving votes, 3 of which are binding: * Leonard Xu (binding) * Martijn Visser (binding) * Rui Fan * Danny Cranmer (binding) There are no disapproving votes. Thanks everyone! Danny

[ANNOUNCE] Apache flink-connector-gcp-pubsub 3.0.2 released

2024-01-12 Thread Danny Cranmer
The Apache Flink community is very happy to announce the release of Apache flink-connector-gcp-pubsub v3.0.2 with support for Flink 1.17 and 1.18. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming application

Re: Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-12 Thread Austin Bennett
+1 (non-binding) On Fri, Jan 12, 2024 at 5:44 PM Becket Qin wrote: > +1 (binding) > > Thanks, > > Jiangjie (Becket) Qin > > On Fri, Jan 12, 2024 at 5:58 AM Zhijiang .invalid> > wrote: > > > +1 (binding) > > Best, > > Zhijiang > > -

Re: Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-12 Thread Dong Lin
+1 (binding) On Sat, Jan 13, 2024 at 6:04 AM Austin Bennett wrote: > +1 (non-binding) > > On Fri, Jan 12, 2024 at 5:44 PM Becket Qin wrote: > > > +1 (binding) > > > > Thanks, > > > > Jiangjie (Becket) Qin > > > > On Fri, Jan 12, 2024 at 5:58 AM Zhijiang > .invalid> > > wrote: > > > > > +1 (bin

Re: Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-12 Thread Rodrigo Meneses
+1 (non binding) On Fri, Jan 12, 2024 at 5:45 PM Dong Lin wrote: > +1 (binding) > > On Sat, Jan 13, 2024 at 6:04 AM Austin Bennett wrote: > > > +1 (non-binding) > > > > On Fri, Jan 12, 2024 at 5:44 PM Becket Qin wrote: > > > > > +1 (binding) > > > > > > Thanks, > > > > > > Jiangjie (Becket) Qi

Re: [VOTE] Release flink-connector-hbase v3.0.1, release candidate #2

2024-01-12 Thread Hang Ruan
+1 (non-binding) - Validated checksum hash - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven and jdk11 - Verified web PR Best, Hang Martijn Visser 于2024年1月12日周五 20:30写道: > Hi everyone, > Please review and vote on the release candidate #2