Re: [VOTE] Release 1.19.3, release candidate #1

2025-06-02 Thread Ferenc Csaky
am not saying we should move forward, the GH CI is still in beta, so we should definitely fix the Azure CI and get a green run, but we should not drop RC1 yet. Best, Ferenc [1] https://github.com/apache/flink/actions/runs/15382501322 [2] https://github.com/ferenc-csaky/flink/actions/runs

Re: [VOTE] Release 1.19.3, release candidate #1

2025-05-30 Thread Ferenc Csaky
25? > > > > Not sure if it might block the release... > > > > [1] https://dev.azure.com/apache-flink/apache-flink/_build?definitionId=1 > > > > Best regards, > > Sergey > > > > On Fri, May 30, 2025, 13:29 Ferenc Csaky ferenc.cs...@pm.me.invalid w

[VOTE] Release 1.20.2, release candidate #1

2025-05-30 Thread Ferenc Csaky
Hi everyone, Please review and vote on the release candidate #1 for the version 1.20.2, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

[VOTE] Release 1.19.3, release candidate #1

2025-05-30 Thread Ferenc Csaky
Hi everyone, Please review and vote on the release candidate #1 for the version 1.19.3, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Re: [DISCUSS] Decouple PyFlink wheel package build from Azure

2025-05-29 Thread Ferenc Csaky
> is very old (CentOS 5 (2007)) and deprecated > > I would vote one migration but it would require quite some testing. > > * Do I understand correctly that all wheels are intended to be built such a > > way or just part of it? > > > > BR, > > G > >

[DISCUSS] Decouple PyFlink wheel package build from Azure

2025-05-28 Thread Ferenc Csaky
for building wheel files, cause it a lot simpler, and does not depend on anything other than GitHub. WDYT? Best, Ferenc [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=73631092#CreatingaFlinkRelease-BuildandstageJavaandPythonartifacts [2] https://github.com/ferenc-csaky

Re: [DISCUSS] Deprecating/dropping support for Python 3.8

2025-05-28 Thread Ferenc Csaky
Solid +1 for dropping instead of deprecate. Best, Ferenc On Wednesday, May 28th, 2025 at 07:12, Gabor Somogyi wrote: > > > Hi Mika, > > +1 to drop and not just deprecate from my side. > > BR, > G > > > On Wed, May 28, 2025 at 7:06 AM Dian Fu dian0511...@gmail.com wrote: > > > Hi Mika,

Re: Getting "sun.rmi.registry is not visible" exception while running main method of CliFrontend.java class of flink-clients package

2025-05-26 Thread Ferenc Csaky
Hi, What branch and JDK version are you using? Is should not be necessary to configure `--add-opens` by hand. In the past, I ran into problems like this, when I was moving back and forth between JDK versions, and sometimes the IDE can stuck in a confused state. In general, I would suggest to i

[jira] [Created] (FLINK-37820) AsyncScalarFunction UDFs cannot be loaded via CompiledPlan

2025-05-20 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37820: Summary: AsyncScalarFunction UDFs cannot be loaded via CompiledPlan Key: FLINK-37820 URL: https://issues.apache.org/jira/browse/FLINK-37820 Project: Flink

[DISCUSS] Flink 1.19.3 release

2025-05-08 Thread Ferenc Csaky
Hello devs, I would like to start a discussion about the next patch release for 1.19. The 1.19.2 version was released almost 3 months ago, and although we do not have tons of commits since then, I think the Parquet CVE fix would be good to be released ASAP [1]. If there are no objections to the r

[DISCUSS] Flink 1.20.2 release

2025-05-08 Thread Ferenc Csaky
Hello devs, I would like to start a discussion about the next patch release for 1.20. The 1.20.1 version was released almost 3 months ago, and there are several fixes since then, some of them mitigates security vulnerabilities [1]. If there are no objections to the release, I would like to volunt

Re: Flink Operator 1.12 release planning

2025-05-08 Thread Ferenc Csaky
Hi G, Thanks for starting the discussion! The delivered items, the given timeline, and the release cadence (1.11 released early March) makes sense to me. +1 for the release and release manager. Thanks, Ferenc On Thursday, May 8th, 2025 at 09:19, Gabor Somogyi wrote: > > > Hi All! > > I

Re: [VOTE] FLIP-520: Simplify StructuredType handling

2025-05-06 Thread Ferenc Csaky
+1 (binding) Thanks for driving this! Best, Ferenc On Tuesday, May 6th, 2025 at 14:50, Sergey Nuyanzin wrote: > > > Thank you for driving this > +1 (binding) > > On Tue, May 6, 2025, 12:04 Timo Walther twal...@apache.org wrote: > > > Hi everyone, > > > > I'd like to start a vote on FLI

Re: [DISCUSS] FLIP-516: Multi-Way Join Operator

2025-05-06 Thread Ferenc Csaky
Hi, I think the FLIP is in a fairly good state, +1 for the idea and the given design. This may be considered already, but IMO we should also add some high-level details, pros, and cons of enabling this feature to the website other than the config option description. Best, Ferenc On Friday, Ma

Re: [DISCUSS] FLIP-529 Connections in Flink SQL and Table API

2025-05-01 Thread Ferenc Csaky
Hi Mayank, Thank you for starting the discussion! In general, I think such functionality would be a really great addition to Flink. Could you pls. elaborate a bit more one what is the reason of defining a `connection` resource on the database level instead of the catalog level? If I think about `

Re: [VOTE] Apache Flink CDC Release 3.4.0, release candidate #3

2025-05-01 Thread Ferenc Csaky
+1 (non-binding) - verified signature and hashes - checked no binaries in source release - checked staging repository - reviewed Jira release notes - verified GH tag - reviewed web PR Thanks, Ferenc On Thursday, May 1st, 2025 at 04:38, Xiqian YU wrote: > > > Thanks Kunni for preparing this

Re: [VOTE] FLIP-518: Introduce a community review process

2025-05-01 Thread Ferenc Csaky
+1 (binding) Thanks for driving this! Best, Ferenc On Tuesday, April 29th, 2025 at 10:40, David Radley wrote: > > > As below – starting a new vote thread (thanks @Robert > Metzgermailto:rmetz...@apache.org). > > > I'd like to start a vote for FLIP-518: Introduce a community review > p

Re: [VOTE] FLIP-524: CloudWatch Metric Sink Connector

2025-04-21 Thread Ferenc Csaky
+1 (binding) Thanks for driving this! On Friday, April 18th, 2025 at 16:57, Robert Metzger wrote: > > > +1 (binding) > > On Wed, Apr 16, 2025 at 10:39 AM Daren Wong darenwkt@gmail.com wrote: > > > Hi devs, > > > > Thank you everyone for the feedback on FLIP-524: CloudWatch Metric Sin

Re: [VOTE] Release flink-connector-jdbc v3.3.0, release candidate #2

2025-04-19 Thread Ferenc Csaky
Glad to see this release happening! +1 (non-binding) - verified signatures and hashes - checked no binaries in source release - built from source with JDK11 & Maven 3.8.6 - verified artifacts in staging repo - checked release notes - verified GH tag and CI - reviewed web PR On Friday, April 18t

[jira] [Created] (FLINK-37690) Fix flaky Kudu test table datagen

2025-04-16 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37690: Summary: Fix flaky Kudu test table datagen Key: FLINK-37690 URL: https://issues.apache.org/jira/browse/FLINK-37690 Project: Flink Issue Type: Technical Debt

[ANNOUNCE] Apache flink-connector-kudu 2.0.0 released

2025-04-14 Thread Ferenc Csaky
The Apache Flink community is very happy to announce the release of Apache flink-connector-kudu 2.0.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available for download at

[jira] [Created] (FLINK-37664) Intergra Kudu connector docs

2025-04-11 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37664: Summary: Intergra Kudu connector docs Key: FLINK-37664 URL: https://issues.apache.org/jira/browse/FLINK-37664 Project: Flink Issue Type: New Feature

[RESULT][VOTE] Release flink-connector-kudu v2.0.0, release candidate #1

2025-04-09 Thread Ferenc Csaky
Hi everyone, I am happy to announce that we have unanimously approved this release. There are 6 approving votes, 3 of which are binding: - Gyula Fora (binding) - Zakelly Lan (binding) - Mate Czagany (non-binding) - Xiqian Yu (non-binding) - Yanquan Lv (non-binding) - Marton Balassi (binding) Th

Re: [VOTE] Release flink-connector-kudu v2.0.0, release candidate #1

2025-04-09 Thread Ferenc Csaky
ecked: > > - Review JIRA release notes > > - Verify hashes and verify signatures > > - Build success from source with JDK11 & maven3.8.6 > > - Source code artifacts matching the current release > > - Read the announcement blog and LGTM > > > > Ferenc Csaky feren

Re: [VOTE] Release flink-connector-elasticsearch v3.1.0, release candidate #1

2025-04-09 Thread Ferenc Csaky
+1 (non-binding) - verified checksum and signature - checked no binaries in the source archive - built source with JDK11 + Maven 3.8.6 - verified release tag, CI, and staging repo - reviewed web PR Best, Ferenc On Wednesday, April 9th, 2025 at 12:25, Xiqian YU wrote: > > > +1 (non-binding)

Re: Kafka connector 4.0.0 release

2025-04-08 Thread Ferenc Csaky
+1 for the release and the release manager. Thanks for driving this. Best, Ferenc On Tuesday, April 8th, 2025 at 05:06, Leonard Xu wrote: > > > +1, thanks @Arvid for driving this release! > > Best, > Leonard > > > 2025 4月 7 18:02,Tom Cooper c...@tomcooper.dev 写道: > > > > +1 from me. Than

Re: [ANNOUNCE] New Apache Flink PMC Member - Sergey Nuyanzin

2025-04-06 Thread Ferenc Csaky
Congrats, Sergey! Best, Ferenc On Monday, April 7th, 2025 at 03:30, weijie guo wrote: > > > Congratulations, Sergey~ > > Best regards, > > Weijie > > > Lincoln Lee lincoln.8...@gmail.com 于2025年4月3日周四 18:14写道: > > > Congratulations, Sergey! > > > > Best, > > Lincoln Lee > > > > Yuepen

Re: Re: [VOTE] FLIP-512: Add meta information to SQL state connector

2025-04-05 Thread Ferenc Csaky
+1 (binding) Best, Ferenc On Monday, March 31st, 2025 at 13:06, Rui Fan <1996fan...@gmail.com> wrote: > > > +1(binding) > > Best, > Rui > > On Mon, Mar 31, 2025 at 5:42 PM Andrei Kaigorodov < > andreykaygoro...@gmail.com> wrote: > > > +1 (non-binding) > > > > Best regards, > > > > Andr

Re: [EXTERNAL] Re: Executing PyFlink Cluster

2025-04-02 Thread Ferenc Csaky
AFAIK the standard YAML config possibility were introduced in Flink 1.19, it just coexisted with the old solution to keep bw compatibility in the 1.x line. If we bp it to 1.20, it's not much overhead to move it over to 1.19 as well I guess. WDYT? On Wednesday, April 2nd, 2025 at 17:23, Gabor S

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

2025-04-01 Thread Ferenc Csaky
Congratulations! Best, Ferenc On Tuesday, April 1st, 2025 at 11:59, yue ma wrote: > > > Congratulation, Zakelly! > > Junrui Lee jrlee@gmail.com 于2025年4月1日周二 17:38写道: > > > Congratulation, Zakelly! > > > > Best, > > Junrui > > > > Leonard Xu xbjt...@gmail.com 于2025年4月1日周二 17:22写道: >

Re: CHI: Add liiniting checks to all PRs

2025-03-28 Thread Ferenc Csaky
Hi Tom, Big +1 for this. On a slightly different note, do we know why the CI run is still in beta? I see that it currently fails because of Python problems, but AFAIK it was not really touched for quite some time. Is it just needs some more development time, or we have resource limitations, maybe

[VOTE] Release flink-connector-kudu v2.0.0, release candidate #1

2025-03-28 Thread Ferenc Csaky
Hi everyone, Please review and vote on release candidate #1 for flink-connector-kudu v2.0.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes

Re: [DISCUSS] Release externalized Kudu connector

2025-03-25 Thread Ferenc Csaky
By starting the release process I meant the steps to create a RC, but the wording was confusing. On Tuesday, March 25th, 2025 at 12:09, Ferenc Csaky wrote: > > > Thank you all for the inputs! If no objections until then, > I will start the release process in Thursday (03-27).

Re: [DISCUSS] Release externalized Kudu connector

2025-03-25 Thread Ferenc Csaky
rt Flink 1.19 and 1.20 (maybe 2.0 soon) and > > > thanks for volunteering as the release manager. > > > > > > Cheers, > > > Marton > > > > > > On Fri, Mar 21, 2025 at 1:00 PM Ferenc Csaky > > > > > wrote: > > > > >

Re: [VOTE] FLIP-503: Blue/Green Deployments for Flink on Kubernetes: Phase 1 (basic)

2025-03-21 Thread Ferenc Csaky
+1 (binding) Thanks, Ferenc On Friday, March 21st, 2025 at 14:48, Őrhidi Mátyás wrote: > > > +1 (binding) > > On Thu, Mar 20, 2025 at 12:22 AM Gyula Fóra gyf...@apache.org wrote: > > > +1 (binding) > > > > And a gentle reminder to please vote :) > > > > Cheers, > > Gyula > > > > On T

[DISCUSS] Release externalized Kudu connector

2025-03-21 Thread Ferenc Csaky
Hello devs, I would like to start a discussion to release the externalized Kudu connector. To make anyone up to date regarding what happened until now and why, let me summarize the story. Originally, the Kudu connector was part of the Bahir Flink [1] repository, but it was moved into the attic

[jira] [Created] (FLINK-37527) Add `KuduSource` documentation

2025-03-20 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37527: Summary: Add `KuduSource` documentation Key: FLINK-37527 URL: https://issues.apache.org/jira/browse/FLINK-37527 Project: Flink Issue Type: New Feature

Re: [VOTE] Release 2.0.0, release candidate #2

2025-03-12 Thread Ferenc Csaky
+1 (non-binding) - Verified signatures and checksums - Checked GH release tag - Built src with JDK21 and Maven 3.8.6 - Deployed TopSpeedWindowing example to standalone cluster - Ran dummy datagen SELECT via SQL client on standalone cluster - Checked web PR that has quite some comments from David,

Re: [VOTE] Release flink-connector-mongodb v2.0.0, release candidate #2

2025-03-11 Thread Ferenc Csaky
+1 (non-binding) - Verified checksums and signatures - Built source with JDK8 and Maven 3.8.6 - Reviewed web PR Thanks, Ferenc On Tuesday, March 11th, 2025 at 09:17, Robert Metzger wrote: > > > +1 (binding) > > - Source archive looks ok (no binaries, maven builds, versions in pom seem >

[jira] [Created] (FLINK-37394) Update CI Flink versions to 1.19 and 1.20 in Kudu connector

2025-02-26 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37394: Summary: Update CI Flink versions to 1.19 and 1.20 in Kudu connector Key: FLINK-37394 URL: https://issues.apache.org/jira/browse/FLINK-37394 Project: Flink

[jira] [Created] (FLINK-37389) Add "flink-sql-connector-kudu" module

2025-02-26 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37389: Summary: Add "flink-sql-connector-kudu" module Key: FLINK-37389 URL: https://issues.apache.org/jira/browse/FLINK-37389 Project: Flink Issue Type

Re: [DISCUSS] Adding API stability annotations (@Experimental, @PublicEvolving) to PyFlink APIs

2025-02-20 Thread Ferenc Csaky
Hi, Thanks for starting this discussion. +1 for the proposal and Timo's addendum regarding the deprecation warning. Best, Ferenc On Thursday, February 20th, 2025 at 11:30, Timo Walther wrote: > > > Hi Mika, > > thanks for bringing this up! I was actually quite surprised that we > don't us

[jira] [Created] (FLINK-37364) Bump Flink 1.19, 1.20 patch versions in Flink CDC

2025-02-20 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37364: Summary: Bump Flink 1.19, 1.20 patch versions in Flink CDC Key: FLINK-37364 URL: https://issues.apache.org/jira/browse/FLINK-37364 Project: Flink Issue Type

Re: [ANNOUNCE] Apache Flink 1.20.1 released

2025-02-19 Thread Ferenc Csaky
Congrats to everyone involved! Thanks Alex for managing the release! Best, Ferenc On Wednesday, February 19th, 2025 at 15:56, Alexander Fedulov wrote: > > > I would also like to explicitly thank Ferenc Csaky, Sergey Nuyanzin, > Matthias Pohl, Marton Balassi, Max Michels, and

Re: [ANNOUNCE] Apache Flink 1.19.2 released

2025-02-19 Thread Ferenc Csaky
Congrats to everyone involved! Thanks Alex for managing the release! Best, Ferenc On Wednesday, February 19th, 2025 at 15:59, Alexander Fedulov wrote: > > > I would also like to explicitly thank Ferenc Csaky, Sergey Nuyanzin, > Matthias Pohl, Marton Balassi, Max Michels, and

Re: Flink 1.18.2 release date

2025-02-18 Thread Ferenc Csaky
Hi, according to a past discussion [1] at the end of January 2025, the 1.18 CI pipeline got disabled, so there is no plan to release 1.18.2. Best, Ferenc [1] https://lists.apache.org/thread/5onl01vt98452vyj4x6flvdq8601fdo7 On Friday, February 14th, 2025 at 11:05, Yang LI wrote: > > > Dear

Re: [VOTE] Release 1.20.1, release candidate #1

2025-01-31 Thread Ferenc Csaky
+1 (non-binding) - verified signatures - verified hashsums - checked GH release tag - checked no binaries in source archives - built the source with jdk8 and maven 3.8.6 - reviewed web PR - deployed WordCount job to local cluster Thanks, Ferenc On Friday, January 31st, 2025 at 00:39, Yanquan

Re: Flink Operator 1.11 release planning

2025-01-31 Thread Ferenc Csaky
+1 for the proposal and the given timeline, really looking forward to see 2.0 support in the operator. Best, Ferenc On Friday, January 31st, 2025 at 10:27, Gyula Fóra wrote: > > > Hi All! > > I would like to kick off the release planning for the 1.11 operator release. > > I think the cod

Re: [VOTE] Release 1.19.2, release candidate #1

2025-01-30 Thread Ferenc Csaky
+1 (non-binfing) - verified signatures - verified hashsums - checked GH release tag - checked no binaries in source archives - built the source with jdk8 and maven 3.8.6 - reviewed web PR - deployed WordCount job to local cluster Thanks, Ferenc On Thursday, January 30th, 2025 at 03:22, Yanqua

[jira] [Created] (FLINK-37237) Enforce SQL PRIMARY KEY definition for Kudu tables and remove table option

2025-01-29 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37237: Summary: Enforce SQL PRIMARY KEY definition for Kudu tables and remove table option Key: FLINK-37237 URL: https://issues.apache.org/jira/browse/FLINK-37237 Project

[jira] [Created] (FLINK-37230) Consolidate Kudu connector table options

2025-01-27 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37230: Summary: Consolidate Kudu connector table options Key: FLINK-37230 URL: https://issues.apache.org/jira/browse/FLINK-37230 Project: Flink Issue Type

Re: [Discuss] Flink CDC 3.4 Kick Off

2025-01-22 Thread Ferenc Csaky
+1, looking forward to these changes! Best, Ferenc On Wednesday, January 22nd, 2025 at 10:56, Leonard Xu wrote: > > > +1 for the proposed code freeze date > > Best, > Leonard > > > 2025年1月22日 15:41,ConradJam jam.gz...@gmail.com 写道: > > > > +1 > > > > Yanquan Lv decq12y...@gmail.com 于20

Re: Upgrade to Netty 4.x (1.19.2, 1.20.1 releases)

2025-01-21 Thread Ferenc Csaky
nd wait for a new Pekko release that > > > allows isolated Netty settings solely for flink-rpc: > > > Pros: > > > - Resolves the CVEs > > > - Memory usage similar to Netty 3, reducing the risk of OOM surprises > > > for users > > > Cons: > > >

[jira] [Created] (FLINK-37190) Make Kudu `FlushMode` configurable in Flink SQL

2025-01-21 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37190: Summary: Make Kudu `FlushMode` configurable in Flink SQL Key: FLINK-37190 URL: https://issues.apache.org/jira/browse/FLINK-37190 Project: Flink Issue Type

Re: Upgrade to Netty 4.x (1.19.2, 1.20.1 releases)

2025-01-20 Thread Ferenc Csaky
ke time for the new Pekko release > > [1] https://github.com/apache/pekko/pull/1709#issuecomment-2599698240 > > Unless we can hope for a timely Pekko release, my vote would be to go ahead > with option 2 and clearly document the potential need for increasing > container memory limit

Re: Upgrade to Netty 4.x (1.19.2, 1.20.1 releases)

2025-01-20 Thread Ferenc Csaky
Since `flink-runtime` uses Netty4 for quite a while, I believe enforcing UNPOOLED will affect shuffle performance. I did not performed actual tests comparing Netty3 and Netty4 in this regard, so I cannot back this with actual numbers, but I think losing shuffle performance would affect more real-wo

Re: Upgrade to Netty 4.x (1.19.2, 1.20.1 releases)

2025-01-16 Thread Ferenc Csaky
Thanks for the summary Alex! +1 to keep Netty4. Best, Ferenc On Thursday, January 16th, 2025 at 17:02, Tom Cooper wrote: > > > + 1 on keeping the upgraded Pekko for 1.20.1. > > From what I could see, the only issues occurred in a end-to-end test that set > the available memory to 7MB. >

[jira] [Created] (FLINK-37152) Update Flink version to 1.20 in Flink CDC

2025-01-16 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37152: Summary: Update Flink version to 1.20 in Flink CDC Key: FLINK-37152 URL: https://issues.apache.org/jira/browse/FLINK-37152 Project: Flink Issue Type

Re: [VOTE] FLIP-496: SQL connector for keyed state data

2025-01-11 Thread Ferenc Csaky
+1 (binding) Looking forward to this! Best, Ferenc On Friday, January 10th, 2025 at 12:28, Márton Balassi wrote: > > > +1 (binding) > > Thanks, G. > > On Thu, Jan 9, 2025 at 4:17 PM Zakelly Lan zakelly@gmail.com wrote: > > > +1 (binding) > > > > Thanks for driving this. > > > >

[jira] [Created] (FLINK-37100) Fix test_netty_shuffle_memory_control.sh in CI for JDK11+

2025-01-10 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37100: Summary: Fix test_netty_shuffle_memory_control.sh in CI for JDK11+ Key: FLINK-37100 URL: https://issues.apache.org/jira/browse/FLINK-37100 Project: Flink

[jira] [Created] (FLINK-37099) Document possible Netty4 configurations to setup Pekko properly in JDK11+

2025-01-10 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37099: Summary: Document possible Netty4 configurations to setup Pekko properly in JDK11+ Key: FLINK-37099 URL: https://issues.apache.org/jira/browse/FLINK-37099 Project

Re: Memory leak in pekko's Netty 4 transport.

2025-01-08 Thread Ferenc Csaky
Hi, I spent some time on this issue and gathered my findings here [1]. ConradJam, if you have some time, can you mayve try to run your job with the following dynamic params added to `env.java.opts.taskmanager` in `config.yaml`: -Dorg.apache.flink.shaded.netty4.io.netty.tryReflectionSetAccessib

[jira] [Created] (FLINK-36855) Implement Source API in Kudu connector

2024-12-05 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-36855: Summary: Implement Source API in Kudu connector Key: FLINK-36855 URL: https://issues.apache.org/jira/browse/FLINK-36855 Project: Flink Issue Type: New

[jira] [Created] (FLINK-36839) Update Kudu version to 1.17.1

2024-12-03 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-36839: Summary: Update Kudu version to 1.17.1 Key: FLINK-36839 URL: https://issues.apache.org/jira/browse/FLINK-36839 Project: Flink Issue Type: Improvement

[ANNOUNCE] Apache flink-connector-hbase 4.0.0 released

2024-12-03 Thread Ferenc Csaky
The Apache Flink community is very happy to announce the release of Apache flink-connector-hbase 4.0.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available for download a

Re: [DISCUSS] Flink 1.20.1 release

2024-11-24 Thread Ferenc Csaky
+1 for the release and the release manager. Best, Ferenc On Friday, November 22nd, 2024 at 16:51, Rui Fan <1996fan...@gmail.com> wrote: > > > Thanks Alex for driving this release! > > +1 for this release and release manager. > > Best, > Rui > > On Fri, Nov 22, 2024 at 10:41 PM Alexander

Re: [DISCUSS] Flink 1.19.2 release

2024-11-24 Thread Ferenc Csaky
+1 for the release and the release manager Best, Ferenc On Friday, November 22nd, 2024 at 16:50, Rui Fan <1996fan...@gmail.com> wrote: > > > Thanks Alex for driving this release! > > +1 for this release and release manager. > > Best, > Rui > > On Fri, Nov 22, 2024 at 10:36 PM Alexander F

[RESULT][VOTE] Release flink-connector-hbase v4.0.0, release candidate #1

2024-11-24 Thread Ferenc Csaky
I am happy to announce that we have unanimously approved this release. There are 6 approving votes, 3 of which are binding: - Yanquan Lv (non-binding) - Attila Kreiner (non-binding) - Mate Czagany (non-binding) - Márton Balassi (binding) - Gyula Fóra (binding) - Arvid Heise (binding) There a

Re: [VOTE] Release flink-connector-hbase v4.0.0, release candidate #1

2024-11-24 Thread Ferenc Csaky
ures > > > > > > - Build success from source with JDK11 & maven3.8.6 > > > > > > - Source code artifacts matching the current release > > > > > > > > > > > > > 2024年11月12日 19:00,Yanquan Lv decq12y...@gma

Re: Dynamic Iceberg Sink

2024-11-14 Thread Ferenc Csaky
Hi Peter, Max, Thanks for starting this discussion, +1 for the proposal. I agree that the added functionality would solve some major pain points for Flink -> Iceberg use-cases! Best, Ferenc On Thursday, November 14th, 2024 at 03:54, Congxian Qiu wrote: > > > Thanks for kicking off this d

Re:Re: [VOTE]FLIP-480: Support to deploy script in application mode

2024-11-12 Thread Ferenc Csaky
+1 (binding) Best, Ferenc On Tuesday, November 12th, 2024 at 03:28, Xuyang wrote: > > > +1 (non-binding) > > > -- > > Best! > Xuyang > > > > > > 在 2024-11-12 10:02:27,"Ron Liu" ron9@gmail.com 写道: > > > +1(binding) > > > > Best, > > Ron > > > > Gyula Fóra gyula.f...@gmail.com

Re: [VOTE] Release flink-connector-hbase v4.0.0, release candidate #1

2024-11-12 Thread Ferenc Csaky
acheflink-1768/org/apache/flink/flink-sql-connector-hbase-2.2/ > [2]https://lists.apache.org/thread/hfocjggnj4m50l0gl25g1bgg77wzh8bl > > > 2024年11月9日 01:22,Ferenc Csaky ferenc.cs...@pm.me.INVALID 写道: > > > > Hi everyone, > > > > Please review and vote on release

[VOTE] Release flink-connector-hbase v4.0.0, release candidate #1

2024-11-08 Thread Ferenc Csaky
Hi everyone, Please review and vote on release candidate #1 for flink-connector-hbase v4.0.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes

RE: [DISCUSS] FLIP-XXX Add K8S conditions to Flink CRD

2024-11-06 Thread Ferenc Csaky
Hi, I can help to create a FLIP page, from the gdoc, but one thing that I noteced is under "Session mode" both the text and the code snippets refer to "FlinkDeployment". I believe that should be "FlinkSessionJob". Best, Ferenc On Wednesday, November 6th, 2024 at 17:33, David Radley wrote: >

Re: Flink technical debt.

2024-11-06 Thread Ferenc Csaky
Hi, Thank you David for initiating this discussion. I think it would definitely worth some attention from the community to try to focus a bit more on these problems. I would be happy to participate in the calls, and help out with reviewing/merging PRs. Best, Ferenc On Wednesday, November 6t

Re:Re: Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-11-04 Thread Ferenc Csaky
Hi Shengkai, Thank you for driving this FLIP! I think this is a good way to close this gap on the short-term until FLIP-316 can be finished. I would only like to add one thing: YARN has a `yarn.ship-files` config option that ships local or DFS files/directories to the YARN cluster [1]. Best, Fer

Re: [DISCUSS] Release HBase connector with partial JDK support

2024-10-28 Thread Ferenc Csaky
Hi, Based on this discussion I would like to suggest to move on with the originally planned release with the HBase connector 4.0, that will support 1.18, and 1.19. I volunteer to be the release manager. Thanks, Ferenc On Wednesday, October 23rd, 2024 at 13:19, Ferenc Csaky wrote

Re: Consequences of removing per-job mode in Flink 2.0

2024-10-25 Thread Ferenc Csaky
kai > > > > [1] > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-480%3A+Support+to+deploy+SQL+script+in+application+mode > > > > Ferenc Csaky ferenc.cs...@pm.me.invalid 于2024年10月10日周四 17:08写道: > > > > > Hello Weijie, Shengkai, &g

Re: [DISCUSS] Release HBase connector with partial JDK support

2024-10-23 Thread Ferenc Csaky
k1.17 is difficult, but are there any plans to > support it in the future? Do we need to wait for Hadoop related repositories > to release specific versions. > > > > 2024年10月22日 19:44,Ferenc Csaky ferenc.cs...@pm.me.INVALID 写道: > > > > Hello devs, > > > >

[DISCUSS] Release HBase connector with partial JDK support

2024-10-22 Thread Ferenc Csaky
Hello devs, I would like to start a discussion regarding a new HBase connector release. Currently, the externalized HBase connector has only 1 release: 3.0.0 that supports Flink 1.16 and 1.17. By stating this, it is obvious that the connector is already outdated for quite a while. There is a l

[jira] [Created] (FLINK-36468) Use Flink Precondition utils instead of Parquet

2024-10-10 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-36468: Summary: Use Flink Precondition utils instead of Parquet Key: FLINK-36468 URL: https://issues.apache.org/jira/browse/FLINK-36468 Project: Flink Issue Type

Re: Consequences of removing per-job mode in Flink 2.0

2024-10-10 Thread Ferenc Csaky
ubmission based on application mode several months > ago. I will write the design about this and reopen the FLIP-316 discussion > later. We hope Flink-2.0 support the submission of SQL jobs using the > application mode. Best, Shengkai > > > Ferenc Csaky ferenc.cs...@pm.me.invalid 于202

Consequences of removing per-job mode in Flink 2.0

2024-10-09 Thread Ferenc Csaky
Hello devs, I just noticed there is an already merged change [1] that removes per-job mode from the codebase. Regarding that, I would like to mention FLINK-26000 [2] that exists for the same for quite a while, and the reason why we kept the code until now is that, Application Mode does not supp

[jira] [Created] (FLINK-36424) Update deprecated YARN RM/NM callback handlers

2024-10-04 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-36424: Summary: Update deprecated YARN RM/NM callback handlers Key: FLINK-36424 URL: https://issues.apache.org/jira/browse/FLINK-36424 Project: Flink Issue Type

[jira] [Created] (FLINK-36316) Move PortRange util to flink-core

2024-09-18 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-36316: Summary: Move PortRange util to flink-core Key: FLINK-36316 URL: https://issues.apache.org/jira/browse/FLINK-36316 Project: Flink Issue Type: Improvement

Re: FLINK-36240 assignment request

2024-09-14 Thread Ferenc Csaky
Hi Arek, Assigned the ticket to you and added some details in a comment there as well. Cheers, Ferenc On Saturday, 14 September 2024 at 00:51, Arek Dankiewicz wrote: > > > Hi devs, > Could some nice committer please assign the issue to me, if you think it > makes sense? > Thanks in advan

Re: [VOTE] FLIP-474: Store operator name and UID in state metadata

2024-08-26 Thread Ferenc Csaky
+1 (binding) Thanks G, and Zakelly for the productive conversation and the polished/added details. Best, Ferenc On Monday, 26 August 2024 at 13:59, Márton Balassi wrote: > > > +1 (binding) > > Thanks for clarifying the big picture [1], that helps a lot. > > [1] > https://docs.google.com

Re: [DISCUSS] CLI action deprecation process

2024-08-14 Thread Ferenc Csaky
u, Ferenc. > > > Best, > > Xintong > > > > On Tue, Jul 23, 2024 at 9:42 PM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > > IIUC, you mean applying the strict mode for the programming APIs > > > as well? > > > > Correct! The

Re: Rebuilding flink

2024-08-10 Thread Ferenc Csaky
The cluster will only be refreshed if you rebuild the module with changes and "flink-dist". So in this particular case: $ mvn clean install -DskipTests -Dfast -pl flink-runtime,flink-dist -am If you have a fairly fresh SNAPSHOT build already in your local maven repo, then "-am" can be omitted and

Re: [ANNOUNCE] Apache Flink 1.20.0 released

2024-08-02 Thread Ferenc Csaky
Congrats! Thanks for the effort to the release mgrs and everyone involved! Best, Ferenc On Friday, 2 August 2024 at 12:16, Jiadong Lu wrote: > > > Congrats! > Best regards, > Jiadong Lu > > On 2024/8/2 18:13, Aleksandr Pilipenko wrote: > > > Congrats! > > > > Best, > > Aleksandr > > >

Re: [DISCUSS] Remove deprecated dataset based API from State Processor API

2024-08-01 Thread Ferenc Csaky
Hi, AFAIK 1.20 will be the last minor release before 2.0, which is already finalized and the promotion is in progress. The master already points to 2.0 [1]. So "removing now" already means 2.0. Best, Ferenc On Wednesday, 31 July 2024 at 14:51, Gyula Fóra wrote: > > > Hi! > Thanks Gabor for lo

[jira] [Created] (FLINK-35939) Do not set empty config values via ConfigUtils#encodeCollectionToConfig

2024-07-31 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-35939: Summary: Do not set empty config values via ConfigUtils#encodeCollectionToConfig Key: FLINK-35939 URL: https://issues.apache.org/jira/browse/FLINK-35939 Project

Re: [DISCUSS] FLIP-XXX: Introduce CLI API compatibility guarantees

2024-07-26 Thread Ferenc Csaky
Thank you, Ferenc. > > > Best, > > Xintong > > > > On Tue, Jul 23, 2024 at 9:42 PM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > > IIUC, you mean applying the strict mode for the programming APIs > > > as well? > > > >

Re: [DISCUSS] CLI action deprecation process

2024-07-23 Thread Ferenc Csaky
pplying the strict mode to > CLI interfaces, and see how it goes. But I'm also open to other opinions. > > > Best, > > Xintong > > > > On Wed, Jul 17, 2024 at 7:59 PM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > Hi Xintong, Muham

Re: [DISCUSS] CLI action deprecation process

2024-07-17 Thread Ferenc Csaky
> So maybe we don't have to follow fully API `@PublicEvolving` > > process for this. > > > > Another maybe user friendly approach would be to inform with > > warning that the `run-application` cli action will be dropped, > > and suggest new action and migrati

Re: [DISCUSS] CLI action deprecation process

2024-07-04 Thread Ferenc Csaky
gestion to use `run` case instead. > This would make users aware of the change and require them > to migrate their scripts. > > After two minor releases, and on next major version bump, > we could drop the `run-application` method as suggested > on discussion by Xintong. > > Be

Re: [VOTE] FLIP-465: Introduce DESCRIBE FUNCTION

2024-07-04 Thread Ferenc Csaky
+1 (non-binding) Best, Ferenc On Thursday, 4 July 2024 at 16:20, Feng Jin wrote: > > > +1 (non-binding) > > Best, > Feng Jin > > On Thu, Jul 4, 2024 at 6:02 PM Martijn Visser martijnvis...@apache.org > > wrote: > > > +1 (binding) > > > > On Thu, Jul 4, 2024 at 5:39 AM Yanquan Lv decq1

Re:[VOTE] FLIP-444: Native file copy support

2024-06-28 Thread Ferenc Csaky
+1 (non-binding) Best, Ferenc On Friday, 28 June 2024 at 06:27, Feifan Wang wrote: > > > +1 (non binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-06-25 16:58:22, "Piotr Nowojski" pnowoj...@apache.org wrote: > > > Hi all, > > > > I would like

[DISCUSS] CLI action deprecation process

2024-06-26 Thread Ferenc Csaky
Hello devs, I would like to open a discussion about considerations regarding how to deprecate CLI actions, and what compatibility guarantees should apply to such cases. The topic came up in a previous discussion [1] about a current FLIP to merge the run and run-application behavior [2]. Accordi

[jira] [Created] (FLINK-35699) The flink-kubernetes artifact shades Jackson 2.15.3 from fabric8

2024-06-25 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-35699: Summary: The flink-kubernetes artifact shades Jackson 2.15.3 from fabric8 Key: FLINK-35699 URL: https://issues.apache.org/jira/browse/FLINK-35699 Project: Flink

  1   2   3   >