[jira] [Created] (FLINK-36682) Add split assign strategy to avoid OOM error in TaskManager

2024-11-08 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-36682: -- Summary: Add split assign strategy to avoid OOM error in TaskManager Key: FLINK-36682 URL: https://issues.apache.org/jira/browse/FLINK-36682 Project: Flink Issu

[jira] [Created] (FLINK-36681) Wrong chunks splitting query in incremental snapshot reading section in mysql cdc doc

2024-11-08 Thread Runkang He (Jira)
Runkang He created FLINK-36681: -- Summary: Wrong chunks splitting query in incremental snapshot reading section in mysql cdc doc Key: FLINK-36681 URL: https://issues.apache.org/jira/browse/FLINK-36681 Pro

[jira] [Created] (FLINK-36680) Flink K8S operator image 1.20.0 is still using Flink 1.19.1

2024-11-08 Thread Maxime (Jira)
Maxime created FLINK-36680: -- Summary: Flink K8S operator image 1.20.0 is still using Flink 1.19.1 Key: FLINK-36680 URL: https://issues.apache.org/jira/browse/FLINK-36680 Project: Flink Issue Type:

[jira] [Created] (FLINK-36679) Add a metric to track checkpoint _metadata size

2024-11-08 Thread Mingliang Liu (Jira)
Mingliang Liu created FLINK-36679: - Summary: Add a metric to track checkpoint _metadata size Key: FLINK-36679 URL: https://issues.apache.org/jira/browse/FLINK-36679 Project: Flink Issue Type:

[VOTE] Release flink-connector-hbase v4.0.0, release candidate #1

2024-11-08 Thread Ferenc Csaky
Hi everyone, Please review and vote on release candidate #1 for flink-connector-hbase v4.0.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes

Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-08 Thread Timo Walther
Hi David, happy to answer your questions as well: > 1. I wonder what class of scenarios that PTF’s do not do well in and > that DataStream API would be preferable/required? Assuming we have PTF > Map and List support. DataStream API supports broadcast state, async operators, custom serializer

Re: Flink V1 to V2 state migration

2024-11-08 Thread Galen Warren
Yes, I'd like to second that it would be very helpful to have a way to migrate state from V1 to V2. On Thu, Nov 7, 2024 at 12:11 PM David Radley wrote: > Hello, > At Flink Forward I learnt that Fink V1 state could not be migrated to V2. > I think this would be a big migration inhibitor for curre

Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-08 Thread Timo Walther
Hi Fabian, thanks for this massive feedback. It took me quite some time to digest it. I hope I covered most of your concerns. I gave the whole FLIP a major update to reflect your suggestions. 1. "Scoping and Simplifications", "Partition and Order Semantics" > What does "by default" mean? Wi

Re: [DISCUSS] Flink PubSub connector bump release needed

2024-11-08 Thread Radek Stankiewicz
Yes Ahmed - you are correct - bug was in new Sink that is not included in 3.1 On Fri, Nov 8, 2024 at 1:51 PM Ahmed Hamdy wrote: > Hi Radek, > I am really glad you initiated the discussion, as far as I understand the > bug is in the new Sink which itself is not yet released, have you been > usin

[jira] [Created] (FLINK-36678) The Flink CDC Yarn deployment mode document description is incorrect

2024-11-08 Thread xuweiwei (Jira)
xuweiwei created FLINK-36678: Summary: The Flink CDC Yarn deployment mode document description is incorrect Key: FLINK-36678 URL: https://issues.apache.org/jira/browse/FLINK-36678 Project: Flink

Re: [DISCUSS] Flink PubSub connector bump release needed

2024-11-08 Thread Ahmed Hamdy
Hi Radek, I am really glad you initiated the discussion, as far as I understand the bug is in the new Sink which itself is not yet released, have you been using a snapshot version? If that's the case then we don't need a bump/patch version release yet I would argue it would be better to start a new

[jira] [Created] (FLINK-36677) Instruct users to change log level dynamically in operator

2024-11-08 Thread Luke Chen (Jira)
Luke Chen created FLINK-36677: - Summary: Instruct users to change log level dynamically in operator Key: FLINK-36677 URL: https://issues.apache.org/jira/browse/FLINK-36677 Project: Flink Issue Ty

Re: [VOTE] Release flink-connector-aws v5.0.0, release candidate #3

2024-11-08 Thread Ahmed Hamdy
Thanks Hong for driving, +1 (non-binding) - Release notes look good - Verified there are no blocker issues. - Verified signatures and hashsums - No binaries in source - Build source using maven and jdk11 - Verified tag is present in repo Best Regards Ahmed Hamdy On Fri, 8 Nov 2024 at 02:28, X

Re: [VOTE]FLIP-480: Support to deploy script in application mode

2024-11-08 Thread Gyula Fóra
Hey! Sorry, bit late to the party, I have added a concern to the discussion related to the gateway submission vote. I would like to clarify that before we close this vote. Cheers, Gyula On Fri, Nov 8, 2024 at 10:57 AM Feng Jin wrote: > +1 (non-binding) > > > Best, > Feng Jin > > On Fri, Nov 8

Re: Re: Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-11-08 Thread Gyula Fóra
Hey! I am a bit concerned about the design for gateway based submission model. I think it's not a good model to access catalog information on the JobManager side. In a production environment the gateway would hold the credentials to the different catalogs and may even contain temporary tables etc

Re: [VOTE]FLIP-480: Support to deploy script in application mode

2024-11-08 Thread Feng Jin
+1 (non-binding) Best, Feng Jin On Fri, Nov 8, 2024 at 5:37 PM yuanfeng hu wrote: > +1(no-binding) > > > Shengkai Fang 于2024年11月8日周五 15:11写道: > > > Hi everyone, > > > > I'd like to start a vote on FLIP-480: Support to deploy script in > > application mode[1]. The discussion can be found here[

Re: [VOTE]FLIP-480: Support to deploy script in application mode

2024-11-08 Thread yuanfeng hu
+1(no-binding) Shengkai Fang 于2024年11月8日周五 15:11写道: > Hi everyone, > > I'd like to start a vote on FLIP-480: Support to deploy script in > application mode[1]. The discussion can be found here[2]. > > The vote will be open for at least 72 hours unless there are any objections > or insufficient

[jira] [Created] (FLINK-36676) Flink CDC SQL Server Connector Missing Data

2024-11-08 Thread Chance (Jira)
Chance created FLINK-36676: -- Summary: Flink CDC SQL Server Connector Missing Data Key: FLINK-36676 URL: https://issues.apache.org/jira/browse/FLINK-36676 Project: Flink Issue Type: Bug Com

[jira] [Created] (FLINK-36675) Dynamic option hints will not take effect when restoring exec plan from json plan without setting 'table.plan.compile.catalog-objects' to 'all'

2024-11-08 Thread xuyang (Jira)
xuyang created FLINK-36675: -- Summary: Dynamic option hints will not take effect when restoring exec plan from json plan without setting 'table.plan.compile.catalog-objects' to 'all' Key: FLINK-36675 URL: https://issues.

[RESULT][VOTE] flink-connector-prometheus v1.0.0, release candidate #1

2024-11-08 Thread Hong Liang
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * Weijie Guo (binding) * Xintong Song (binding) * Yanquan Lv (non-binding) * Lorenzo Nicora (non-binding) * Danny Cranmer (binding) There are no disapproving votes. Thanks e

Re: [VOTE] Release flink-connector-prometheus v1.0.0, release candidate #1

2024-11-08 Thread Hong Liang
Thank you everyone for voting. I'm closing the vote in another thread. Thanks, Hong On Wed, Nov 6, 2024 at 5:03 PM Hong Liang wrote: > Thanks for the thorough verification Danny! > > > - I note that the AWS SDK version differs between flink-connector- > prometheus [1] and flink-connector-aws [