[jira] [Created] (FLINK-36532) Kafka group offsets are not committed on stop with savepoint

2024-10-14 Thread LEONID ILYEVSKY (Jira)
LEONID ILYEVSKY created FLINK-36532: --- Summary: Kafka group offsets are not committed on stop with savepoint Key: FLINK-36532 URL: https://issues.apache.org/jira/browse/FLINK-36532 Project: Flink

[jira] [Created] (FLINK-36533) An exception occurs when using the taskmanager.data.bind-port

2024-10-14 Thread five (Jira)
five created FLINK-36533: Summary: An exception occurs when using the taskmanager.data.bind-port Key: FLINK-36533 URL: https://issues.apache.org/jira/browse/FLINK-36533 Project: Flink Issue Type: Bu

Re: [VOTE] Release flink-connector-kafka v3.3.0, release candidate #1

2024-10-14 Thread Leonard Xu
- verified signatures - verified hashsums - checked Github release tag - reviewed the web PR TODO: Quick question about the url before vote. https://repository.apache.org/content/repositories/staging/org/apache/flink/flink-connector-kafka/3.3.0-1.19.1 https://repository.apache.org/content/repos

Re: [VOTE] Release flink-connector-kafka v3.3.0, release candidate #1

2024-10-14 Thread Arvid Heise
That's a good catch Leonard. I'll check if I can change that on the fly or else I will create a new RC. On Tue, Oct 15, 2024 at 7:56 AM Leonard Xu wrote: > - verified signatures > - verified hashsums > - checked Github release tag > - reviewed the web PR > > TODO: > Quick question about the url

Re: [VOTE] Release flink-connector-kafka v3.3.0, release candidate #1

2024-10-14 Thread Arvid Heise
Okay turns out that the upload script uses sed to extract the version and that doesn't work with Mac's sed. I will update the docs to reflect the need to use gsed for the release. Because we didn't need to touch code to fix it, I'd leave the RC1 still active. Instead, I have deleted the old stagin

[jira] [Created] (FLINK-36534) Upgrade Flink Kubernetes operator to flink-1.20

2024-10-14 Thread Shailesh Gupta (Jira)
Shailesh Gupta created FLINK-36534: -- Summary: Upgrade Flink Kubernetes operator to flink-1.20 Key: FLINK-36534 URL: https://issues.apache.org/jira/browse/FLINK-36534 Project: Flink Issue Typ

[DISCUSS] FLINK-36510/PR 25494 Upgrade Pekko from 1.0.1 to 1.1.2

2024-10-14 Thread Grace Grimwood
Hi, I've submitted a PR [1] to upgrade to the latest Pekko 1.1.x, could I please get a review? I noticed some discussion on this list roughly a year ago about upgrading to Pekko 1.1 (once it released) to remove the old Netty 3 dependency, but hadn't seen anyone mention it since the Pekko release

[DISCUSS] Flink external connector bump version

2024-10-14 Thread Yanquan Lv
Dear Flink devs, I would like to initiate a discussion about upgrading the Flink External connector Flink bump version to Flink 1.20. Apache Flink 1.20 is expected to be the last 1.x release and a Flink long-term support (LTS) version[1], For new users and those planning to upgrade to the Flink

[jira] [Created] (FLINK-36528) Update org.apache.avro : avro dependency

2024-10-14 Thread Kartik Goyal (Jira)
Kartik Goyal created FLINK-36528: Summary: Update org.apache.avro : avro dependency Key: FLINK-36528 URL: https://issues.apache.org/jira/browse/FLINK-36528 Project: Flink Issue Type: Improvem

Re: [VOTE] Release flink-connector-kafka v3.3.0, release candidate #1

2024-10-14 Thread Danny Cranmer
Hey Arvid, +1 (binding) - I left a couple of comments on the website PR that need addressing - Release notes look good - Source archive signatures and checksums are correct - There are no binaries in the source archive - Contents of mvn dist look good - Binary signatures and checksums are correct

[jira] [Created] (FLINK-36526) Optimize the overhead of writing with direct buffer in ForSt

2024-10-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36526: --- Summary: Optimize the overhead of writing with direct buffer in ForSt Key: FLINK-36526 URL: https://issues.apache.org/jira/browse/FLINK-36526 Project: Flink

[jira] [Created] (FLINK-36527) Introduce a parameter to support the autoscaler to adopt a more aggressive strategy when Source or upstream shuffle is keyBy

2024-10-14 Thread yuanfenghu (Jira)
yuanfenghu created FLINK-36527: -- Summary: Introduce a parameter to support the autoscaler to adopt a more aggressive strategy when Source or upstream shuffle is keyBy Key: FLINK-36527 URL: https://issues.apache.org/j

Re: [DISCUSS] FLIP-XXX Add K8S conditions to Flink CRD

2024-10-14 Thread Lajith Koova
Thank you all for the valuable feedback . Following the procedure outlined on the Flink Improvement Proposal Confluence page [1], we kindly ask the PMC/Committers to transfer the content from the Add K8S conditions to CRD's Status [2] and assign a FLIP Number for us, which we will use for voti

[DISCUSS] Elasticsearch v3.1 release

2024-10-14 Thread Ahmed Hamdy
Hi all, I want to kick off the discussion for elasticsearch connector release v3.1. Our latest release v3.0.1 was more than a year ago[1]. Since then the connector has developed an important set of features like SinkV2 compatibility update[2] and most importantly Elasticsearch 8 support[3] which is

Re: [VOTE] Release flink-connector-kafka v3.3.0, release candidate #1

2024-10-14 Thread Arvid Heise
Hi Ahmed, thanks for pointing out that web PR looks amiss. I consulted with Chesnay and it looks like our Hugo setup is not perfect. First, we didn't pin the Hugo version, which I now did. But second it seems like we still get different signature on the scripts for some reasons. I will not be able

[jira] [Created] (FLINK-36529) Support greater or equals logic for operator flink version default configs

2024-10-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-36529: -- Summary: Support greater or equals logic for operator flink version default configs Key: FLINK-36529 URL: https://issues.apache.org/jira/browse/FLINK-36529 Project: Flink

[jira] [Created] (FLINK-36530) Not able to restore list state from S3

2024-10-14 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-36530: - Summary: Not able to restore list state from S3 Key: FLINK-36530 URL: https://issues.apache.org/jira/browse/FLINK-36530 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-10-14 Thread Timo Walther
Hi Jim, thanks for taking a deep look into the FLIP. Happy to answer your questions: 1. Pass through semantics and partition columns We won't support pass through semantics in the first version. But I don't think that columns are duplicated unless they use a different name. E.g. the PTF can of

Re: [DISCUSS] Elasticsearch v3.1 release

2024-10-14 Thread Danny Cranmer
Hey Ahmed, +1 for the release and you as release manager with PMC assistance. Thanks for opening this discussion, we never finished releasing the Elasticsearch connector for Flink 1.19 [1], so we do not have an official version for Flink 1.19/1.20 which is a problem. I am happy to assist you as s

[jira] [Created] (FLINK-36531) AutoScaler needs to consider the lag from last checkpoint

2024-10-14 Thread Sai Sharath Dandi (Jira)
Sai Sharath Dandi created FLINK-36531: - Summary: AutoScaler needs to consider the lag from last checkpoint Key: FLINK-36531 URL: https://issues.apache.org/jira/browse/FLINK-36531 Project: Flink

Re: [VOTE] Release flink-connector-kafka v3.3.0, release candidate #1

2024-10-14 Thread Ahmed Hamdy
Hi Arvid, yeah sure, thanks for following up Best Regards Ahmed Hamdy On Mon, 14 Oct 2024 at 10:52, Danny Cranmer wrote: > Hey Arvid, > > +1 (binding) > > - I left a couple of comments on the website PR that need addressing > - Release notes look good > - Source archive signatures and checksum