[jira] [Created] (FLINK-36202) Remove all deprecated datastream api

2024-09-03 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-36202: -- Summary: Remove all deprecated datastream api Key: FLINK-36202 URL: https://issues.apache.org/jira/browse/FLINK-36202 Project: Flink Issue Type: Sub-task

Re: [VOTE] FLIP-477: Amazon SQS Source Connector

2024-09-03 Thread Saurabh Singh
Hi Flink Devs, Gentle Reminder for voting on FLIP-477: Amazon SQS Source Connector [1]. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-477 +Amazon+SQS+Source+Connector Regards Saurabh & Abhi On Thu, Aug 22, 2024 at 1:17 AM Aleksandr Pilipenko wrote: > Thank you for driving this! >

Re: [DISCUSS] FLIP-XXX Amazon SQS Source Connector

2024-09-03 Thread Danny Cranmer
Hello Saurabh, Thanks for contributing this, I have seen multiple custom implementations of SQS sources, so a community supported version will be a great addition. // .setFailOnError(false) A general callout that this is not ideal, I know we use it elsewhere but we should consider some pluggable

[jira] [Created] (FLINK-36203) Have some way to control the polling frequency of GetRecords from SplitFetcher

2024-09-03 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36203: -- Summary: Have some way to control the polling frequency of GetRecords from SplitFetcher Key: FLINK-36203 URL: https://issues.apache.org/jira/browse/FLINK-36203 Project: F

Re: [DISCUSS] FLIP-XXX Amazon SQS Source Connector

2024-09-03 Thread Arvid Heise
Sorry for being late to the party. I saw your call to vote and looked at the FLIP. First, most of the design is looking really good and it will be good to have another connector integrated into the AWS ecosystem. A couple of questions/remarks: 1) Since we only have 1 split, we should also limit th

[jira] [Created] (FLINK-36204) Fix dropping records when consuming from LATEST and having a restore from expired snapshot

2024-09-03 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36204: -- Summary: Fix dropping records when consuming from LATEST and having a restore from expired snapshot Key: FLINK-36204 URL: https://issues.apache.org/jira/browse/FLINK-36204

[jira] [Created] (FLINK-36205) DDB Streams connector should be able to resolve the stream ARN from given Table name

2024-09-03 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-36205: --- Summary: DDB Streams connector should be able to resolve the stream ARN from given Table name Key: FLINK-36205 URL: https://issues.apache.org/jira/browse/FLINK-36205

[jira] [Created] (FLINK-36206) Support flink-connector-aws-base to allow custom override configuration

2024-09-03 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36206: -- Summary: Support flink-connector-aws-base to allow custom override configuration Key: FLINK-36206 URL: https://issues.apache.org/jira/browse/FLINK-36206 Project: Flink

Re: [VOTE] Apache Flink CDC Release 3.2.0, release candidate #1

2024-09-03 Thread Leonard Xu
+1 (binding) - verified signatures - verified hashsums - checked Github release tag - built from source code with JDK 1.8 succeeded - checked release notes, all blockers in RC0 have been fixed - run a CDC YAML job that sync data from MySQL to Kafka, the result is expected - reviewed the web PR a

[jira] [Created] (FLINK-36207) Disabling japicmp plugin for deprecated APIs

2024-09-03 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-36207: - Summary: Disabling japicmp plugin for deprecated APIs Key: FLINK-36207 URL: https://issues.apache.org/jira/browse/FLINK-36207 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-36208) use ThreadLocalRandom in Flink AbstractID

2024-09-03 Thread Sean Sullivan (Jira)
Sean Sullivan created FLINK-36208: - Summary: use ThreadLocalRandom in Flink AbstractID Key: FLINK-36208 URL: https://issues.apache.org/jira/browse/FLINK-36208 Project: Flink Issue Type: Impro

Re: [VOTE] Apache Flink CDC Release 3.2.0, release candidate #1

2024-09-03 Thread Xiqian YU
Thanks Qingsheng for preparing this RC! +1 (non-binding) * confirmed tarball checksum matches * confirmed binaries were compiled with JDK 1.8 * compiled from source and ran newly added test cases * created an end-to-end pipeline job and tested transform + schema evolution cases

[jira] [Created] (FLINK-36209) Reduce some redundant operations in the initialization of KafkaSourceEnumState

2024-09-03 Thread xiaochen.zhou (Jira)
xiaochen.zhou created FLINK-36209: - Summary: Reduce some redundant operations in the initialization of KafkaSourceEnumState Key: FLINK-36209 URL: https://issues.apache.org/jira/browse/FLINK-36209 Proj

[jira] [Created] (FLINK-36210) Optimize the logic for fetching topic metadata in the TopicPatternSubscriber mode

2024-09-03 Thread xiaochen.zhou (Jira)
xiaochen.zhou created FLINK-36210: - Summary: Optimize the logic for fetching topic metadata in the TopicPatternSubscriber mode Key: FLINK-36210 URL: https://issues.apache.org/jira/browse/FLINK-36210 P

[jira] [Created] (FLINK-36211) Shade kafka related package in Kafka Pipeline connector.

2024-09-03 Thread LvYanquan (Jira)
LvYanquan created FLINK-36211: - Summary: Shade kafka related package in Kafka Pipeline connector. Key: FLINK-36211 URL: https://issues.apache.org/jira/browse/FLINK-36211 Project: Flink Issue Type

Re: [DISCUSSION] Disabling japicmp plugin in master for 2.0

2024-09-03 Thread Matthias Pohl
Good point. It makes sense to only exclude deprecated API. I needed to find a workaround for the Scala API. The japicmp plugin seems to have an issue with Scala's @deprecated annotation. But excluding all *scala files (considering that we want to remove all these classes, anyway) should be a good