Re: [DISCUSS] Release Flink 1.16.1

Hi Martijn, +1 Thank you for bringing this up. There is a serious bug in planner rule #FlinkJoinToMultiJoinRule, which will generate a wrong join reorder plan and will cause data correctness issue: https://issues.apache.org/jira/browse/FLINK-30270 (reviewing) I hope this bug fix can be picked to

[jira] [Created] (FLINK-30483) Make Avro format support for TIMESTAMP_LTZ

Mingliang Liu created FLINK-30483: - Summary: Make Avro format support for TIMESTAMP_LTZ Key: FLINK-30483 URL: https://issues.apache.org/jira/browse/FLINK-30483 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-30484) ZooKeeperLeaderElectionTest.testZooKeeperReelection timed out

Matthias Pohl created FLINK-30484: - Summary: ZooKeeperLeaderElectionTest.testZooKeeperReelection timed out Key: FLINK-30484 URL: https://issues.apache.org/jira/browse/FLINK-30484 Project: Flink

[jira] [Created] (FLINK-30485) Remove flink-connector-rabbitmq from master branch

Martijn Visser created FLINK-30485: -- Summary: Remove flink-connector-rabbitmq from master branch Key: FLINK-30485 URL: https://issues.apache.org/jira/browse/FLINK-30485 Project: Flink Issue

[jira] [Created] (FLINK-30486) Make the config documentation generator available to connector repos

Martijn Visser created FLINK-30486: -- Summary: Make the config documentation generator available to connector repos Key: FLINK-30486 URL: https://issues.apache.org/jira/browse/FLINK-30486 Project: Fli

[DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

Hi everyone, I would like to start a discussion about making Sink support speculative execution for batch jobs. This proposal is a follow up of "FLIP-168: Speculative Execution For Batch Job"[1]. Speculative execution is very meaningful for batch jobs. And it would be more complete after supportin

[jira] [Created] (FLINK-30487) Add RabbitMQ Table/SQL connector documentation

Martijn Visser created FLINK-30487: -- Summary: Add RabbitMQ Table/SQL connector documentation Key: FLINK-30487 URL: https://issues.apache.org/jira/browse/FLINK-30487 Project: Flink Issue Type

[ANNOUNCE] Apache flink-connector-opensearch 1.0.0 released

The Apache Flink community is very happy to announce the release of Apache flink-connector-opensearch 1.0.0 for Flink 1.16. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is avai

Re: [Consulting] Should a Flink class loader be a singleton?

Hi all, I’m running into the exact same issue, though with Flink 1.15.1. I get a ClassCastException with HoodieWrapperFileSystem being loaded from two different ChildFirstClassLoader instances: Caused by: java.lang.ClassCastException: class shaded.org.apache.hudi.common.fs.HoodieWrapperFileSys

[jira] [Created] (FLINK-30488) OpenSearch implementation of Async Sink

Andriy Redko created FLINK-30488: Summary: OpenSearch implementation of Async Sink Key: FLINK-30488 URL: https://issues.apache.org/jira/browse/FLINK-30488 Project: Flink Issue Type: New Featu

[jira] [Created] (FLINK-30489) flink-sql-connector-pulsar doesn't shade all dependencies

Henri Yandell created FLINK-30489: - Summary: flink-sql-connector-pulsar doesn't shade all dependencies Key: FLINK-30489 URL: https://issues.apache.org/jira/browse/FLINK-30489 Project: Flink I

Re: [DISCUSS] Release Flink 1.16.1

Hi Martjin, Thank you for bringing this up! +1 to release 1.16.1. There's a critical problem (FLINK-30334) of HybridSource and a fix is in review. I hope we can include the fix in 1.16.1. Thanks, Zhu yh z 于2022年12月22日周四 16:11写道： > > Hi Martijn, > > +1 > Thank you for bringing this up. There i

[jira] [Created] (FLINK-30490) Deleted topic from KafkaSource is still included in subsequent restart from savepoint

Hilmi Al Fatih created FLINK-30490: -- Summary: Deleted topic from KafkaSource is still included in subsequent restart from savepoint Key: FLINK-30490 URL: https://issues.apache.org/jira/browse/FLINK-30490

[jira] [Created] (FLINK-30491) Hive table partition supports to deserialize later during runtime

dalongliu created FLINK-30491: - Summary: Hive table partition supports to deserialize later during runtime Key: FLINK-30491 URL: https://issues.apache.org/jira/browse/FLINK-30491 Project: Flink

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

Hi, Thanks for driving this FLIP, +1 for the proposed changes. Limit the maximum value of shuffle read memory is very useful when using when using adaptive batch scheduler. Currently, the adaptive batch scheduler may cause a large number of input channels in a certain TM, so we generally recommen

Re: [DISCUSS] FLIP-274 : Introduce metric group for OperatorCoordinator

Hi everyone, As for the Zhu Zhu's problem, I think we should keep the common metrics, which will help to observe incoming and outgoing events. What do you think, @Zhu Zhu ? And @Chesnay, are there any other issues you are more concerned about? Looking forward to your reply. Thanks for all the co

Re: [DISCUSS] Cleaning up HighAvailabilityServices interface to reflect the per-JM-process LeaderElection

Thanks for the discussion. I will go ahead then and refactor the code without touching the HighAvailabilityServices interface. We will keep the per-component factory methods and return a single leader election instance for all of them. Other HighAvailabilityServices implementations can then come up