Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-07 Thread Grace Grimwood
Hi Kevin, Thanks for starting this thread. This idea is something that was discussed in Kroxylicious (an open source Kafka proxy, I'm a maintainer there). In that discussion [1] we came to the conclusion that there are a couple of issues with implementing this: 1. Doesn't scale - very large messa

[jira] [Created] (FLINK-35781) Make pipeline parallelism config optional

2024-07-07 Thread yux (Jira)
yux created FLINK-35781: --- Summary: Make pipeline parallelism config optional Key: FLINK-35781 URL: https://issues.apache.org/jira/browse/FLINK-35781 Project: Flink Issue Type: Improvement Com

[jira] [Created] (FLINK-35780) Support state migration from disabling to enabling ttl in RocksDBState

2024-07-07 Thread xiangyu feng (Jira)
xiangyu feng created FLINK-35780: Summary: Support state migration from disabling to enabling ttl in RocksDBState Key: FLINK-35780 URL: https://issues.apache.org/jira/browse/FLINK-35780 Project: Flink

[jira] [Created] (FLINK-35779) Update documentation for PubSubSinkV2

2024-07-07 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-35779: --- Summary: Update documentation for PubSubSinkV2 Key: FLINK-35779 URL: https://issues.apache.org/jira/browse/FLINK-35779 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35778) Escape URI reserved characters when creating file-merging directories

2024-07-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35778: --- Summary: Escape URI reserved characters when creating file-merging directories Key: FLINK-35778 URL: https://issues.apache.org/jira/browse/FLINK-35778 Project: Flink

[jira] [Created] (FLINK-35777) Observe session jobs during cleanup

2024-07-07 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-35777: -- Summary: Observe session jobs during cleanup Key: FLINK-35777 URL: https://issues.apache.org/jira/browse/FLINK-35777 Project: Flink Issue Type: Improvement