[Request Help] Flink StreamRecord granularity latency metrics

Hi everyone, We are focusing on improving observability for Flink, we have a vision to make the latency of every business stream record observable, is there any idea to implement the feature? looking forward to your suggestions!

Re:Changing GC settings of Taskmanager

Hi, Banu. Could you check whether the "Configuration" icon under the "Task Managers" and "Job Manager" buttons on the left side of the Flink-UI shows that the currently effective flink conf includes these JVM changes? I suspect that you are using a session cluster mode, where changes to the

Elasticsearch 8.x Connector in Maven

Hi all, I see that the Elasticsearch Connector for 8.x is supported per the repo (and completed JIRAs). Is there a way to reference this via Maven? Or is it required to build the connector from the source directly? We recently upgraded an Elasticsearch cluster to 8.x and some of the writes are

Re: checkpoint upload thread

Hi Enric, If I understand correctly, one subtask would use one `asyncOperationsThreadPool`[1,2], it is possible to use the same connection for an operator chain. [1] https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/StreamTask

KafkaSink self-defined RoundRobinPartitioner not able to discover new partitions

I wrote a FlinkRoundRobinPartitioner extends FlinkKafkaPartitioner and use it as following: KafkaSink kafkaSink = KafkaSink.builder() .setBootstrapServers(sinkServers).setKafkaProducerConfig(props) .setDeliverGuarantee(DeliveryGuarantee.AT_LEAST_ONCE) .setRecordSerializer(KafkaRecordSerializationS