Re: Dynamic Kafka Properties

2025-01-30 Thread Salva Alcántara
By looking at: https://github.com/apache/flink-connector-kafka/pull/20 where the "setRackIdSupplier" setter for the kafka source builder was introduced, I guess one could take a more general approach and instead consider overrides for: "setProperty" "setProperties" which receive a supplier for

Dynamic Kafka Properties

2025-01-27 Thread Salva Alcántara
I've recently started to enable rack awareness in my sources following this: https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kafka/#rackid E.g., ```java .setRackIdSupplier(() -> System.getenv("TM_NODE_AZ")) ``` This approach allows to decouple the AZ between jo