Andrzej Bialecki created SOLR-18062:
---------------------------------------

             Summary: CrossDC - support arbitrary Kafka properties
                 Key: SOLR-18062
                 URL: https://issues.apache.org/jira/browse/SOLR-18062
             Project: Solr
          Issue Type: Improvement
          Components: module - crossDC
    Affects Versions: 10.0
            Reporter: Andrzej Bialecki
            Assignee: Andrzej Bialecki


Currently a strictly controlled subset of Kafka properties is supported in 
CrossDC Producer and Consumer. However, this limits the possibility of adding 
other Kafka properties related to performance tuning, connectivity etc. There 
are literally hundreds of these properties, some varying between Kafka versions.

This ticket will add a generic mechanism to pass-through arbitrary Kafka 
properties. The proposed mechanism is the following:
 * environment variables starting with {{KAFKA_}} will be stripped of the 
prefix, lowercased and replace underscores with dots.
 * system properties starting with {{kafka.}} will be stripped of the prefix.

Properties collected this way from env vars and sys props will be added to 
{{KafkaCrossDcConf}} and returned in 
{{KafkaCrossDcConf.getAdditionalProperties()}} which is used during 
configuration of Kafka consumers and producers.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to