Stamatis Zampetakis created HIVE-27402:
------------------------------------------

             Summary: Refactor Kafka credential handling into kafka-handler 
module
                 Key: HIVE-27402
                 URL: https://issues.apache.org/jira/browse/HIVE-27402
             Project: Hive
          Issue Type: Improvement
          Components: HiveServer2, kafka integration
            Reporter: Stamatis Zampetakis
            Assignee: Stamatis Zampetakis


Currently the code for handling credentials and authentication for the Kafka 
storage handler is spread across hive-exec 
(https://github.com/apache/hive/blob/7cd3107a76d633ef5fae2ffb8ec16953ac968092/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java#L302)
 and kafka-handler 
(https://github.com/apache/hive/blob/7cd3107a76d633ef5fae2ffb8ec16953ac968092/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaUtils.java#L71)
 modules. This leads to unexpected dependencies to kafka (e.g., kafka-client) 
in hive-exec module and limits sharing opportunities of credential utilities 
present in KafkaUtil class.
    
The goal of this refactoring is threefold:
* centralize Kafka credential handling (in one module) opening the road to more 
code reuse and better encapsulation;
* remove kafka dependencies (e.g., kafka-client) from hive-exec module;
* facilitate unit testing and product stability.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to