Wechar created HIVE-26205:
-----------------------------
Summary: Remove the incorrect org.slf4j dependency in kafka-handler
Key: HIVE-26205
URL: https://issues.apache.org/jira/browse/HIVE-26205
Project: Hive
Issue Type: Bug
Components: Hive
Affects Versions: 4.0.0-alpha-2
Reporter: Wechar
Assignee: Wechar
Fix For: 4.0.0-alpha-2
Get a compile error while executing:
{code:bash}
mvn clean install -DskipTests
{code}
The error message is:
{code:bash}
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile)
on project kafka-handler: Compilation failure: Compilation failure:
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaStorageHandler.java:[53,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaStorageHandler.java:[54,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaStorageHandler.java:[73,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.KafkaStorageHandler
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/VectorizedKafkaRecordReader.java:[37,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/VectorizedKafkaRecordReader.java:[47,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class
org.apache.hadoop.hive.kafka.VectorizedKafkaRecordReader
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaJsonSerDe.java:[63,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/SimpleKafkaWriter.java:[35,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/SimpleKafkaWriter.java:[50,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.SimpleKafkaWriter
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaOutputFormat.java:[34,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaOutputFormat.java:[43,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.KafkaOutputFormat
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/RetryUtils.java:[24,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/RetryUtils.java:[34,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.RetryUtils
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaScanTrimmer.java:[51,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaScanTrimmer.java:[65,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.KafkaScanTrimmer
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/TransactionalKafkaWriter.java:[45,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/TransactionalKafkaWriter.java:[65,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.TransactionalKafkaWriter
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/HiveKafkaProducer.java:[37,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/HiveKafkaProducer.java:[59,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.HiveKafkaProducer<K,V>
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordIterator.java:[30,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordIterator.java:[56,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.KafkaRecordIterator
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaUtils.java:[52,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaUtils.java:[72,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.KafkaUtils
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordReader.java:[31,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordReader.java:[42,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.KafkaRecordReader
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaInputFormat.java:[42,17]
package org.slf4j does not exist
[ERROR]
/ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaInputFormat.java:[64,24]
cannot find symbol
[ERROR] symbol: class Logger
[ERROR] location: class org.apache.hadoop.hive.kafka.KafkaInputFormat
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :kafka-handler
{code}
*Root cause:*
The `pom.xml` of `kafka-handler` module defines such dependency:
{code:xml}
<!-- kafka-handler/pom.xml -->
<dependency>
<groupId>org.slf4j</groupId>
<artifactId>slf4j-api</artifactId>
<scope>test</scope>
</dependency>
{code}
which causes that log4j lib can be available only in test. It is a redundant
config that we can remove.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
