Hi Bharath, Thanks for your help!
Qi Shu > 在 2019年6月5日,下午5:58,Bharath Kumara Subramanian <codin.mart...@gmail.com> 写道: > > HI Qi, > > You are right. I forgot to update the other thread on this. I suspected > Kafka 1.0 was the reason for NPE since it had trouble instantiating the > logger. > Here is the Kafka client support matrix for our releases > > Dependency Supported versions Not supported version Samza version > > Kafka > 0.11.* > 1.*, 2.* > 1.0 > 1.1 > 2.0.* 1.* and below 1.2(Upcoming release) > Hope it helps. > > Thanks, > Bharath > > > On Tue, Jun 4, 2019 at 11:24 PM QiShu <sh...@eefung.com> wrote: > >> Hi, >> >> Running environment: >> Samza version: 2.12-1.1.0 >> Kafka cluster version: 2.12-1.1.0 >> Hadoop version: 3.1.0 >> >> When using Kafka_2.12-1.1.0.jar, Samza job failed to run when >> retrieving coordinator stream meta info from Kafka: >> 2019-06-03 17:26:11.176 [main] KafkaSystemAdmin [INFO] Fetching >> SystemStreamMetadata for topics [__samza_coordinator_canal-metrics-test_1] >> on system kafka >> 2019-06-03 17:26:11.179 [main] KafkaSystemAdmin [ERROR] Fetching system >> stream metadata for: [__samza_coordinator_canal-metrics-test_1] threw an >> exception. >> java.lang.NullPointerException >> at >> java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936) >> at >> org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:75) >> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:253) >> at kafka.utils.Logging.logger(Logging.scala:43) >> at kafka.utils.Logging.debug(Logging.scala:62) >> at kafka.utils.Logging.debug$(Logging.scala:62) >> at >> org.apache.samza.system.kafka.KafkaSystemAdminUtilsScala$.debug(KafkaSystemAdminUtilsScala.scala:45) >> at >> org.apache.samza.system.kafka.KafkaSystemAdminUtilsScala$.assembleMetadata(KafkaSystemAdminUtilsScala.scala:74) >> at >> org.apache.samza.system.kafka.KafkaSystemAdminUtilsScala.assembleMetadata(KafkaSystemAdminUtilsScala.scala) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin.fetchSystemStreamMetadata(KafkaSystemAdmin.java:461) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin.access$400(KafkaSystemAdmin.java:76) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin$4.apply(KafkaSystemAdmin.java:340) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin$4.apply(KafkaSystemAdmin.java:337) >> at >> org.apache.samza.util.ExponentialSleepStrategy.run(ExponentialSleepStrategy.scala:90) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin.getSystemStreamMetadata(KafkaSystemAdmin.java:374) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin.getSystemStreamMetadata(KafkaSystemAdmin.java:292) >> at >> org.apache.samza.coordinator.stream.CoordinatorStreamSystemConsumer.register(CoordinatorStreamSystemConsumer.java:109) >> at org.apache.samza.job.JobRunner.run(JobRunner.scala:105) >> at >> org.apache.samza.runtime.RemoteApplicationRunner.lambda$run$0(RemoteApplicationRunner.java:76) >> at java.util.ArrayList.forEach(ArrayList.java:1255) >> at >> org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:73) >> at >> org.apache.samza.runtime.ApplicationRunnerUtil.invoke(ApplicationRunnerUtil.java:49) >> at >> org.apache.samza.runtime.ApplicationRunnerMain.main(ApplicationRunnerMain.java:53) >> Exception in thread "main" org.apache.samza.SamzaException: Failed to run >> application >> at >> org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:79) >> at >> org.apache.samza.runtime.ApplicationRunnerUtil.invoke(ApplicationRunnerUtil.java:49) >> at >> org.apache.samza.runtime.ApplicationRunnerMain.main(ApplicationRunnerMain.java:53) >> Caused by: org.apache.samza.SamzaException: java.lang.NullPointerException >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin$5.apply(KafkaSystemAdmin.java:358) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin$5.apply(KafkaSystemAdmin.java:347) >> at >> org.apache.samza.util.ExponentialSleepStrategy.run(ExponentialSleepStrategy.scala:97) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin.getSystemStreamMetadata(KafkaSystemAdmin.java:374) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin.getSystemStreamMetadata(KafkaSystemAdmin.java:292) >> at >> org.apache.samza.coordinator.stream.CoordinatorStreamSystemConsumer.register(CoordinatorStreamSystemConsumer.java:109) >> at org.apache.samza.job.JobRunner.run(JobRunner.scala:105) >> at >> org.apache.samza.runtime.RemoteApplicationRunner.lambda$run$0(RemoteApplicationRunner.java:76) >> at java.util.ArrayList.forEach(ArrayList.java:1255) >> at >> org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:73) >> ... 2 more >> Caused by: java.lang.NullPointerException >> at >> java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936) >> at >> org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:75) >> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:253) >> at kafka.utils.Logging.logger(Logging.scala:43) >> at kafka.utils.Logging.debug(Logging.scala:62) >> at kafka.utils.Logging.debug$(Logging.scala:62) >> at >> org.apache.samza.system.kafka.KafkaSystemAdminUtilsScala$.debug(KafkaSystemAdminUtilsScala.scala:45) >> at >> org.apache.samza.system.kafka.KafkaSystemAdminUtilsScala$.assembleMetadata(KafkaSystemAdminUtilsScala.scala:74) >> at >> org.apache.samza.system.kafka.KafkaSystemAdminUtilsScala.assembleMetadata(KafkaSystemAdminUtilsScala.scala) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin.fetchSystemStreamMetadata(KafkaSystemAdmin.java:461) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin.access$400(KafkaSystemAdmin.java:76) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin$4.apply(KafkaSystemAdmin.java:340) >> at >> org.apache.samza.system.kafka.KafkaSystemAdmin$4.apply(KafkaSystemAdmin.java:337) >> at >> org.apache.samza.util.ExponentialSleepStrategy.run(ExponentialSleepStrategy.scala:90) >> ... 9 more >> >> >> >> When using Kafka_2.12-0.11.0.2.jar,coordinator stream meta info >> can be retrieved successfully. >> >> So I want to know the supported Kafka version by Samza, thanks! >> >> >> Qi Shu