Hi Qi, Can you share your application configuration? Especially the systems your application consumes and produces to and its related configuration. Also, would it be possible for to attach the entire log?
Thanks, Bharath On Tue, May 28, 2019 at 7:07 PM QiShu <sh...@eefung.com> wrote: > Hi, > > Below is the running environment: > Hadoop version 3.1.0 > java version “1.8.0_151" > samza-api-1.1.0.jar > samza-core_2.12-1.1.0.jar > samza-kafka_2.12-1.1.0.jar > samza-kv_2.12-1.1.0.jar > samza-kv-inmemory_2.12-1.1.0.jar > samza-kv-rocksdb_2.12-1.1.0.jar > samza-log4j_2.12-1.1.0.jar > samza-shell-1.1.0-dist.tgz > samza-yarn_2.12-1.1.0.jar > scala-compiler-2.12.1.jar > scala-library-2.12.1.jar > scala-logging_2.12-3.7.2.jar > scala-parser-combinators_2.12-1.0.4.jar > scala-reflect-2.12.4.jar > scalate-core_2.12-1.8.0.jar > scalate-util_2.12-1.8.0.jar > scalatra_2.12-2.5.0.jar > scalatra-common_2.12-2.5.0.jar > scalatra-scalate_2.12-2.5.0.jar > scala-xml_2.12-1.0.6.jar > kafka_2.12-1.1.0.jar > kafka-clients-1.1.0.jar > > Below is the exception when starting app in Yarn: > 2019-05-29 09:52:47.851 [main] AppInfoParser [INFO] Kafka version : 1.1.0 > 2019-05-29 09:52:47.851 [main] AppInfoParser [INFO] Kafka commitId : > fdcf75ea326b8e07 > 2019-05-29 09:52:47.862 [main] Log4jControllerRegistration$ [INFO] > Registered kafka:type=kafka.Log4jController MBean > 2019-05-29 09:52:47.877 [main] KafkaSystemAdmin [INFO] Created > KafkaSystemAdmin for system kafka > Exception in thread "main" org.apache.samza.SamzaException: Failed to run > application > at > org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:79) > at > org.apache.samza.runtime.ApplicationRunnerUtil.invoke(ApplicationRunnerUtil.java:49) > at > org.apache.samza.runtime.ApplicationRunnerMain.main(ApplicationRunnerMain.java:53) > Caused by: java.lang.NullPointerException > at java.util.HashMap.merge(HashMap.java:1225) > at > java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1320) > at > java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169) > at > java.util.HashMap$EntrySpliterator.forEachRemaining(HashMap.java:1696) > at > java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) > at > java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) > at > java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) > at > java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) > at > org.apache.samza.config.JavaSystemConfig.getSystemAdmins(JavaSystemConfig.java:84) > at > org.apache.samza.system.SystemAdmins.<init>(SystemAdmins.java:38) > at > org.apache.samza.execution.StreamManager.<init>(StreamManager.java:55) > at > org.apache.samza.execution.JobPlanner.buildAndStartStreamManager(JobPlanner.java:64) > at > org.apache.samza.execution.JobPlanner.getExecutionPlan(JobPlanner.java:94) > at > org.apache.samza.execution.RemoteJobPlanner.prepareJobs(RemoteJobPlanner.java:57) > at > org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:67) > ... 2 more > > > Thanks for your help! > > Qi Shu > > >
