mmiklavc edited a comment on issue #1523: METRON-2232 Upgrade to Hadoop 3.1.1 URL: https://github.com/apache/metron/pull/1523#issuecomment-540727383 There is a classpath problem starting up MaaS: ``` 19/10/10 18:55:17 INFO service.Client: Got application report from ASM for, appId=1, clientToAMToken=null, appDiagnostics=Application application_1570638455687_0001 failed 2 times due to AM Container for appattempt_1570638455687_0001_000002 exited with exitCode: 1 Failing this attempt.Diagnostics: [2019-10-10 18:55:17.199]Exception from container-launch. Container id: container_e01_1570638455687_0001_02_000001 Exit code: 1 [2019-10-10 18:55:17.206]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of AppMaster.stderr : 19/10/10 18:55:16 INFO service.ApplicationMaster: Initializing ApplicationMaster 19/10/10 18:55:16 INFO service.ApplicationMaster: Application master for app, appId=1, clustertimestamp=1570638455687, attemptId=2 19/10/10 18:55:16 INFO service.ApplicationMaster: Starting ApplicationMaster 19/10/10 18:55:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 19/10/10 18:55:16 INFO yarn.YarnUtils: Executing with tokens: 19/10/10 18:55:16 INFO yarn.YarnUtils: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 1 cluster_timestamp: 1570638455687 } attemptId: 2 } keyId: 1879176656) 19/10/10 18:55:17 INFO impl.TimelineClientImpl: Timeline service address: node1:8188 19/10/10 18:55:17 FATAL service.ApplicationMaster: Error running ApplicationMaster java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org.apache.hadoop.yarn.client.api.impl.TimelineConnector$TimelineClientConnectionRetry.<init>(TimelineConnector.java:304) at org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:121) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:130) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.metron.maas.service.ApplicationMaster$1.run(ApplicationMaster.java:564) at org.apache.metron.maas.service.ApplicationMaster$1.run(ApplicationMaster.java:557) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.metron.maas.service.ApplicationMaster.startTimelineClient(ApplicationMaster.java:557) at org.apache.metron.maas.service.ApplicationMaster.run(ApplicationMaster.java:448) at org.apache.metron.maas.service.ApplicationMaster.main(ApplicationMaster.java:312) log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.ExitUtil). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. [2019-10-10 18:55:17.207]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of AppMaster.stderr : 19/10/10 18:55:16 INFO service.ApplicationMaster: Initializing ApplicationMaster 19/10/10 18:55:16 INFO service.ApplicationMaster: Application master for app, appId=1, clustertimestamp=1570638455687, attemptId=2 19/10/10 18:55:16 INFO service.ApplicationMaster: Starting ApplicationMaster 19/10/10 18:55:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 19/10/10 18:55:16 INFO yarn.YarnUtils: Executing with tokens: 19/10/10 18:55:16 INFO yarn.YarnUtils: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 1 cluster_timestamp: 1570638455687 } attemptId: 2 } keyId: 1879176656) 19/10/10 18:55:17 INFO impl.TimelineClientImpl: Timeline service address: node1:8188 19/10/10 18:55:17 FATAL service.ApplicationMaster: Error running ApplicationMaster java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org.apache.hadoop.yarn.client.api.impl.TimelineConnector$TimelineClientConnectionRetry.<init>(TimelineConnector.java:304) at org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:121) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:130) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.metron.maas.service.ApplicationMaster$1.run(ApplicationMaster.java:564) at org.apache.metron.maas.service.ApplicationMaster$1.run(ApplicationMaster.java:557) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.metron.maas.service.ApplicationMaster.startTimelineClient(ApplicationMaster.java:557) at org.apache.metron.maas.service.ApplicationMaster.run(ApplicationMaster.java:448) at org.apache.metron.maas.service.ApplicationMaster.main(ApplicationMaster.java:312) log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.ExitUtil). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. For more detailed output, check the application tracking page: http://node1:8088/cluster/app/application_1570638455687_0001 Then click on links to logs of each attempt. . Failing the application., appMasterHost=N/A, appQueue=default, appMasterRpcPort=-1, appStartTime=1570733692831, yarnAppState=FAILED, distributedFinalState=FAILED, appTrackingUrl=http://node1:8088/cluster/app/application_1570638455687_0001, appUser=root 19/10/10 18:55:17 INFO service.Client: Application did not finish. YarnState=FAILED, DSFinalStatus=FAILED. Breaking monitoring loop 19/10/10 18:55:17 ERROR service.Client: Application failed to complete successfully ``` EDIT - I do not see this issue in master, so the problem appears to have been introduced by the Hadoop upgrade itself, or potentially other changes affecting classpath in the feature branch over the past several months.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
