Hi Andrey,
Flink version: 1.4.2 Please find the client log attached and job manager log is at: job manager log<https://drive.google.com/file/d/1iNOs2E69jevF9pu1t7uw6Gj2XZKJoWpC/view?usp=sharing>. Thanks, -Fakrudeen (define (sqrte n xn eph) (if (> eph (abs (- n (* xn xn)))) xn (sqrte n (/ (+ xn (/ n xn)) 2) eph))) From: Andrey Zagrebin <and...@ververica.com> Date: Friday, July 19, 2019 at 10:36 AM To: Fakrudeen Ali Ahmed <aliah...@adobe.com> Cc: "user@flink.apache.org" <user@flink.apache.org> Subject: Re: Job submission timeout with no error info. Hi Fakrudeen, which Flink version do you use? could you share full client and job manager logs? Best, Andrey On Fri, Jul 19, 2019 at 7:00 PM Fakrudeen Ali Ahmed <aliah...@adobe.com<mailto:aliah...@adobe.com>> wrote: Hi, We are submitting a Flink topology [YARN] and it fails during upload of the jar with no error info. [main] INFO org.apache.flink.runtime.client.JobClient - Checking and uploading JAR files [main] ERROR org.apache.flink.client.CliFrontend - Error while running the command. org.apache.flink.client.program.ProgramInvocationException: The program execution failed: JobManager did not respond within 60000 ms Flink UI says: “Could not retrieve the redirect address of the current leader. Please try to refresh.” We tried increasing job manager memory to 8GB and still it has the same issue. Jar size is around 190 MB but we were able to successfully run this size before. Zookeeper in Hadoop YARN cluster is healthy. How do we start debugging this? Is it some dependency jar issue in our uber jar or something else? Thanks, -Fakrudeen (define (sqrte n xn eph) (if (> eph (abs (- n (* xn xn)))) xn (sqrte n (/ (+ xn (/ n xn)) 2) eph)))
realtime@hn0-realti:~/ahmedf$ /usr/share/flink-1.4.2/bin/flink run -d -yid application_1560557574938_0046 -yn 2 -ys 4 -c com.adobe.platform.identity.services.realtime.QualityEvaluationPipeline /tmp/realtimegraph.fakrudeen.July18.jar 2 >&1 > out.topology.txt SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/share/flink-1.4.2/lib/flink-metrics-0.1.0-fat.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/share/flink-1.4.2/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.6.5.3005-27/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory] [main] INFO org.apache.flink.client.CliFrontend - -------------------------------------------------------------------------------- [main] INFO org.apache.flink.client.CliFrontend - Starting Command Line Client (Version: 1.4.2, Rev:04e4c85, Date:28.02.2018 @ 12:53:14 UTC) [main] INFO org.apache.flink.client.CliFrontend - OS current user: realtime [main] INFO org.apache.flink.client.CliFrontend - Current Hadoop/Kerberos user: realtime [main] INFO org.apache.flink.client.CliFrontend - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.191-b12 [main] INFO org.apache.flink.client.CliFrontend - Maximum heap size: 6254 MiBytes [main] INFO org.apache.flink.client.CliFrontend - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64 [main] INFO org.apache.flink.client.CliFrontend - Hadoop version: 2.8.1 [main] INFO org.apache.flink.client.CliFrontend - JVM Options: [main] INFO org.apache.flink.client.CliFrontend - -Dlog.file=/usr/share/flink-1.4.2/log/flink-realtime-client-hn0-realti.log [main] INFO org.apache.flink.client.CliFrontend - -Dlog4j.configuration=file:/usr/share/flink-1.4.2/conf/log4j-cli.properties [main] INFO org.apache.flink.client.CliFrontend - -Dlogback.configurationFile=file:/usr/share/flink-1.4.2/conf/logback.xml [main] INFO org.apache.flink.client.CliFrontend - Program Arguments: [main] INFO org.apache.flink.client.CliFrontend - run [main] INFO org.apache.flink.client.CliFrontend - -d [main] INFO org.apache.flink.client.CliFrontend - -yid [main] INFO org.apache.flink.client.CliFrontend - application_1560557574938_0046 [main] INFO org.apache.flink.client.CliFrontend - -yn [main] INFO org.apache.flink.client.CliFrontend - 2 [main] INFO org.apache.flink.client.CliFrontend - -ys [main] INFO org.apache.flink.client.CliFrontend - 4 [main] INFO org.apache.flink.client.CliFrontend - -c [main] INFO org.apache.flink.client.CliFrontend - com.adobe.platform.identity.services.realtime.QualityEvaluationPipeline [main] INFO org.apache.flink.client.CliFrontend - /tmp/realtimegraph.fakrudeen.July18.jar [main] INFO org.apache.flink.client.CliFrontend - 2 [main] INFO org.apache.flink.client.CliFrontend - Classpath: /usr/share/flink-1.4.2/lib/flink-hadoop-compatibility_2.11-1.4.2.jar:/usr/share/flink-1.4.2/lib/flink-metrics-0.1.0-fat.jar:/usr/share/flink-1.4.2/lib/flink-python_2.11-1.4.2.jar:/usr/share/flink-1.4.2/lib/flink-s3-fs-hadoop-1.4.2.jar:/usr/share/flink-1.4.2/lib/hadoop-mapreduce-client-core-2.8.0.jar:/usr/share/flink-1.4.2/lib/log4j-1.2.17.jar:/usr/share/flink-1.4.2/lib/newrelic-api.jar:/usr/share/flink-1.4.2/lib/newrelic.jar:/usr/share/flink-1.4.2/lib/slf4j-log4j12-1.7.7.jar:/usr/share/flink-1.4.2/lib/flink-dist_2.11-1.4.2.jar::/etc/hadoop/conf::/usr/hdp/2.6.5.3005-27/hadoop/conf:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-hadoop1-0.3.0.2.6.99.201-SNAPSHOT.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/hadoop-lzo-0.6.0.2.6.5.3005-27-javadoc.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-spi-0.3.0.2.6.99.201-SNAPSHOT.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/ranger-yarn-plugin-shim-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/activation-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/ranger-hdfs-plugin-shim-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-hadoop2-0.3.0.2.6.99.201-SNAPSHOT.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-bookkeeper-0.3.0.2.6.99.201-SNAPSHOT.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/aws-java-sdk-core-1.10.6.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/servlet-api-2.5.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-presto-0.3.0.2.6.99.201-SNAPSHOT.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/curator-client-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-rpm-0.3.0.2.6.99.201-SNAPSHOT.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/slf4j-api-1.7.10.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-configuration-1.6.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jettison-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jets3t-0.9.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/zookeeper-3.4.6.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/azure-keyvault-core-1.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/json-simple-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/netty-3.6.2.Final.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jersey-server-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/paranamer-2.3.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/xz-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/hadoop-lzo-0.6.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-io-2.4.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/stax-api-1.0-2.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-core-0.3.0.2.6.99.201-SNAPSHOT.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-net-3.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/aws-java-sdk-s3-1.10.6.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/ojdbc6.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/json-20090211.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-core-0.3.0.2.6.99.201-SNAPSHOT-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/aws-java-sdk-kms-1.10.6.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/json-smart-1.3.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/hadoop-lzo-0.6.0.2.6.5.3005-27-sources.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-tests-0.3.0.2.6.99.201-SNAPSHOT.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jersey-core-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/azure-storage-7.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/asm-3.2.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/microsoft-log4j-etwappender-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/xmlenc-0.52.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/joda-time-2.9.4.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/rubix-tests-0.3.0.2.6.99.201-SNAPSHOT-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/curator-framework-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-digester-1.8.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/guava-11.0.2.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/junit-4.11.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/mdsdclient-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/ranger-plugin-classloader-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/gson-2.2.4.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/jersey-json-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop/lib/commons-codec-1.4.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-aws-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-azure-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-aws.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-azure-datalake-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-annotations.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-common-2.7.3.2.6.5.3005-27-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-annotations-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-auth.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-nfs.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-nfs-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-azure.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-common.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-auth-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//azure-data-lake-store-sdk-2.2.5.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-common-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-common-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//hadoop-azure-datalake.jar:/usr/hdp/2.6.5.3005-27/hadoop/.//gcs-connector-1.8.1.2.6.5.3005-27-shaded.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/./:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/json-simple-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/json-20090211.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/adls2-oauth2-token-provider-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/adls2-oauth2-token-provider.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/azure-data-lake-store-sdk.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/asm-3.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/microsoft-log4j-etwappender-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/hadoop-azure-datalake.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/mdsdclient-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/.//hadoop-hdfs-nfs-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/.//hadoop-hdfs-2.7.3.2.6.5.3005-27-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/.//hadoop-hdfs-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/2.6.5.3005-27/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/activation-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/mssql-jdbc-7.0.0.jre8.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/objenesis-2.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/curator-client-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jackson-databind-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/httpcore-4.4.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-configuration-1.6.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jettison-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jets3t-0.9.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/zookeeper-3.4.6.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/azure-keyvault-core-1.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/json-simple-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/netty-3.6.2.Final.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jcip-annotations-1.0-1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/metrics-core-3.0.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/paranamer-2.3.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/xz-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/avro-1.7.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-io-2.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-net-3.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/guice-3.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/json-20090211.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/hdinsight-ats-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-math3-3.1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/json-smart-1.3.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jackson-annotations-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-dbcp2-2.0.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jsp-api-2.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/azure-storage-7.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-pool2-2.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jackson-core-2.7.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-lang3-3.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/zookeeper-3.4.6.2.6.5.3005-27-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/asm-3.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/fst-2.24.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/microsoft-log4j-etwappender-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jsch-0.1.54.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/xmlenc-0.52.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/wildfly-openssl-1.0.4.Final.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/curator-framework-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-digester-1.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/guava-11.0.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/mdsdclient-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/httpclient-4.5.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/gson-2.2.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-client-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-registry-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-common-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-tests-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-common-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-api-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/mssql-jdbc-7.0.0.jre8.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/xz-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/avro-1.7.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/guice-3.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/hdinsight-ats-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/commons-dbcp2-2.0.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/commons-pool2-2.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/asm-3.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/lib/junit-4.11.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-gridmix-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//activation-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-ant.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jackson-jaxrs-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//httpcore-4.4.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-extras-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jettison-1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-ant-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jackson-xc-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//zookeeper-3.4.6.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-auth.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//azure-keyvault-core-1.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-distcp-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//netty-3.6.2.Final.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jcip-annotations-1.0-1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//metrics-core-3.0.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//xz-1.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jackson-core-asl-1.9.13.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//nimbus-jose-jwt-4.41.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//avro-1.7.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-sls-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-rumen-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jetty-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//json-smart-1.3.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-openstack-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-archives-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-auth-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-lang3-3.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//asm-3.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jsr305-3.0.0.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.3.2.6.5.3005-27-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jsch-0.1.54.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-streaming-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//wildfly-openssl-1.0.4.Final.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-datajoin-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//junit-4.11.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//httpclient-4.5.2.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/2.6.5.3005-27/hadoop-mapreduce/.//commons-codec-1.4.jar::/usr/hdp/current/hadoop-mapreduce-client/hadoop-sls.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-gridmix-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/activation-1.1.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-compress-1.4.1.jar:/usr/hdp/current/hadoop-mapreduce-client/api-util-1.0.0-M20.jar:/usr/hdp/current/hadoop-mapreduce-client/jaxb-api-2.2.2.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-httpclient-3.1.jar:/usr/hdp/current/hadoop-mapreduce-client/servlet-api-2.5.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-ant.jar:/usr/hdp/current/hadoop-mapreduce-client/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/hadoop-mapreduce-client/curator-client-2.7.1.jar:/usr/hdp/current/hadoop-mapreduce-client/httpcore-4.4.4.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-examples-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-extras-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-configuration-1.6.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-hs-plugins-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-collections-3.2.2.jar:/usr/hdp/current/hadoop-mapreduce-client/jettison-1.1.jar:/usr/hdp/current/hadoop-mapreduce-client/hamcrest-core-1.3.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-ant-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/jets3t-0.9.0.jar:/usr/hdp/current/hadoop-mapreduce-client/jackson-xc-1.9.13.jar:/usr/hdp/current/hadoop-mapreduce-client/protobuf-java-2.5.0.jar:/usr/hdp/current/hadoop-mapreduce-client/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/hadoop-mapreduce-client/zookeeper-3.4.6.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-app-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-auth.jar:/usr/hdp/current/hadoop-mapreduce-client/azure-keyvault-core-1.0.0.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-extras.jar:/usr/hdp/current/hadoop-mapreduce-client/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-distcp-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/mockito-all-1.8.5.jar:/usr/hdp/current/hadoop-mapreduce-client/netty-3.6.2.Final.jar:/usr/hdp/current/hadoop-mapreduce-client/jcip-annotations-1.0-1.jar:/usr/hdp/current/hadoop-mapreduce-client/metrics-core-3.0.1.jar:/usr/hdp/current/hadoop-mapreduce-client/jersey-server-1.9.jar:/usr/hdp/current/hadoop-mapreduce-client/paranamer-2.3.jar:/usr/hdp/current/hadoop-mapreduce-client/xz-1.0.jar:/usr/hdp/current/hadoop-mapreduce-client/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hadoop-mapreduce-client/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hadoop-mapreduce-client/avro-1.7.4.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-io-2.4.jar:/usr/hdp/current/hadoop-mapreduce-client/stax-api-1.0-2.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-sls-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/snappy-java-1.0.4.1.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-beanutils-1.7.0.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-net-3.1.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-cli-1.2.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-app.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-openstack.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-math3-3.1.1.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-rumen-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-lang-2.6.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-hs-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/java-xmlbuilder-0.4.jar:/usr/hdp/current/hadoop-mapreduce-client/jetty-6.1.26.hwx.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-examples.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-beanutils-core-1.8.0.jar:/usr/hdp/current/hadoop-mapreduce-client/json-smart-1.3.1.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-openstack-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-archives-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-common-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hadoop-mapreduce-client/api-asn1-api-1.0.0-M20.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-auth-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/jersey-core-1.9.jar:/usr/hdp/current/hadoop-mapreduce-client/jsp-api-2.1.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-lang3-3.4.jar:/usr/hdp/current/hadoop-mapreduce-client/asm-3.2.jar:/usr/hdp/current/hadoop-mapreduce-client/jsr305-3.0.0.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-common.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-2.7.3.2.6.5.3005-27-tests.jar:/usr/hdp/current/hadoop-mapreduce-client/jsch-0.1.54.jar:/usr/hdp/current/hadoop-mapreduce-client/xmlenc-0.52.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-logging-1.1.3.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-streaming.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-distcp.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-hs.jar:/usr/hdp/current/hadoop-mapreduce-client/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/current/hadoop-mapreduce-client/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hadoop-mapreduce-client/log4j-1.2.17.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-streaming-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/curator-recipes-2.7.1.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-rumen.jar:/usr/hdp/current/hadoop-mapreduce-client/wildfly-openssl-1.0.4.Final.jar:/usr/hdp/current/hadoop-mapreduce-client/curator-framework-2.7.1.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-datajoin-2.7.3.2.6.5.3005-27.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-digester-1.8.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-datajoin.jar:/usr/hdp/current/hadoop-mapreduce-client/guava-11.0.2.jar:/usr/hdp/current/hadoop-mapreduce-client/junit-4.11.jar:/usr/hdp/current/hadoop-mapreduce-client/httpclient-4.5.2.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-gridmix.jar:/usr/hdp/current/hadoop-mapreduce-client/gson-2.2.4.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/current/hadoop-mapreduce-client/jersey-json-1.9.jar:/usr/hdp/current/hadoop-mapreduce-client/hadoop-archives.jar:/usr/hdp/current/hadoop-mapreduce-client/commons-codec-1.4.jar:/usr/hdp/2.6.5.3005-27/tez/tez-yarn-timeline-cache-plugin-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-api-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-history-parser-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-job-analyzer-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-runtime-internals-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-yarn-timeline-history-with-fs-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-runtime-library-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-examples-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-yarn-timeline-history-with-acls-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-common-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-mapreduce-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-yarn-timeline-history-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-tests-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/tez-dag-0.7.0.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/commons-collections4-4.1.jar:/usr/hdp/2.6.5.3005-27/tez/lib/hadoop-aws-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/hadoop-yarn-server-web-proxy-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/servlet-api-2.5.jar:/usr/hdp/2.6.5.3005-27/tez/lib/hadoop-azure-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/hadoop-azure-datalake-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/2.6.5.3005-27/tez/lib/jettison-1.3.4.jar:/usr/hdp/2.6.5.3005-27/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.5.3005-27/tez/lib/hadoop-annotations-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/jersey-client-1.9.jar:/usr/hdp/2.6.5.3005-27/tez/lib/slf4j-api-1.7.5.jar:/usr/hdp/2.6.5.3005-27/tez/lib/commons-io-2.4.jar:/usr/hdp/2.6.5.3005-27/tez/lib/jsr305-2.0.3.jar:/usr/hdp/2.6.5.3005-27/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/2.6.5.3005-27/tez/lib/commons-cli-1.2.jar:/usr/hdp/2.6.5.3005-27/tez/lib/hadoop-yarn-server-timeline-pluginstorage-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/2.6.5.3005-27/tez/lib/commons-lang-2.6.jar:/usr/hdp/2.6.5.3005-27/tez/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/tez/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.6.5.3005-27/tez/lib/hadoop-mapreduce-client-common-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/azure-data-lake-store-sdk-2.1.4.jar:/usr/hdp/2.6.5.3005-27/tez/lib/hadoop-mapreduce-client-core-2.7.3.2.6.5.3005-27.jar:/usr/hdp/2.6.5.3005-27/tez/lib/gcs-connector-1.8.1.2.6.5.3005-27-shaded.jar:/usr/hdp/2.6.5.3005-27/tez/lib/guava-11.0.2.jar:/usr/hdp/2.6.5.3005-27/tez/lib/jersey-json-1.9.jar:/usr/hdp/2.6.5.3005-27/tez/lib/commons-codec-1.4.jar:/usr/hdp/2.6.5.3005-27/tez/conf [main] INFO org.apache.flink.client.CliFrontend - -------------------------------------------------------------------------------- [main] INFO org.apache.flink.client.CliFrontend - Using configuration directory /usr/share/flink-1.4.2/conf [main] INFO org.apache.flink.client.CliFrontend - Trying to load configuration file [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 2048 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 10240 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 4 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.preallocate, false [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: web.port, 8081 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: fs.hdfs.hadoopconf, /etc/hadoop/conf/ [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: classloader.resolve-order, parent-first [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.latency.interval, 1000 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporters, new_relic_reporter, console_reporter, observability_reporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledNewRelicReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledObservabilityReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledConsoleReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.report-interval-sec, 60 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.jm.job, <job_name>.<host>.jobmanager [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.task, <job_name>.<host>.taskmanager.<tm_id>.task.<task_name>.<subtask_index> [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.operator, <job_name>.<host>.taskmanager.<tm_id>.operator.<operator_name>.<subtask_index> [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: env.java.opts, -javaagent:lib/newrelic.jar -Dnewrelic.config.file=lib/newrelic.yml -Dmetrics-sdk.environment_name=dev -Dmetrics-sdk.ims_client_id=acp_core_identity_data [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.framesize, "209715200b" [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 2048 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 10240 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 4 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.preallocate, false [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: web.port, 8081 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: fs.hdfs.hadoopconf, /etc/hadoop/conf/ [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: classloader.resolve-order, parent-first [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.latency.interval, 1000 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporters, new_relic_reporter, console_reporter, observability_reporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledNewRelicReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledObservabilityReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledConsoleReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.report-interval-sec, 60 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.jm.job, <job_name>.<host>.jobmanager [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.task, <job_name>.<host>.taskmanager.<tm_id>.task.<task_name>.<subtask_index> [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.operator, <job_name>.<host>.taskmanager.<tm_id>.operator.<operator_name>.<subtask_index> [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: env.java.opts, -javaagent:lib/newrelic.jar -Dnewrelic.config.file=lib/newrelic.yml -Dmetrics-sdk.environment_name=dev -Dmetrics-sdk.ims_client_id=acp_core_identity_data [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.framesize, "209715200b" [main] INFO org.apache.flink.runtime.security.modules.HadoopModule - Hadoop user set to realtime (auth:SIMPLE) [main] INFO org.apache.flink.client.CliFrontend - Running 'run' command. [main] INFO org.apache.flink.client.CliFrontend - Building program from JAR file [main] INFO org.apache.flink.yarn.YarnClusterDescriptor - Found application JobManager host name 'wn102-realti.kqx3zvog2keubh3xevwwysjuye.cx.internal.cloudapp.net' and port '38191' from supplied application id 'application_1560557574938_0046' [main] INFO org.apache.flink.client.CliFrontend - Cluster configuration: Yarn cluster with application id application_1560557574938_0046 [main] INFO org.apache.flink.client.CliFrontend - Using address wn102-realti.kqx3zvog2keubh3xevwwysjuye.cx.internal.cloudapp.net:38191 to connect to JobManager. [main] INFO org.apache.flink.client.CliFrontend - JobManager web interface address http://hn0-realti.kqx3zvog2keubh3xevwwysjuye.cx.internal.cloudapp.net:8088/proxy/application_1560557574938_0046/ [main] INFO org.apache.flink.client.CliFrontend - Using the parallelism provided by the remote cluster (1). To use another parallelism, set it at the ./bin/flink client. [main] INFO org.apache.flink.client.CliFrontend - Starting execution of program [main] INFO org.apache.flink.yarn.YarnClusterClient - Starting program in interactive mode [main] INFO com.adobe.platform.identity.services.realtime.QualityEvaluationPipeline - Setting up event source... [main] INFO org.apache.hadoop.metrics2.impl.MetricsConfig - loaded properties from hadoop-metrics2-azure-file-system.properties [main] INFO org.apache.hadoop.metrics2.sink.WasbAzureIaasSink - Init starting. [main] INFO org.apache.hadoop.metrics2.sink.AzureIaasSink - Init starting. Initializing MdsLogger. [main] INFO org.apache.hadoop.metrics2.sink.AzureIaasSink - Init completed. [main] INFO org.apache.hadoop.metrics2.sink.WasbAzureIaasSink - Init completed. [main] INFO org.apache.hadoop.metrics2.impl.MetricsSinkAdapter - Sink azurefs2 started [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 2048 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 10240 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 4 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.preallocate, false [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: web.port, 8081 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: fs.hdfs.hadoopconf, /etc/hadoop/conf/ [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: classloader.resolve-order, parent-first [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.latency.interval, 1000 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporters, new_relic_reporter, console_reporter, observability_reporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledNewRelicReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.new_relic_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledObservabilityReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.observability_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.class, com.adobe.platform.identity.services.realtime.metrics.ScheduledConsoleReporter [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.interval, 60 SECONDS [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.report-interval-sec, 60 [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.reporter.console_reporter.env-name, dev [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.jm.job, <job_name>.<host>.jobmanager [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.task, <job_name>.<host>.taskmanager.<tm_id>.task.<task_name>.<subtask_index> [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: metrics.scope.operator, <job_name>.<host>.taskmanager.<tm_id>.operator.<operator_name>.<subtask_index> [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: env.java.opts, -javaagent:lib/newrelic.jar -Dnewrelic.config.file=lib/newrelic.yml -Dmetrics-sdk.environment_name=dev -Dmetrics-sdk.ims_client_id=acp_core_identity_data [main] INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.framesize, "209715200b" [main] INFO com.adobe.platform.identity.services.realtime.HDFSSource - Connection to HDFS path successful:wasb://s3/job_1557924141373_0439-r-00159 [main] INFO com.adobe.platform.identity.services.realtime.QualityEvaluationPipeline - Setting up determinisitic path... [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class com.adobe.platform.identity.services.instagraph.manager.GraphUpdate does not contain a setter for field addedEdges [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class com.adobe.platform.identity.services.instagraph.manager.GraphUpdate is not a valid POJO type because not all fields are valid POJO fields. [main] INFO com.adobe.platform.identity.services.realtime.QualityEvaluationPipeline - Setting up Graph update layer ... [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class com.adobe.platform.identity.services.instagraph.manager.GraphUpdate does not contain a setter for field addedEdges [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class com.adobe.platform.identity.services.instagraph.manager.GraphUpdate is not a valid POJO type because not all fields are valid POJO fields. [main] WARN org.apache.flink.streaming.api.environment.StreamContextEnvironment - Job was executed in detached mode, the results will be available on completion. [main] INFO com.adobe.platform.identity.services.realtime.QualityEvaluationPipeline - Successfully started the pipeline. [main] INFO org.apache.flink.yarn.YarnClusterClient - Waiting until all TaskManagers have connected [main] INFO org.apache.flink.yarn.YarnClusterClient - Starting client actor system. [main] INFO org.apache.flink.runtime.util.LeaderRetrievalUtils - Trying to select the network interface and address to use by connecting to the leading JobManager. [main] INFO org.apache.flink.runtime.util.LeaderRetrievalUtils - TaskManager will try to connect for 10000 milliseconds before falling back to heuristics [main] INFO org.apache.flink.runtime.net.ConnectionUtils - Retrieved new target address wn102-realti.kqx3zvog2keubh3xevwwysjuye.cx.internal.cloudapp.net/10.0.0.42:38191. [main] INFO org.apache.flink.yarn.YarnClusterClient - Trying to start actor system at hn0-realti.kqx3zvog2keubh3xevwwysjuye.cx.internal.cloudapp.net:0 [flink-akka.actor.default-dispatcher-5] INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started [flink-akka.actor.default-dispatcher-4] INFO akka.remote.Remoting - Starting remoting [flink-akka.actor.default-dispatcher-4] INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://fl...@hn0-realti.kqx3zvog2keubh3xevwwysjuye.cx.internal.cloudapp.net:44091] [main] INFO org.apache.flink.yarn.YarnClusterClient - Actor system started at akka.tcp://fl...@hn0-realti.kqx3zvog2keubh3xevwwysjuye.cx.internal.cloudapp.net:44091 [main] INFO org.apache.flink.yarn.YarnClusterClient - TaskManager status (4/-1) [main] INFO org.apache.flink.yarn.YarnClusterClient - All TaskManagers are connected [main] INFO org.apache.flink.yarn.YarnClusterClient - Submitting Job with JobID: 3a74fc2ce24793ba3f95db4054534471. Returning after job submission. [main] INFO org.apache.flink.runtime.client.JobClient - Checking and uploading JAR files [main] ERROR org.apache.flink.client.CliFrontend - Error while running the command. org.apache.flink.client.program.ProgramInvocationException: The program execution failed: JobManager did not respond within 60000 ms at org.apache.flink.client.program.ClusterClient.runDetached(ClusterClient.java:524) at org.apache.flink.yarn.YarnClusterClient.submitJob(YarnClusterClient.java:213) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:456) at org.apache.flink.client.program.DetachedEnvironment.finalizeExecute(DetachedEnvironment.java:77) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:402) at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:802) at org.apache.flink.client.CliFrontend.run(CliFrontend.java:282) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1054) at org.apache.flink.client.CliFrontend$1.call(CliFrontend.java:1101) at org.apache.flink.client.CliFrontend$1.call(CliFrontend.java:1098) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41) at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1098) Caused by: org.apache.flink.runtime.client.JobTimeoutException: JobManager did not respond within 60000 ms at org.apache.flink.runtime.client.JobClient.submitJobDetached(JobClient.java:437) at org.apache.flink.client.program.ClusterClient.runDetached(ClusterClient.java:516) ... 14 more Caused by: java.util.concurrent.TimeoutException at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1771) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915) at org.apache.flink.runtime.client.JobClient.submitJobDetached(JobClient.java:435) ... 15 more ------------------------------------------------------------ The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The program execution failed: JobManager did not respond within 60000 ms at org.apache.flink.client.program.ClusterClient.runDetached(ClusterClient.java:524) at org.apache.flink.yarn.YarnClusterClient.submitJob(YarnClusterClient.java:213) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:456) at org.apache.flink.client.program.DetachedEnvironment.finalizeExecute(DetachedEnvironment.java:77) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:402) at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:802) at org.apache.flink.client.CliFrontend.run(CliFrontend.java:282) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1054) at org.apache.flink.client.CliFrontend$1.call(CliFrontend.java:1101) at org.apache.flink.client.CliFrontend$1.call(CliFrontend.java:1098) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41) at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1098) Caused by: org.apache.flink.runtime.client.JobTimeoutException: JobManager did not respond within 60000 ms at org.apache.flink.runtime.client.JobClient.submitJobDetached(JobClient.java:437) at org.apache.flink.client.program.ClusterClient.runDetached(ClusterClient.java:516) ... 14 more Caused by: java.util.concurrent.TimeoutException at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1771) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915) at org.apache.flink.runtime.client.JobClient.submitJobDetached(JobClient.java:435) ... 15 more [main] INFO org.apache.flink.yarn.YarnClusterClient - Disconnecting YarnClusterClient from ApplicationMaster [flink-akka.actor.default-dispatcher-17] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon. [flink-akka.actor.default-dispatcher-17] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. [azurefs2] INFO org.apache.hadoop.metrics2.impl.MetricsSinkAdapter - azurefs2 thread interrupted.
