Hi Stefan ,
Here is main class code :
final String outFile = getOutFileName(backupDir);
final Set<String> keys = getAllRedisKeys(parameters);
final ExecutionEnvironment env =
ExecutionEnvironment.getExecutionEnvironment();
env.setParallelism(parallelism);
env
.fromCollection(keys)
.rebalance()
.flatMap(new RedisRead()).withParameters(parameters.getConfiguration())
.writeAsText(outFile);
env.execute();
RedisRead -> simply read key one by one .
Memory Per task : 2048 MB
Attaching flink logs .
Let me know if I can help anything more .
Thanks and Regards
Sohi
On Tue, Sep 26, 2017 at 2:50 PM, Stefan Richter <s.rich...@data-artisans.com
> wrote:
> Hi,
>
> could you give us some more information like the size of your heap space,
> information about where and how you implemented access to Redis and how you
> kep the retrieved data, and most importantly a stack trace or (much better)
> a log?
>
> Best,
> Stefan
>
> > Am 26.09.2017 um 06:52 schrieb sohimankotia <sohimanko...@gmail.com>:
> >
> > Hi,
> >
> > I am getting Java Heap Space error while running Flink Job (Flink 1.2 ) .
> >
> > Use case : I am getting all keys from REDIS with specific pattern . Then
> > streaming over those keys and reading data from Redis for those key and
> > writing to file in HDFS .
> >
> > Job was running fine for few days but suddenly started giving Heap Space
> > error .
> >
> > Job Parallelism : 9 ( 3 nodes and 3 slots)
> >
> > Total Redis Keys : 1031966 ( aprox 33 MB in size (keys only))
> >
> >
> >
> > Logs :
> >
> >
> >
> >
> >
> >
> >
> > --
> > Sent from: http://apache-flink-user-mailing-list-archive.2336050.
> n4.nabble.com/
>
>
2017-09-25 22:30:55,502 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - --------------------------------------------------------------------------------
2017-09-25 22:30:55,503 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Starting YARN ApplicationMaster / JobManager (Version: <unknown>, Rev:76eba4e, Date:11.04.2017 @ 00:26:53 UTC)
2017-09-25 22:30:55,504 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Current user: hdfs
2017-09-25 22:30:55,504 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.121-b13
2017-09-25 22:30:55,504 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Maximum heap size: 406 MiBytes
2017-09-25 22:30:55,504 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - JAVA_HOME: /var/lib/hadoop-hdfs/jdk8/jdk1.8.0_121
2017-09-25 22:30:55,507 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Hadoop version: 2.3.0
2017-09-25 22:30:55,507 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - JVM Options:
2017-09-25 22:30:55,507 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - -Xmx424M
2017-09-25 22:30:55,507 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - -Djava.library.path=/opt/cloudera/parcels/CDH/lib/hadoop/lib/native/
2017-09-25 22:30:55,507 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - -Dlog.file=/var/log/hadoop-yarn/container/application_1503328266056_100730/container_e55_1503328266056_100730_01_000001/jobmanager.log
2017-09-25 22:30:55,507 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - -Dlog4j.configuration=file:log4j.properties
2017-09-25 22:30:55,507 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Program Arguments: (none)
2017-09-25 22:30:55,508 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Classpath: log4j.properties:cis-redis-ops.jar:lib/flink-dist_2.11-1.2.0.jar:lib/flink-hadoop-compatibility_2.11-1.2.0.jar:lib/flink-python_2.11-1.2.0.jar:lib/slf4j-log4j12-1.7.7.jar:lib/log4j-1.2.17.jar:lib/flink-shaded-hadoop2-1.2.0.jar:flink.jar:flink-conf.yaml::/etc/hadoop/conf.cloudera.yarn:/var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-annotations-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-common.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-encoding.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-pig-bundle.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-aws.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-auth-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-common.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-avro.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-generator.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-jackson.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-common-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-common-2.6.0-cdh5.5.1-tests.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-pig.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-auth.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-aws-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-format-javadoc.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-scala_2.10.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-thrift.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-cascading.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-tools.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-column.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-nfs.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-annotations.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-hadoop.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-format-sources.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-protobuf.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-common-tests.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-test-hadoop2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/hadoop-nfs-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-format.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-hadoop-bundle.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/parquet-scrooge_2.10.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/junit-4.11.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/zookeeper.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/gson-2.2.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/curator-client-2.7.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/logredactor-1.0.3.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/java-xmlbuilder-0.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/curator-framework-2.7.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-digester-1.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/avro.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/api-util-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/httpcore-4.2.5.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/hamcrest-core-1.3.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/curator-recipes-2.7.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/htrace-core4-4.0.1-incubating.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/hue-plugins-3.9.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/aws-java-sdk-1.7.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/hadoop-hdfs-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/hadoop-hdfs-2.6.0-cdh5.5.1-tests.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/hadoop-hdfs-nfs.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/hadoop-hdfs-nfs-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/hadoop-hdfs.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/hadoop-hdfs-tests.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-hdfs/lib/htrace-core4-4.0.1-incubating.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-registry.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-registry-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-client.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-tests-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-web-proxy.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-common-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-common.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-api-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-client-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-api.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-tests.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-common.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-common-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-nodemanager.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.5.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/spark-1.5.0-cdh5.5.1-yarn-shuffle.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/zookeeper.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/guice-3.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/spark-yarn-shuffle.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hadoop-yarn/lib/jline-2.11.jar
2017-09-25 22:30:55,509 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - --------------------------------------------------------------------------------
2017-09-25 22:30:55,510 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Registered UNIX signal handlers for [TERM, HUP, INT]
2017-09-25 22:30:55,513 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - remoteKeytabPrincipal obtained null
2017-09-25 22:30:55,514 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - YARN daemon is running as: hdfs Yarn client user obtainer: hdfs
2017-09-25 22:30:55,521 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Loading config from directory /mnt/vol1/yarn/nm/usercache/hdfs/appcache/application_1503328266056_100730/container_e55_1503328266056_100730_01_000001
2017-09-25 22:30:55,524 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, 192.168.3.150
2017-09-25 22:30:55,524 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2017-09-25 22:30:55,524 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 6144
2017-09-25 22:30:55,524 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 40960
2017-09-25 22:30:55,525 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.off-heap, true
2017-09-25 22:30:55,525 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 15
2017-09-25 22:30:55,525 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelization.degree.default, 10
2017-09-25 22:30:55,525 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.preallocate, false
2017-09-25 22:30:55,525 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2017-09-25 22:30:55,525 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.tmp.dirs, /mnt/vol2/tmp/flink-cluster-tmp-2
2017-09-25 22:30:55,526 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.web.port, 8081
2017-09-25 22:30:55,526 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: fs.hdfs.hadoopconf, /etc/hadoop/conf
2017-09-25 22:30:55,526 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: env.java.opts, "-Djava.library.path=/opt/cloudera/parcels/CDH/lib/hadoop/lib/native/"
2017-09-25 22:30:55,526 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: env.java.home, /var/lib/hadoop-hdfs/jdk8/jdk1.8.0_121
2017-09-25 22:30:55,526 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: yarn.application-master.env.JAVA_HOME, /var/lib/hadoop-hdfs/jdk8/jdk1.8.0_121
2017-09-25 22:30:55,526 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: yarn.taskmanager.env.JAVA_HOME, /var/lib/hadoop-hdfs/jdk8/jdk1.8.0_121
2017-09-25 22:30:55,527 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.framesize, 256477376b
2017-09-25 22:30:55,527 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.web.history, 100
2017-09-25 22:30:55,527 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: webclient.tempdir, /mnt/vol2/tmp/flink-webclient-tmp-2
2017-09-25 22:30:55,527 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: blob.storage.directory, /mnt/vol2/tmp/flink-blobstore-tmp-2
2017-09-25 22:30:55,527 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.fraction, 0.5
2017-09-25 22:30:55,527 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 60s
2017-09-25 22:30:55,528 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.client.timeout, 60s
2017-09-25 22:30:55,528 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.watch.heartbeat.interval, 60s
2017-09-25 22:30:55,528 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.watch.heartbeat.pause, 300s
2017-09-25 22:30:55,634 WARN org.apache.hadoop.conf.Configuration - /var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER/core-site.xml:an attempt to override final parameter: hadoop.ssl.require.client.cert; Ignoring.
2017-09-25 22:30:55,634 WARN org.apache.hadoop.conf.Configuration - /var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER/core-site.xml:an attempt to override final parameter: hadoop.ssl.keystores.factory.class; Ignoring.
2017-09-25 22:30:55,634 WARN org.apache.hadoop.conf.Configuration - /var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER/core-site.xml:an attempt to override final parameter: hadoop.ssl.server.conf; Ignoring.
2017-09-25 22:30:55,634 WARN org.apache.hadoop.conf.Configuration - /var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER/core-site.xml:an attempt to override final parameter: hadoop.ssl.client.conf; Ignoring.
2017-09-25 22:30:55,638 INFO org.apache.flink.runtime.security.modules.HadoopModule - Hadoop user set to hdfs (auth:SIMPLE)
2017-09-25 22:30:55,676 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - YARN assigned hostname for application master: dh-cdh-m1d5.dbp.dailyhunt.in
2017-09-25 22:30:55,716 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - TaskManagers will be created with 1 task slots
2017-09-25 22:30:55,717 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - TaskManagers will be started with container size 8000 MB, JVM heap size 3000 MB, JVM direct memory limit 6000 MB
2017-09-25 22:30:55,726 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Trying to start actor system at dh-cdh-m1d5.dbp.dailyhunt.in:17431
2017-09-25 22:30:56,630 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2017-09-25 22:30:56,697 INFO Remoting - Starting remoting
2017-09-25 22:30:57,131 INFO Remoting - Remoting started; listening on addresses :[akka.tcp://fl...@dh-cdh-m1d5.dbp.dailyhunt.in:17431]
2017-09-25 22:30:57,137 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Actor system started at akka.tcp://fl...@dh-cdh-m1d5.dbp.dailyhunt.in:17431
2017-09-25 22:30:57,137 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Actor system bound to hostname dh-cdh-m1d5.dbp.dailyhunt.in.
2017-09-25 22:30:57,283 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Setting up resources for TaskManagers
2017-09-25 22:30:57,283 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - TM:remoteKeytabPath obtained null
2017-09-25 22:30:57,283 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - TM:remoteKeytabPrincipal obtained null
2017-09-25 22:30:57,283 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - TM:remoteYarnConfPath obtained null
2017-09-25 22:30:57,283 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - TM:remotekrb5Path obtained null
2017-09-25 22:30:58,600 INFO org.apache.flink.yarn.Utils - Copying from file:/mnt/vol1/yarn/nm/usercache/hdfs/appcache/application_1503328266056_100730/container_e55_1503328266056_100730_01_000001/3be0aa74-c83a-492d-8017-99be55a4821a-taskmanager-conf.yaml to hdfs://nameservice1/user/hdfs/.flink/application_1503328266056_100730/3be0aa74-c83a-492d-8017-99be55a4821a-taskmanager-conf.yaml
2017-09-25 22:30:58,948 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Prepared local resource for modified yaml: resource { scheme: "hdfs" host: "nameservice1" port: -1 file: "/user/hdfs/.flink/application_1503328266056_100730/3be0aa74-c83a-492d-8017-99be55a4821a-taskmanager-conf.yaml" } size: 1424 timestamp: 1506358858841 type: FILE visibility: APPLICATION
2017-09-25 22:30:58,954 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Creating container launch context for TaskManagers
2017-09-25 22:30:58,954 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Starting TaskManagers with command: $JAVA_HOME/bin/java -Xms3000m -Xmx3000m -XX:MaxDirectMemorySize=6000m "-Djava.library.path=/opt/cloudera/parcels/CDH/lib/hadoop/lib/native/" -Dlog.file=<LOG_DIR>/taskmanager.log -Dlog4j.configuration=file:./log4j.properties org.apache.flink.yarn.YarnTaskManager --configDir . 1> <LOG_DIR>/taskmanager.out 2> <LOG_DIR>/taskmanager.err
2017-09-25 22:30:59,039 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /mnt/vol2/tmp/flink-blobstore-tmp-2/blobStore-9d66eaca-bcc2-40b1-8b56-bd31f53b8736
2017-09-25 22:30:59,058 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:13684 - max concurrent requests: 50 - max backlog: 1000
2017-09-25 22:30:59,097 INFO org.apache.flink.runtime.metrics.MetricRegistry - No metrics reporter configured, no metrics will be exposed/reported.
2017-09-25 22:30:59,128 INFO org.apache.flink.runtime.jobmanager.MemoryArchivist - Started memory archivist akka://flink/user/$a
2017-09-25 22:30:59,129 INFO org.apache.flink.yarn.YarnJobManager - Starting JobManager at akka.tcp://fl...@dh-cdh-m1d5.dbp.dailyhunt.in:17431/user/jobmanager.
2017-09-25 22:30:59,139 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - Starting JobManager Web Frontend
2017-09-25 22:30:59,155 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of JobManager log file: /var/log/hadoop-yarn/container/application_1503328266056_100730/container_e55_1503328266056_100730_01_000001/jobmanager.log
2017-09-25 22:30:59,155 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of JobManager stdout file: /var/log/hadoop-yarn/container/application_1503328266056_100730/container_e55_1503328266056_100730_01_000001/jobmanager.out
2017-09-25 22:30:59,156 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Using directory /tmp/flink-web-036814e5-c28f-4c4c-a873-e58a6cced3b5 for the web interface files
2017-09-25 22:30:59,156 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Using directory /tmp/flink-web-2f317950-11c4-4eaa-8f24-bf803fd9d030 for web frontend JAR file uploads
2017-09-25 22:30:59,159 INFO org.apache.flink.yarn.YarnJobManager - JobManager akka.tcp://fl...@dh-cdh-m1d5.dbp.dailyhunt.in:17431/user/jobmanager was granted leadership with leader session ID None.
2017-09-25 22:30:59,559 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Web frontend listening at 0.0.0.0:44777
2017-09-25 22:30:59,560 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Starting with JobManager akka.tcp://fl...@dh-cdh-m1d5.dbp.dailyhunt.in:17431/user/jobmanager on port 44777
2017-09-25 22:30:59,560 INFO org.apache.flink.runtime.webmonitor.JobManagerRetriever - New leader reachable under akka://flink/user/jobmanager#1040661736:null.
2017-09-25 22:30:59,602 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - YARN application tolerates 1 failed TaskManager containers before giving up
2017-09-25 22:30:59,607 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - YARN Application Master started
2017-09-25 22:30:59,620 INFO org.apache.flink.yarn.YarnFlinkResourceManager - Cannot reconnect to previously allocated containers. This YARN version does not support 'getContainersFromPreviousAttempts()'
2017-09-25 22:30:59,621 INFO org.apache.flink.yarn.YarnFlinkResourceManager - Initializing YARN resource master
2017-09-25 22:30:59,659 INFO org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy - yarn.client.max-nodemanagers-proxies : 500
2017-09-25 22:30:59,659 INFO org.apache.flink.yarn.YarnFlinkResourceManager - Registering Application Master with tracking url http://dh-cdh-m1d5.dbp.dailyhunt.in:44777
2017-09-25 22:30:59,682 INFO org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider - Failing over to rm159
2017-09-25 22:31:00,207 INFO org.apache.flink.yarn.YarnFlinkResourceManager - Trying to associate with JobManager leader akka://flink/user/jobmanager#1040661736
2017-09-25 22:31:00,223 INFO org.apache.flink.yarn.YarnFlinkResourceManager - Resource Manager associating with leading JobManager Actor[akka://flink/user/jobmanager#1040661736] - leader session null
2017-09-25 22:31:00,224 INFO org.apache.flink.yarn.YarnFlinkResourceManager - Requesting new TaskManager container with 8000 megabytes memory. Pending requests: 1
2017-09-25 22:31:01,274 INFO org.apache.flink.yarn.YarnFlinkResourceManager - Received new container: container_1503328266056_100730_01_000002 - Remaining pending container requests: 0
2017-09-25 22:31:01,276 INFO org.apache.flink.yarn.YarnFlinkResourceManager - Launching TaskManager in container ContainerInLaunch @ 1506358861275: Container: [ContainerId: container_1503328266056_100730_01_000002, NodeId: dh-cdh-m1d1.dbp.dailyhunt.in:8041, NodeHttpAddress: dh-cdh-m1d1.dbp.dailyhunt.in:8042, Resource: <memory:8192, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 192.168.3.153:8041 }, ] on host dh-cdh-m1d1.dbp.dailyhunt.in
2017-09-25 22:31:01,278 INFO org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy - Opening proxy : dh-cdh-m1d1.dbp.dailyhunt.in:8041
2017-09-25 22:31:05,496 INFO org.apache.flink.yarn.YarnFlinkResourceManager - TaskManager ResourceID{resourceId='container_1503328266056_100730_01_000002'} has started.
2017-09-25 22:31:05,502 INFO org.apache.flink.runtime.instance.InstanceManager - Registered TaskManager at dh-cdh-m1d1 (akka.tcp://fl...@dh-cdh-m1d1.dbp.dailyhunt.in:55045/user/taskmanager) as 9d65107b36e1654999dd18d616c9cb97. Current number of registered hosts is 1. Current number of alive task slots is 1.
2017-09-25 22:31:17,072 INFO org.apache.flink.yarn.YarnJobManager - Submitting job 8e68646c7834ed0e3292a247979b51f2 (Flink Java Job at Mon Sep 25 22:31:13 IST 2017).
2017-09-25 22:31:17,096 INFO org.apache.flink.yarn.YarnJobManager - Using restart strategy NoRestartStrategy for 8e68646c7834ed0e3292a247979b51f2.
2017-09-25 22:31:17,145 INFO org.apache.flink.yarn.YarnJobManager - Running initialization on master for job Flink Java Job at Mon Sep 25 22:31:13 IST 2017 (8e68646c7834ed0e3292a247979b51f2).
2017-09-25 22:31:17,206 WARN org.apache.hadoop.conf.Configuration - /var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER/core-site.xml:an attempt to override final parameter: hadoop.ssl.require.client.cert; Ignoring.
2017-09-25 22:31:17,207 WARN org.apache.hadoop.conf.Configuration - /var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER/core-site.xml:an attempt to override final parameter: hadoop.ssl.keystores.factory.class; Ignoring.
2017-09-25 22:31:17,207 WARN org.apache.hadoop.conf.Configuration - /var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER/core-site.xml:an attempt to override final parameter: hadoop.ssl.server.conf; Ignoring.
2017-09-25 22:31:17,207 WARN org.apache.hadoop.conf.Configuration - /var/run/cloudera-scm-agent/process/4175-yarn-NODEMANAGER/core-site.xml:an attempt to override final parameter: hadoop.ssl.client.conf; Ignoring.
2017-09-25 22:31:18,024 INFO org.apache.flink.yarn.YarnJobManager - Successfully ran initialization on master in 879 ms.
2017-09-25 22:31:18,043 INFO org.apache.flink.yarn.YarnJobManager - Scheduling job 8e68646c7834ed0e3292a247979b51f2 (Flink Java Job at Mon Sep 25 22:31:13 IST 2017).
2017-09-25 22:31:18,044 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job Flink Java Job at Mon Sep 25 22:31:13 IST 2017 (8e68646c7834ed0e3292a247979b51f2) switched from state CREATED to RUNNING.
2017-09-25 22:31:18,044 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (at takeBackup(GroupMetaBackupToHDFS.java:72) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (3be363fa357650297cc470c425cfcda5) switched from CREATED to SCHEDULED.
2017-09-25 22:31:18,067 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (at takeBackup(GroupMetaBackupToHDFS.java:72) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (3be363fa357650297cc470c425cfcda5) switched from SCHEDULED to DEPLOYING.
2017-09-25 22:31:18,073 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSource (at takeBackup(GroupMetaBackupToHDFS.java:72) (org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (attempt #0) to dh-cdh-m1d1
2017-09-25 22:31:23,411 ERROR akka.actor.ActorSystemImpl - Uncaught error from thread [flink-akka.remote.default-remote-dispatcher-7] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled
java.lang.OutOfMemoryError: Java heap space
at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
at akka.remote.transport.AkkaPduProtobufCodec$.constructPayload(AkkaPduCodec.scala:145)
at akka.remote.transport.AkkaProtocolHandle.write(AkkaProtocolTransport.scala:194)
at akka.remote.EndpointWriter.writeSend(Endpoint.scala:782)
at akka.remote.EndpointWriter$$anonfun$4.applyOrElse(Endpoint.scala:744)
at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
at akka.remote.EndpointActor.aroundReceive(Endpoint.scala:437)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
at akka.actor.ActorCell.invoke(ActorCell.scala:487)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
at akka.dispatch.Mailbox.run(Mailbox.scala:220)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2017-09-25 22:31:23,411 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Removing web dashboard root cache directory /tmp/flink-web-036814e5-c28f-4c4c-a873-e58a6cced3b5
2017-09-25 22:31:23,438 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Removing web dashboard jar upload directory /tmp/flink-web-2f317950-11c4-4eaa-8f24-bf803fd9d030
2017-09-25 22:31:23,439 INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:13684
