Hi, I am trying to start flink session(v1.3.2) on yarn(v 2.7) on HDInsight cluster. But it throws following error:
*Error while deploying YARN cluster: Couldn't deploy Yarn cluster* *java.lang.RuntimeException: Couldn't deploy Yarn cluster* * at org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:443)* * at org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:630)* * at org.apache.flink.yarn.cli.FlinkYarnSessionCli$1.call(FlinkYarnSessionCli.java:486)* * at org.apache.flink.yarn.cli.FlinkYarnSessionCli$1.call(FlinkYarnSessionCli.java:483)* * at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)* * at java.security.AccessController.doPrivileged(Native Method)* * at javax.security.auth.Subject.doAs(Subject.java:422)* * at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)* * at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)* * at org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:483)* *Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider not found* * at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2227)* * at org.apache.hadoop.yarn.client.RMProxy.createRMFailoverProxyProvider(RMProxy.java:161)* * at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:94)* * at org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:72)* I referred this mail thread also: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-session-on-Yarn-ClassNotFoundException-td15222.html I am using HDInsight Cluster(HDP3.6). According to the documentation, set HADOOP_CONF_DIR and YARN_CONF_DIR as well. Any inputs will be really helpful. Thanks! -- Thanks & Regards, Nishu Tayal
