Hi Henry, When running flink on YARN, from ClusterEntrypoint the system environment info is print out. One of the info is "Hadoop version: 2.4.1”, I think it is from the flink-shaded-hadoop2 jar. But actually the system Hadoop version is 2.7.2.
I want to know is it OK if the version is different? *> I don't think it is OK, because you will use a lower version of the client to access the higher version of the server.* Is it a best practice to adjust flink Hadoop version to the Hadoop version actually used? *> I personally recommend that you keep the two versions consistent to eliminate the possibility of causing various potential problems. * *In fact, Flink provides a bundle of Hadoop 2.7.x bundles for you to download.[1]* [1]: https://www.apache.org/dyn/closer.lua/flink/flink-1.6.1/flink-1.6.1-bin-hadoop27-scala_2.11.tgz Thanks, vino. 徐涛 <happydexu...@gmail.com> 于2018年10月26日周五 上午9:13写道： > Hi Experts > When running flink on YARN, from ClusterEntrypoint the system > environment info is print out. > One of the info is "Hadoop version: 2.4.1”, I think it is from the > flink-shaded-hadoop2 jar. But actually the system Hadoop version is 2.7.2. > I want to know is it OK if the version is different? Is it a best > practice to adjust flink Hadoop version to the Hadoop version actually used? > > Thanks a lot. > > Best > Henry
