Re: FLink Accessing two hdfs cluster

2021-11-30 Thread David Morávek
Hi chenqizhu, this exception doesn't seem to come from Flink, but rather from a YARN container bootstrap. When YARN container starts up, it needs to download resources from HDFS (your job archives / configuration / distributed cache / ...) which are necessary for startup of the user application (

FLink Accessing two hdfs cluster

2021-11-30 Thread chenqizhu
hi, Flink version 1.13 supports configuration of Hadoop properties in flink-conf.yaml via flink.hadoop.*. There is A requirement to write checkpoint to HDFS with SSDS (called Bcluster ) to speed checkpoint writing, but this HDFS cluster is not the default HDFS in the flink client (called Ac