Re: Flink on yarn use jar on hdfs

Hi shengnan, Sorry for late. I will attach a pr to FLINK-13938 in this week. If we specify the shared lib(-ysl), all the jars located in the lib directory of flink client will not be uploaded. Instead, we will use the hdfs path to set the LocalResource of yarn. And the visibility of LocalResource

Re: Flink on yarn use jar on hdfs

And could you please share your github account with me? I am interested to follow you to see how you achieve this feature? Thank you. On 9/16/2019 14:44，Yang Wang wrote： Hi Shengnan, I think you mean to avoid uploading flink-dist jars in submission every time. I ha

Re: Flink on yarn use jar on hdfs

Hi Shengnan, I think you mean to avoid uploading flink-dist jars in submission every time. I have created a JIRA[1] to use Yarn public cache to speed up the launch duration of JM and TM. After this feature merged, you could submit a flink job like below. ./bin/flink run -d -m yarn-cluster -p 20 -

Flink on yarn use jar on hdfs

Hi everyone! I found that everytime I start a flink-yarn application, client will ship flink-uber jar and other dependencies to hdfs and start appMaster. Is there any approaches to locate flink-uber jar and other library jars on hdfs and let only configuration file being shipped. Therefore the y