Re: Setting environment variables of the taskmanagers (yarn)

2019-09-25 Thread Peter Huang
Hi Richard, Good suggestion. I just created a Jira ticket. I will find a time this week to update docs. Best Regards Peter Huang On Wed, Sep 25, 2019 at 8:05 AM Richard Deurwaarder wrote: > Hi Peter and Jiayi, > > Thanks for the answers this worked perfectly, I just added > > containerized.m

Re: Setting environment variables of the taskmanagers (yarn)

2019-09-25 Thread Richard Deurwaarder
Hi Peter and Jiayi, Thanks for the answers this worked perfectly, I just added containerized.master.env.GOOGLE_APPLICATION_CREDENTIALS=xyz and containerized.taskmanager.env.GOOGLE_APPLICATION_CREDENTIALS=xyz to my flink config and they got picked up. Do you know why this is missing from the doc

Re: Setting environment variables of the taskmanagers (yarn)

2019-09-24 Thread Peter Huang
Hi Richard, For the first question, I don't think you need to explicitly specify fs.hdfs.hadoopconf as each file in the ship folder is copied as a yarn local resource for containers. The configuration path is overridden internally in Flink. For the second question of setting TM environment variab

Re: Setting environment variables of the taskmanagers (yarn)

2019-09-24 Thread bupt_ljy
Hi Richard, You can use dynamic properties to add your environmental variables. Set jobmanager env: e.g. -Dcontainerized.master.env.GOOGLE_APPLICATION_CREDENTIALS=xyz Set taskmanager env: e.g. -Dcontainerized.taskmanager.env.GOOGLE_APPLICATION_CREDENTIALS=xyz Best Regards, Jiayi Liao Origi