Re: Flink on YARN - tmp directory

2017-07-31 Thread Aljoscha Krettek
Hi Chris, I think in this case we need to change what is passed as "-Djava.io .tmpdir" to the JVMs that run the TaskManagers. You should be able to achieve this via env.java.opts or more specifically env.java.opts.taskmanager [1]. The directory specified via task taskmanager.

Re: Flink on YARN - tmp directory

2017-07-28 Thread Chris Hebert
I should also note that the above steps did get the Flink JobManager and TaskManagers to save their tmp web dashboard files to /my/tmp/ and to show in the Dashboard that the taskmanager.tmp.dirs property had been properly set to /my/tmp/, but the tmp files I wrote in my jobs stubbornly wrote to /tm

Flink on YARN - tmp directory

2017-07-28 Thread Chris Hebert
Hi, My jobs create tmp files like so: java.nio.file.Path tmpFilePath = java.nio.file.Files.createTempFile("tmpFile", "txt"); They currently appear in /tmp/, but I want them somewhere else, say /my/tmp/ . The Flink on YARN docs say: Flink on YARN will overwrite the following configuration param