[GitHub] [zeppelin] zjffdu opened a new pull request #3820: [ZEPPELIN-4906]. FLINK_CONF_DIR doesn't work in yarn interpreter mode

[GitBox]

zjffdu opened a new pull request #3820:
URL: https://github.com/apache/zeppelin/pull/3820


   ### What is this PR for?
   
   This use env instead of properties for these flink related config. Because 
the env will be reset in yarn interpreter mode 
(https://github.com/apache/zeppelin/blob/master/zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java#L295)
   
   ### What type of PR is it?
   [Bug Fix]
   
   ### Todos
   * [ ] - Task
   
   ### What is the Jira issue?
   * https://issues.apache.org/jira/browse/ZEPPELIN-4906
   
   ### How should this be tested?
   * Manually tested,
   Here's what I see after this PR.
   
   ```
    INFO [2020-06-24 10:46:06,461] 
({FIFOScheduler-interpreter_583675831-Worker-1} 
FlinkScalaInterpreter.scala[initFlinkConfig]:153) - FLINK_HOME: 
/Users/jzhang/Temp/hadoop/yarn/usercache/jzhang/appcache/application_1591195707498_0116/container_1591195707498_0116_01_000001/flink
    INFO [2020-06-24 10:46:06,462] 
({FIFOScheduler-interpreter_583675831-Worker-1} 
FlinkScalaInterpreter.scala[initFlinkConfig]:154) - FLINK_CONF_DIR: 
/Users/jzhang/Temp/hadoop/yarn/usercache/jzhang/appcache/application_1591195707498_0116/container_1591195707498_0116_01_000001/flink/conf
    INFO [2020-06-24 10:46:06,462] 
({FIFOScheduler-interpreter_583675831-Worker-1} 
FlinkScalaInterpreter.scala[initFlinkConfig]:155) - HADOOP_CONF_DIR: 
/Users/jzhang/Java/lib/hadoop-2.7.7/etc/hadoop
    INFO [2020-06-24 10:46:06,462] 
({FIFOScheduler-interpreter_583675831-Worker-1} 
FlinkScalaInterpreter.scala[initFlinkConfig]:156) - YARN_CONF_DIR: 
/Users/jzhang/Java/lib/hadoop-2.7.7/etc/hadoop
    INFO [2020-06-24 10:46:06,462] 
({FIFOScheduler-interpreter_583675831-Worker-1} 
FlinkScalaInterpreter.scala[initFlinkConfig]:157) - HIVE_CONF_DIR: 
    INFO [2020-06-24 10:46:06,464] 
({FIFOScheduler-interpreter_583675831-Worker-1} 
FlinkScalaInterpreter.scala[initFlinkConfig]:160) - Using flink: 1.10.0
    INFO [2020-06-24 10:46:06,465] 
({FIFOScheduler-interpreter_583675831-Worker-1} FlinkShims.java[loadShims]:51) 
- Initializing shims for Flink 1.10
   ```
   ### Screenshots (if appropriate)
   
   ### Questions:
   * Does the licenses files need update? No
   * Is there breaking changes for older versions? No
   * Does this needs documentation? No
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org