Re: [DISCUSS] Introduce The Batch/Stream ExecutionEnvironment in Yarn mode

Hi Roc Marshal, I have a question about making the Yarn deployment ASAP. In my opinion, using the "ExecutionEnvironment" instead of "flink run -m yarn-cluster" to deploy a Flink cluster on Yarn do not help to reduce the time cost. Since we still need to ship the user jars, flink libs to the HDFS s

Re: [DISCUSS] Introduce The Batch/Stream ExecutionEnvironment in Yarn mode

Sorry, I confused JIRA with email. The Attachment link: https://gitee.com/RocMarshal/resources4link/blob/master/README.md The JIRA ID: FLINK-17472 The JIRA link: https://issues.apache.org/jira/plugins/servlet/mobile#issue/FLINK-17472 Best, Roc | | Roc Marshal | | 邮箱：flin...

Re: [DISCUSS] Introduce The Batch/Stream ExecutionEnvironment in Yarn mode

Could you post the Jira issue here? I don't see it mentioned in this thread so far. Best, Aljoscha On 05.05.20 12:32, Roc Marshal wrote: Hi,Aljoscha.I have updated the JIRA according to your suggestion. Thank you very much.Best,Roc At 2020-05-05 16:04:01, "Aljoscha Krettek" wrote: Hi, imag

Re:Re: [DISCUSS] Introduce The Batch/Stream ExecutionEnvironment in Yarn mode

Hi,Aljoscha.I have updated the JIRA according to your suggestion. Thank you very much.Best,Roc At 2020-05-05 16:04:01, "Aljoscha Krettek" wrote: >Hi, > >image attachments don't work on this ML. You will have to upload the >image somewhere and post a link. > >Best, >Aljoscha > >On 02.05.20 09:16,

Re: [DISCUSS] Introduce The Batch/Stream ExecutionEnvironment in Yarn mode

Hi, image attachments don't work on this ML. You will have to upload the image somewhere and post a link. Best, Aljoscha On 02.05.20 09:16, Jeff Zhang wrote: Hi Roc, You can try flink on zeppelin, where you can submit flink job to yarn directly without starting flink cluster by yourself. H

Re: [DISCUSS] Introduce The Batch/Stream ExecutionEnvironment in Yarn mode

Hi Roc, You can try flink on zeppelin, where you can submit flink job to yarn directly without starting flink cluster by yourself. Here's a few tutorials. 1) Get started https://link.medium.com/oppqD6dIg5 2) Batch https://link.medium.com/3qumbwRIg5

[DISCUSS] Introduce The Batch/Stream ExecutionEnvironment in Yarn mode

Hi all. Expect to have such a mode of submission. Build the job directly in the Environment, and then submit the job in yarn mode. Just like RemoteStreamEnvironment, as long as you specify the parameters of the yarn cluster (host, port) or yarn configuration directory and HADOOP_USER_NAME