Hi Roc, You can try flink on zeppelin, where you can submit flink job to yarn directly without starting flink cluster by yourself. Here's a few tutorials.
1) Get started https://link.medium.com/oppqD6dIg5 <https://t.co/PTouUYYTrv?amp=1> 2) Batch https://link.medium.com/3qumbwRIg5 <https://t.co/Yo9QAY0Joj?amp=1> 3) Streaming https:// link.medium.com/RBHa2lTIg5 <https://t.co/sUapN40tvI?amp=1> 4) Advanced usage https://link.medium.com/CAekyoXIg5 <https://t.co/MXolULmafZ?amp=1> Roc Marshal <flin...@126.com> 于2020年5月2日周六 上午11:18写道： > Hi all. > Expect to have such a mode of submission. Build the job directly in > the Environment, and then submit the job in yarn mode. Just like > RemoteStreamEnvironment, as long as you specify the parameters of the yarn > cluster (host, port) or yarn configuration directory and HADOOP_USER_NAME, > you can use the topology built by Env to submit the job . > This submission method is best to minimize the transmission of > resources required by yarn to start flink-jobmanager and taskmanagerrunner > to ensure that flink can deploy job on the yarn cluster as quickly as > possible. > The simple demo as shown in the picture .the parameter named 'env' > containes all the operators about job ,like sources,maps,etc.. > > Thank you for your attention. > > > > -- Best Regards Jeff Zhang
