Hi All, We would like to start a discussion thread about a new feature called Flink Driver. A brief summary is following.
As mentioned in the discussion of Interactive Programming, user applications might consist of multiple jobs and take long to finish. Currently, when Flink runs applications with multiple jobs, the application will run in a local process which is responsible for submitting the jobs. That local process will not exit until the whole application has finished. Users have to keep eyes on the local process in case it is killed due to connection lost, session timeout, local operating system problem, etc. To solve the problem, we would like to introduce the Flink Driver. Users can submit applications using driver mode. A Flink driver job will be submitted to take care of the job submissions in the user application. For more details about flink driver, please refer to the doc: https://docs.google.com/document/d/1dJnDOgRae9FzoBzXcsGoutGB1YjTi1iqG6d1Ht61EnY Any comments and suggestions will be highly appreciated. Best Regards, Shuiqiang
