Re: Role of Job Manager

2019-06-19 Thread Pankaj Chand
Hi Biao, Thank you for your reply! Please let me know the url of the updated Flink documentation. The url of the outdated document is: https://ci.apache.org/projects/flink/flink-docs-release-1.8/concepts/runtime.html Another page which (tacitly) supports the outdated concept is: https://ci.apa

Re: Role of Job Manager

2019-06-18 Thread Biao Liu
Hi Pankaj, That's really a good question. There was a refactor of architecture before[1]. So there might be some descriptions used the outdated concept. Before refactoring, Job Manager is a centralized role. It controls whole cluster and all jobs which is described in your interpretation 1. Afte

Re: Role of Job Manager

2019-06-18 Thread Eduardo Winpenny Tejedor
Hi Pankaj, I have no experience with Hadoop but from the book I gathered there's one Job Manager per application i.e. per jar (as in the example in the first chapter). This is not to say there's one Job Manager per job. Actually I don't think the word Job is defined in the book, I've seen Task def