Re: [DISCUSS] FLIP-73: Introducing Executors for job submission

2019-10-03 Thread Zili Chen
Thanks for your explanation Kostas to make it clear subtasks under FLIP-73. As you described, changes of Environment are included in this FLIP. For "each API to have a single Environment", it could be helpful to describe which APIs we'd like to have after FLIP-73. And if we keep multiple Environme

Re: [DISCUSS] FLIP-74: Flink JobClient API

2019-10-03 Thread Zili Chen
s/on the context if/on the context of/ s/dummy/dumb/

Re: [DISCUSS] FLIP-74: Flink JobClient API

2019-10-03 Thread Zili Chen
Hi Kostas, By mention "integration to be a follow up discussion" in FLIP-73 discussion I think I'm more on the context if FLIP-74 because without including the retrieval of JobClient in FLIP-74 we actually introduce a dummy public interface. 1. return JobClient from Executor#execute actually has

[DISCUSS] Improve Flink logging with contextual information

2019-10-03 Thread Gyula Fóra
Hi all! We have been thinking that it would be a great improvement to add contextual information to the Flink logs: - Container / yarn / host info to JM/TM logs - Job info (job id/ jobname) to task logs I this should be similar to how the metric scopes are set up and should be able to provide

Re: [DISCUSS] FLIP-74: Flink JobClient API

2019-10-03 Thread Kostas Kloudas
Hi Tison, I see. Then I would say that as a first step, and to see if people are happy with the result, integration with the production code can be through a new method executeAsync() in the Executor that we discussed earlier. This method could potentially be exposed to ExecutionEnvironment as a

Re: [DISCUSS] FLIP-74: Flink JobClient API

2019-10-03 Thread Zili Chen
Hi Kostas, That is exactly how things go on in my mind and the reason I say "integration to be a follow up discussion" :-) Best, tison. Kostas Kloudas 于2019年10月3日周四 下午6:23写道： > Hi Tison, > > I see. Then I would say that as a first step, and to see if people are > happy with the result, > inte

Re: [VOTE] FLIP-57: Rework FunctionCatalog

2019-10-03 Thread Bowen Li
I'm glad to announce that the community has accepted the design of FLIP-57, and we are moving forward to implementing it. Thanks everyone! On Wed, Oct 2, 2019 at 11:01 AM Bowen Li wrote: > Introducing a new term "path" to APIs like > "getShortPath(Identifier)/getLongPath(Identifier)" would be c

[jira] [Created] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-03 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-14316: -- Summary: stuck in "Job leader ... lost leadership" error Key: FLINK-14316 URL: https://issues.apache.org/jira/browse/FLINK-14316 Project: Flink Issue Typ

[jira] [Created] (FLINK-14317) make hadoop history server logs accessible through flink ui

2019-10-03 Thread Yu Yang (Jira)
Yu Yang created FLINK-14317: --- Summary: make hadoop history server logs accessible through flink ui Key: FLINK-14317 URL: https://issues.apache.org/jira/browse/FLINK-14317 Project: Flink Issue Type

[jira] [Created] (FLINK-14318) JDK11 build stalls during shading

2019-10-03 Thread Gary Yao (Jira)
Gary Yao created FLINK-14318: Summary: JDK11 build stalls during shading Key: FLINK-14318 URL: https://issues.apache.org/jira/browse/FLINK-14318 Project: Flink Issue Type: Bug Component