Re: Future of JobManager.scala

2018-10-03 Thread Tzu-Li Chen
Hi Sun, JobManager.scala is component of legacy mode, they would be removed as a sub task of FLINK-10392[1]. For the evolution from "legacy mode" to FLIP-6 new mode, see also [2]. For short, the previous JobManager is split mainly into JobMaster and Dispatcher. [1] https://issues.apache.org/jira

Future of JobManager.scala

2018-10-03 Thread Jin Sun
Hi Team, What is the future of JobManager in org/apache/flink/runtime/jobmanager/JobManager.scala? I noticed that there are some duplicate logic between JobManager.scala and JobMaster/Dispatcher, that somehow confuse me, and I also saw LegacyYarnClusterDescriptor.java depends on JobManag

TPCH/TPCDS benchmark

2018-10-03 Thread Jin Sun
Hi team, Do we have a tpch/tpcds benchmark located somewhere that we can run to validate performance? Some people did the benchmark and compare between Hive, Presto, and spark, but no flink: https://www.slideshare.net/ssuser6bb12d/hive-presto-and-spark-on-tpcds-benchmark , the benchmark the

[jira] [Created] (FLINK-10487) fix deprecated Flink SQL example

2018-10-03 Thread Bowen Li (JIRA)
Bowen Li created FLINK-10487: Summary: fix deprecated Flink SQL example Key: FLINK-10487 URL: https://issues.apache.org/jira/browse/FLINK-10487 Project: Flink Issue Type: Bug Components

Re: [DISCUSS] Move hadoop 2.4 test profiles to cron jobs

2018-10-03 Thread vino yang
+1 Thanks, vino. Tzu-Li Chen 于2018年10月2日周二 下午9:04写道: > +1, sounds good to cut down travis burden. > > Best, > tison. > > > Fabian Hueske 于2018年10月2日周二 下午9:02写道: > > > +1 > > > > Am Di., 2. Okt. 2018 um 14:50 Uhr schrieb Till Rohrmann < > > trohrm...@apache.org>: > > > > > Great idea Chesnay. +

[jira] [Created] (FLINK-10486) Recover local mode on flink startup

2018-10-03 Thread JIRA
Ismaël Mejía created FLINK-10486: Summary: Recover local mode on flink startup Key: FLINK-10486 URL: https://issues.apache.org/jira/browse/FLINK-10486 Project: Flink Issue Type: Improvement