Re: [DISCUSS] FLIP-39: Flink ML pipeline and ML libs

2019-04-28 Thread Chen Qin
Just share some of insights from operating SparkML side at scale - map reduce may not best way to iterative sync partitioned workers. - native hardware accelerations is key to adopt rapid changes in ML improvements in foreseeable future. Chen On Apr 29, 2019, at 11:02, jincheng sun wrote: > >

[jira] [Created] (FLINK-12361) Remove useless expression from runtime scheduler

2019-04-28 Thread Liya Fan (JIRA)
Liya Fan created FLINK-12361: Summary: Remove useless expression from runtime scheduler Key: FLINK-12361 URL: https://issues.apache.org/jira/browse/FLINK-12361 Project: Flink Issue Type: Improvem

Re: [DISCUSS] FLIP-39: Flink ML pipeline and ML libs

2019-04-28 Thread jincheng sun
Hi Shaoxuan, Thanks for doing more efforts for the enhances of the scalability and the ease of use of Flink ML and make it one step further. Thank you for sharing a lot of context information. big +1 for this proposal! Here only one suggestion, that is, It has been a short time until the release

[DISCUSS] FLIP-39: Flink ML pipeline and ML libs

2019-04-28 Thread Shaoxuan Wang
Hi everyone, Weihua has proposed to rebuild Flink ML pipeline on top of TableAPI several months ago in this mail thread: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Embracing-Table-API-in-Flink-ML-td25368.html Luogen, Becket, Xu, Weihua and I have been working on this

Re: How to let Flink 1.7.X run Flink session cluster on YARN in Java 7 default environment

2019-04-28 Thread Yaoting Gong
Sorry, I didn't see the original message already mentioned in these configurations. But it do works for me. I put these into flink-conf.yml, not try the way you did. On Mon, Apr 29, 2019 at 9:45 AM Yaoting Gong wrote: > Hi, @胡逸才, I've met the same problem. Add some configs as blow will help

Re: How to let Flink 1.7.X run Flink session cluster on YARN in Java 7 default environment

2019-04-28 Thread Yaoting Gong
Hi, @胡逸才, I've met the same problem. Add some configs as blow will help you . env.java.home: /usr/jdk1.8.0_51containerized.master.env.JAVA_HOME: /usr/jdk1.8.0_51containerized.taskmanager.env.JAVA_HOME: /usr/jdk1.8.0_51yarn.taskmanager.env.JAVA_HOME: /usr/jdk1.8.0_51 On Sun, Apr 28, 2019 at 1

[jira] [Created] (FLINK-12360) Translate "Jobs and Scheduling" Page to Chinese

2019-04-28 Thread Armstrong Nova (JIRA)
Armstrong Nova created FLINK-12360: -- Summary: Translate "Jobs and Scheduling" Page to Chinese Key: FLINK-12360 URL: https://issues.apache.org/jira/browse/FLINK-12360 Project: Flink Issue Typ

[jira] [Created] (FLINK-12359) SystemResourcesMetricsITCase unstable

2019-04-28 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12359: Summary: SystemResourcesMetricsITCase unstable Key: FLINK-12359 URL: https://issues.apache.org/jira/browse/FLINK-12359 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12358) Verify whether rest documenation needs to be updated when building pull request

2019-04-28 Thread Yun Tang (JIRA)
Yun Tang created FLINK-12358: Summary: Verify whether rest documenation needs to be updated when building pull request Key: FLINK-12358 URL: https://issues.apache.org/jira/browse/FLINK-12358 Project: Flin

Re: Warning from dev@flink.apache.org

2019-04-28 Thread Sree V
it's a bot.It is says this before appending ".INVALID" to your email, Aitozi. Thank you./Sree Sent from Yahoo Mail on Android On Sat, Apr 27, 2019 at 1:21, aitozi wrote: Hi, dev-owner: I'm not quite understand the mail, can you tell me what's it point to ? Thanks, Aitozi On 2019/4/27,

[jira] [Created] (FLINK-12357) Remove useless code in TableConfig

2019-04-28 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-12357: --- Summary: Remove useless code in TableConfig Key: FLINK-12357 URL: https://issues.apache.org/jira/browse/FLINK-12357 Project: Flink Issue Type: Bug Co

Re: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-04-28 Thread vino yang
Hi Yu, OK, now I know your comments more clearly. Now, answer your two questions: 1. the value of this work: As I mentioned in the last reply mail to you: "we found the queryable state is hard to use and it may cause few users to use this function. We may think the reason and the result affect

[jira] [Created] (FLINK-12356) Optimise version experssion of flink-shaded-hadoop2(-uber)

2019-04-28 Thread Paul Lin (JIRA)
Paul Lin created FLINK-12356: Summary: Optimise version experssion of flink-shaded-hadoop2(-uber) Key: FLINK-12356 URL: https://issues.apache.org/jira/browse/FLINK-12356 Project: Flink Issue Type

[jira] [Created] (FLINK-12355) KafkaITCase.testTimestamps is unstable

2019-04-28 Thread Yu Li (JIRA)
Yu Li created FLINK-12355: - Summary: KafkaITCase.testTimestamps is unstable Key: FLINK-12355 URL: https://issues.apache.org/jira/browse/FLINK-12355 Project: Flink Issue Type: Test Component

Re: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-04-28 Thread Yu Li
TL;DR: IMO a more complete solution is to cover both query and meta request serving in a new component. We could use the proposal here as step one but we should have a global plan. And before improving a seemingly not widely used feature, we'd better weigh the gain and efforts. Let me clarify the