Re: Java library for Flink-Kudu integration

2017-03-27 Thread shijinkui
Hi, Fabian Do we have plan to replace Flink connectors with bahir-flink[1]? [1] https://github.com/apache/Bahir-flink 在 2017/3/28 上午12:15, "Fabian Hueske" 写入: >Hi Ruben, > >thanks for sharing this! >A Flink Kudu connector is a great contribution and Bahir seems to be the >right place for it. >

[jira] [Created] (FLINK-6202) YarnSessionCli couldn't submit jobs when using -z option

2017-03-27 Thread Syinchwun Leo (JIRA)
Syinchwun Leo created FLINK-6202: Summary: YarnSessionCli couldn't submit jobs when using -z option Key: FLINK-6202 URL: https://issues.apache.org/jira/browse/FLINK-6202 Project: Flink Issue

Re: [jira] [Created] (FLINK-6167) Consider removing ArchivedExecutionGraph classes

2017-03-27 Thread David Wang
Hi Chesnay, If Acrhived* versions of ExecutionGraph classes have been removed, is there any way to retrieve data in ExecutionGraph from JobMaster via RPC? Some of our projects rely on the Archived* classes from Job Masters running in the cluster. Thanks, David 2017-03-22 22:11 GMT+08:00 Chesnay

[jira] [Created] (FLINK-6201) move python example files to the examples dir

2017-03-27 Thread shijinkui (JIRA)
shijinkui created FLINK-6201: Summary: move python example files to the examples dir Key: FLINK-6201 URL: https://issues.apache.org/jira/browse/FLINK-6201 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-6200) Add event time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL

2017-03-27 Thread sunjincheng (JIRA)
sunjincheng created FLINK-6200: -- Summary: Add event time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Key: FLINK-6200 URL: https://issues.apache.org/jira/browse/FLINK-6200 Project: Flink

[jira] [Created] (FLINK-6199) Single outstanding Async I/O operation per key

2017-03-27 Thread Jamie Grier (JIRA)
Jamie Grier created FLINK-6199: -- Summary: Single outstanding Async I/O operation per key Key: FLINK-6199 URL: https://issues.apache.org/jira/browse/FLINK-6199 Project: Flink Issue Type: Improvem

Re: Java library for Flink-Kudu integration

2017-03-27 Thread Fabian Hueske
Hi Ruben, thanks for sharing this! A Flink Kudu connector is a great contribution and Bahir seems to be the right place for it. Thanks, Fabian 2017-03-27 15:35 GMT+02:00 : > Hi all, > > I apologize for sending the email to both accounts, but not sure where > this topic fits better. > > In my t

Re: FW: [DISCUSS] Table API / SQL indicators for event and processing time

2017-03-27 Thread Fabian Hueske
Hi Timo, I had a look at your branch. Thanks for all the refactoring and work you put into this. I like the proposal a lot. I think indicating the time attribute in the schema is a good idea. I'm not sure if we should support the rowtime expression for batch table though. For batch, any long or t

[jira] [Created] (FLINK-6198) Update the documentation of the CEP library to include all the new features.

2017-03-27 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-6198: - Summary: Update the documentation of the CEP library to include all the new features. Key: FLINK-6198 URL: https://issues.apache.org/jira/browse/FLINK-6198 Project:

[jira] [Created] (FLINK-6197) Add support for iterative conditions.

2017-03-27 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-6197: - Summary: Add support for iterative conditions. Key: FLINK-6197 URL: https://issues.apache.org/jira/browse/FLINK-6197 Project: Flink Issue Type: Bug

[CANCEL][VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-27 Thread Robert Metzger
I'll cancel the vote. Once the fixes are in, I'll create a new RC. On Mon, Mar 27, 2017 at 11:59 AM, Chesnay Schepler wrote: > If possible I would like to include FLINK-6183 & FLINK-6184 as well. > > They fix 2 metric-related issues that could arise when a Task is cancelled > very early. (like,

[jira] [Created] (FLINK-6196) Support dynamic schema in Table Function

2017-03-27 Thread Zhuoluo Yang (JIRA)
Zhuoluo Yang created FLINK-6196: --- Summary: Support dynamic schema in Table Function Key: FLINK-6196 URL: https://issues.apache.org/jira/browse/FLINK-6196 Project: Flink Issue Type: Improvement

Re: Question about flink client

2017-03-27 Thread Till Rohrmann
Hi Yelei, I think you're right that we should not only rely on the response of the JobManager but also ask the Yarn client what the status of the application is. If the application status is something different than Succeeded, then it should be save to shut down the cluster. If this is not the cas

[jira] [Created] (FLINK-6195) Move gelly-examples jar from opt to examples

2017-03-27 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-6195: - Summary: Move gelly-examples jar from opt to examples Key: FLINK-6195 URL: https://issues.apache.org/jira/browse/FLINK-6195 Project: Flink Issue Type: Sub-task

Java library for Flink-Kudu integration

2017-03-27 Thread ruben.casado.tejedor
Hi all, I apologize for sending the email to both accounts, but not sure where this topic fits better. In my team, we have been working in some PoCs and PoVs about new data architectures. As part of this work, we have implemented a library to connect Kudu and Flink. The library allows reading/

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-27 Thread Chesnay Schepler
If possible I would like to include FLINK-6183 & FLINK-6184 as well. They fix 2 metric-related issues that could arise when a Task is cancelled very early. (like, right away) FLINK-6183 fixes a memory leak where the TaskMetricGroup was never closed FLINK-6184 fixes a NullPointerExceptions in t

[jira] [Created] (FLINK-6194) More broken links in docs

2017-03-27 Thread Patrick Lucas (JIRA)
Patrick Lucas created FLINK-6194: Summary: More broken links in docs Key: FLINK-6194 URL: https://issues.apache.org/jira/browse/FLINK-6194 Project: Flink Issue Type: Bug Reporter:

[jira] [Created] (FLINK-6193) Flink dist directory normalize

2017-03-27 Thread shijinkui (JIRA)
shijinkui created FLINK-6193: Summary: Flink dist directory normalize Key: FLINK-6193 URL: https://issues.apache.org/jira/browse/FLINK-6193 Project: Flink Issue Type: Improvement Compon

Re: [DISCUSS] Flink dist directory management

2017-03-27 Thread shijinkui
Hi, Fabian, Jark Wu, Greg Thank for your feedback and support. I’ll create some sub-issue to complete the every task of code refactor. 在 2017/3/27 下午3:38, "Fabian Hueske" 写入: >Hi Jinkui, > >I agree with you, moving all examples into ./examples would be nice. >Note, that for the DataSet and DataS

Re: [DISCUSS] Flink dist directory management

2017-03-27 Thread Fabian Hueske
Hi Jinkui, I agree with you, moving all examples into ./examples would be nice. Note, that for the DataSet and DataStream APIs, each example is packaged as a separate JAR with the main class being included in the MANIFEST file. I think we should select a few representative examples of the Table a

[jira] [Created] (FLINK-6192) reuse zookeeer client created by CuratorFramework

2017-03-27 Thread Tao Wang (JIRA)
Tao Wang created FLINK-6192: --- Summary: reuse zookeeer client created by CuratorFramework Key: FLINK-6192 URL: https://issues.apache.org/jira/browse/FLINK-6192 Project: Flink Issue Type: Improvement

Re: Question about flink client

2017-03-27 Thread Yelei Feng
Hi Till, Thanks for your help, I merged your code into my branch and the issue is gone. BTW, do you have some insights for the first problem? "Once the yarn session CLI can't get cluster status(e.g. jobmanager is down), it will try to shutdown the cluster and cleanup related files even if new