[jira] [Created] (FLINK-6211) Validation error in Kinesis Consumer when using AT_TIMESTAMP as start position

2017-03-28 Thread Wei-Che Wei (JIRA)
Wei-Che Wei created FLINK-6211: -- Summary: Validation error in Kinesis Consumer when using AT_TIMESTAMP as start position Key: FLINK-6211 URL: https://issues.apache.org/jira/browse/FLINK-6211 Project: Fli

[jira] [Created] (FLINK-6210) RocksDB instance should be closed in ListViaMergeSpeedMiniBenchmark

2017-03-28 Thread Ted Yu (JIRA)
Ted Yu created FLINK-6210: - Summary: RocksDB instance should be closed in ListViaMergeSpeedMiniBenchmark Key: FLINK-6210 URL: https://issues.apache.org/jira/browse/FLINK-6210 Project: Flink Issue Ty

Flink on yarn passing yarn config params.

2017-03-28 Thread praveen kanamarlapudi
Hi, How can I pass yarn application tag while running flink on yarn? Example command: ./bin/flink run -d -m yarn-cluster -yn 4 -yjm 1024 -ytm 4096 examples/batch/WordCount.jar Thanks, Praveen

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-28 Thread Haohui Mai
-1 (non-binding) We recently found out that all jobs submitted via UI will have a parallelism of 1, potentially due to FLINK-5808. Filed FLINK-6209 to track it. ~Haohui On Mon, Mar 27, 2017 at 2:59 AM Chesnay Schepler wrote: > If possible I would like to include FLINK-6183 & FLINK-6184 as wel

[jira] [Created] (FLINK-6209) StreamPlanEnvironment always has a parallelism of 1

2017-03-28 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6209: - Summary: StreamPlanEnvironment always has a parallelism of 1 Key: FLINK-6209 URL: https://issues.apache.org/jira/browse/FLINK-6209 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6208) Implement skip till next match strategy

2017-03-28 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-6208: --- Summary: Implement skip till next match strategy Key: FLINK-6208 URL: https://issues.apache.org/jira/browse/FLINK-6208 Project: Flink Issue Type: New F

[jira] [Created] (FLINK-6207) Duplicate type serializers for async snapshots of CopyOnWriteStateTable

2017-03-28 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6207: - Summary: Duplicate type serializers for async snapshots of CopyOnWriteStateTable Key: FLINK-6207 URL: https://issues.apache.org/jira/browse/FLINK-6207 Project: Flin

[jira] [Created] (FLINK-6206) As an Engineer, I want task state transition log to be warn/error for FAILURE scenarios

2017-03-28 Thread Dan Bress (JIRA)
Dan Bress created FLINK-6206: Summary: As an Engineer, I want task state transition log to be warn/error for FAILURE scenarios Key: FLINK-6206 URL: https://issues.apache.org/jira/browse/FLINK-6206 Project

Re: [DISCUSS] Project build time and possible restructuring

2017-03-28 Thread Robert Metzger
I think your selection of modules is okay. Moving out storm and the scala shell would be nice as well. But storm is not really maintained, so maybe we should consider moving it out of the Flink repo entirely. And the scala shell is not a library, but it also doesn't really belong into the main rep

[jira] [Created] (FLINK-6205) Put late elements in side output.

2017-03-28 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-6205: - Summary: Put late elements in side output. Key: FLINK-6205 URL: https://issues.apache.org/jira/browse/FLINK-6205 Project: Flink Issue Type: Bug C

Re: Java library for Flink-Kudu integration

2017-03-28 Thread Jinkui Shi
This make sense. Only one problem, bahir-flink is not very active. Maybe need more committee to pay some time on it, and have some new plan. We also plan to support carbondata[1] in bahir-flink. By the way, to keep the code base thin, can rewrite flink with Scala step by step until Flink 2.0 :))

[jira] [Created] (FLINK-6204) Improve Event-Time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL

2017-03-28 Thread sunjincheng (JIRA)
sunjincheng created FLINK-6204: -- Summary: Improve Event-Time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL Key: FLINK-6204 URL: https://issues.apache.org/jira/browse/FLINK-6204 Project: Flink

Re: Java library for Flink-Kudu integration

2017-03-28 Thread Stephan Ewen
We are currently looking into how we can keep the size of the code base under control (because it is growing super large). Part is moving libraries into a dedicated subrepository (there is a separate mailing list thread on that) and some connectors to Bahir. Connectors can move between Flink and B

[jira] [Created] (FLINK-6203) DataSet Transformations

2017-03-28 Thread JIRA
苏拓 created FLINK-6203: - Summary: DataSet Transformations Key: FLINK-6203 URL: https://issues.apache.org/jira/browse/FLINK-6203 Project: Flink Issue Type: Bug Components: DataSet API Affects

Re: Figuring out when a job has successfully restored state

2017-03-28 Thread Gyula Fóra
Hi, Another thought I had last night, maybe we could have another state for recovering jobs in the future. Deploying -> Recovering -> Running This recovering state might only be applicable for state backends that have to be restored before processing can start, lazy state backends (like external d

Re: Java library for Flink-Kudu integration

2017-03-28 Thread Fabian Hueske
No, we do not want to move all connectors to Apache Bahir or replace the connectors by Bahir. The Flink community aims to maintain the most important connectors within Flink. Maintaining all connectors would be a huge effort. So, we decided to move some of the less frequently used connectors to Ba