[jira] [Created] (FLINK-3282) Add FlinkRelNode interface.

2016-01-25 Thread Chengxiang Li (JIRA)
Chengxiang Li created FLINK-3282: Summary: Add FlinkRelNode interface. Key: FLINK-3282 URL: https://issues.apache.org/jira/browse/FLINK-3282 Project: Flink Issue Type: New Feature C

Re: Scala 2.10/2.11 Maven dependencies

2016-01-25 Thread Maximilian Michels
I won't have the time to finish the refactoring. Also, it will be pretty painful with all the large streaming pull requests being merged at the moment. If there are no objections, I would like to merge the Scala suffix changes with "flink-streaming-java" being Scala dependent. It will improve the e

Re: Scala 2.10/2.11 Maven dependencies

2016-01-25 Thread Ufuk Celebi
> On 25 Jan 2016, at 11:39, Maximilian Michels wrote: > > I won't have the time to finish the refactoring. Also, it will be > pretty painful with all the large streaming pull requests being merged > at the moment. If there are no objections, I would like to merge the > Scala suffix changes with

Release Flink 1.0.0

2016-01-25 Thread Robert Metzger
Hi, I would like to release 1.0.0 in the next weeks. Looking at the JIRAs, I think we are going to close a lot of blocking issues soon. How about we do a first release candidate on Wednesday, 3. February? The first release candidate is most likely not going to pass the vote, the primary goal will

Re: Release Flink 1.0.0

2016-01-25 Thread Gyula Fóra
Hi, I agree that getting Flink 1.0.0 out soon would be great as Flink is in a pretty solid state right now. I wonder whether it would make sense to include an out-of-core state backend in streaming core that can be used with partitioned/window states. I think if we are releasing 1.0.0 we should h

[jira] [Created] (FLINK-3283) Failed Kafka 0.9 test on duplicate message

2016-01-25 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3283: -- Summary: Failed Kafka 0.9 test on duplicate message Key: FLINK-3283 URL: https://issues.apache.org/jira/browse/FLINK-3283 Project: Flink Issue Type: Test

[jira] [Created] (FLINK-3284) Broken web link: Hadoop compatibility in Flink

2016-01-25 Thread Slim Baltagi (JIRA)
Slim Baltagi created FLINK-3284: --- Summary: Broken web link: Hadoop compatibility in Flink Key: FLINK-3284 URL: https://issues.apache.org/jira/browse/FLINK-3284 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-3285) Skip Maven deployment of flink-java8

2016-01-25 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3285: - Summary: Skip Maven deployment of flink-java8 Key: FLINK-3285 URL: https://issues.apache.org/jira/browse/FLINK-3285 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-3286) Remove JDEB Debian Package code from flink-dist

2016-01-25 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3286: --- Summary: Remove JDEB Debian Package code from flink-dist Key: FLINK-3286 URL: https://issues.apache.org/jira/browse/FLINK-3286 Project: Flink Issue Type: Bug

Re: Release Flink 1.0.0

2016-01-25 Thread Stephan Ewen
I agree, with Gyula, one out-of-core state backend should be in. We are pretty close to that. Aljoscha has done good work on extending test coverage for state backends, so we should be pretty comfortable that it works as well, once we integrate new state backends with the tests. There is a bit of

Re: Scala 2.10/2.11 Maven dependencies

2016-01-25 Thread Stephan Ewen
+1 On Mon, Jan 25, 2016 at 11:41 AM, Ufuk Celebi wrote: > > > On 25 Jan 2016, at 11:39, Maximilian Michels wrote: > > > > I won't have the time to finish the refactoring. Also, it will be > > pretty painful with all the large streaming pull requests being merged > > at the moment. If there are

Re: Features only compatible with hadoop 2.x

2016-01-25 Thread Stephan Ewen
At some point, the state backends should probably have their own parent- and subprojects, similar to the batch-connectors and streaming-connectors. Then you have the flexibility to include and exclude them as needed. Stephan On Sat, Jan 23, 2016 at 6:42 PM, Gyula Fóra wrote: > Alright, thanks

[jira] [Created] (FLINK-3287) Flink Kafka Consumer fails due to Curator version conflict

2016-01-25 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-3287: - Summary: Flink Kafka Consumer fails due to Curator version conflict Key: FLINK-3287 URL: https://issues.apache.org/jira/browse/FLINK-3287 Project: Flink Is

[jira] [Created] (FLINK-3288) KafkaConsumer (0.8) fails with UnknownException

2016-01-25 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-3288: - Summary: KafkaConsumer (0.8) fails with UnknownException Key: FLINK-3288 URL: https://issues.apache.org/jira/browse/FLINK-3288 Project: Flink Issue Type: B

Re: Scala 2.10/2.11 Maven dependencies

2016-01-25 Thread Till Rohrmann
+1 On Mon, Jan 25, 2016 at 3:36 PM, Stephan Ewen wrote: > +1 > > On Mon, Jan 25, 2016 at 11:41 AM, Ufuk Celebi wrote: > > > > > > On 25 Jan 2016, at 11:39, Maximilian Michels wrote: > > > > > > I won't have the time to finish the refactoring. Also, it will be > > > pretty painful with all the

Re: Release Flink 1.0.0

2016-01-25 Thread Aljoscha Krettek
Hi, I think the refactoring of Partitioned State and the WindowOperator on state work is almost ready. I also have the RocksDB state backend working. I’m running some tests now on the cluster and should be able to open a PR tomorrow. > On 25 Jan 2016, at 15:36, Stephan Ewen wrote: > > I agree

Re: Flink Yarn Stack Size

2016-01-25 Thread Stephan Ewen
@Hilmi: A stack size of 1GB is too much, maybe the JVM ignores it? Can you try "-Xss2m" or so? Is this to prevent stack overflow errors in some code? Stephan On Fri, Jan 22, 2016 at 2:21 PM, Robert Metzger wrote: > Hi, > > yes, looks like the argument is passed correctly. > > By the way: Why

Re: Flink Yarn Stack Size

2016-01-25 Thread Hilmi Yildirim
Hi, I have solved the problem. I used an object which contained a huge generic MutableList. When kryo serializes the MutableList it does many recursive calls which lead to a huge stack and to the StackOverFlowError. I changed the MutableList to a Set and now kryo does not do so many recursive

Re: Release Flink 1.0.0

2016-01-25 Thread Matthias J. Sax
Hi, I also would like to get the STOP signal in. But I do not have time to work in it this week... According to Till's comments, this will be the last round of reviewing required. So I should be able to finish it till 3rd Feb, but not sure. What do you think about it? -Matthias On 01/25/2016 04

[jira] [Created] (FLINK-3289) Double reference to flink-contrib

2016-01-25 Thread Stefano Baghino (JIRA)
Stefano Baghino created FLINK-3289: -- Summary: Double reference to flink-contrib Key: FLINK-3289 URL: https://issues.apache.org/jira/browse/FLINK-3289 Project: Flink Issue Type: Bug