[jira] [Created] (FLINK-2281) Allow chaining of operators with multiple inputs

2015-06-26 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-2281: - Summary: Allow chaining of operators with multiple inputs Key: FLINK-2281 URL: https://issues.apache.org/jira/browse/FLINK-2281 Project: Flink Issue Type: Improvem

Re: Thoughts About Streaming

2015-06-26 Thread Aljoscha Krettek
I like the bit about the API a lot. What I don't see yet is how delta window can work in a distributed way with out-of-order elements. On Fri, 26 Jun 2015 at 19:43 Stephan Ewen wrote: > Here is a first bit of what I have been writing down. Will add more over > the next days: > > > https://cwiki.

Re: Thoughts About Streaming

2015-06-26 Thread Stephan Ewen
Here is a first bit of what I have been writing down. Will add more over the next days: https://cwiki.apache.org/confluence/display/FLINK/Stream+Windows https://cwiki.apache.org/confluence/display/FLINK/Parallel+Streams%2C+Partitions%2C+Time%2C+and+Ordering On Thu, Jun 25, 2015 at 6:35 PM, Pa

Re: Stream iteration head as ConnectedDataStream

2015-06-26 Thread Paris Carbone
That’s convenient, at least for the incremental ML where feedback streams are the norm. In this case we don’t force the user to create wrappers and we also know what comes from where. I went through the PR and it looks that doesn’t break anything so you have my +1. Paris > On 26 Jun 2015, at

[jira] [Created] (FLINK-2280) GenericTypeComparator.compare() does not respect ascending flag

2015-06-26 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-2280: Summary: GenericTypeComparator.compare() does not respect ascending flag Key: FLINK-2280 URL: https://issues.apache.org/jira/browse/FLINK-2280 Project: Flink

Stream iteration head as ConnectedDataStream

2015-06-26 Thread Gyula Fóra
Hey! Now that we are implementing more and more applications for streaming that use iterations we realized a huge shortcoming of the current iteration api. Currently it only allows to feedback data of the same type to the iteration head. This makes sense because the operators are typed but makes

[jira] [Created] (FLINK-2279) Allow treating iteration head as ConnectedDataStream

2015-06-26 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-2279: - Summary: Allow treating iteration head as ConnectedDataStream Key: FLINK-2279 URL: https://issues.apache.org/jira/browse/FLINK-2279 Project: Flink Issue Type: New

Re: [VOTE] Release additional convenience binaries for Flink 0.9.0

2015-06-26 Thread Robert Metzger
+1 - Ran a 100 GB wordcount on a Hadoop/YARN 2.4.0 installation. So both YARN and HDFS seem to work for the 2.4.1 build. - Tested the 2.6.0 build against HDP 2.2, which contains Hadoop 2.6.0. There I generated 100 GB of data and ran Wordcount ;) On Thu, Jun 25, 2015 at 3:32 PM, Ufuk Celebi wrote

[jira] [Created] (FLINK-2278) SparseVector created from Breeze Sparsevector has wrong size

2015-06-26 Thread Christoph Alt (JIRA)
Christoph Alt created FLINK-2278: Summary: SparseVector created from Breeze Sparsevector has wrong size Key: FLINK-2278 URL: https://issues.apache.org/jira/browse/FLINK-2278 Project: Flink I

[jira] [Created] (FLINK-2277) In Scala API delta Iterations can not be set to unmanaged

2015-06-26 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-2277: --- Summary: In Scala API delta Iterations can not be set to unmanaged Key: FLINK-2277 URL: https://issues.apache.org/jira/browse/FLINK-2277 Project: Flink