Re: [VOTE] Release Apache Flink 1.1.0 (RC2)

2016-08-04 Thread Ufuk Celebi
+1 This RC: + Check checksums and signatures + Verify no binaries in source release Last RC: + Build (clean verify) with default Hadoop version + Build (clean verify) with Hadoop 2.6.1 + Checked build for Scala 2.11 + Checked all POMs + Read README.md + Examined OUT and LOG files + Checked path

Re: [ANNOUNCE] Introducing a feature branch for FLIP-6 (cluster management)

2016-08-04 Thread Till Rohrmann
+1 On Thu, Aug 4, 2016 at 3:20 AM, Aljoscha Krettek wrote: > +1 seems good > > On Wed, 3 Aug 2016 at 11:05 Stephan Ewen wrote: > > > Hi all! > > > > We would like to start working on FLIP-6. > > > > Because it is such a big change, I would like to start developing it > > concurrently to the mas

Conceptual difference Windows and DataSet

2016-08-04 Thread Kevin Jacobs
Hi, I have the following use case: 1. Group by a specific field. 2. Get a list of all messages belonging to the group. 3. Count the number of records in the group. With the use of DataSets, it is fairly easy to do this (see http://stackoverflow.com/questions/38745446/apache-flink

AW: [ANNOUNCE] Introducing a feature branch for FLIP-6 (clustermanagement)

2016-08-04 Thread fhueske
+1 We did the same when porting the Table API to Calcite and it worked very well. Von: Till Rohrmann

Re: [ANNOUNCE] Introducing a feature branch for FLIP-6 (clustermanagement)

2016-08-04 Thread Till Rohrmann
Alright, I've created the feature branch *flip-6* in the main repository. The work related to FLIP-6 should be consolidated in this branch prior to merging it to the master. Cheers, Till On Thu, Aug 4, 2016 at 12:41 PM, wrote: > +1 > > We did the same when porting the Table API to Calcite and i

[jira] [Created] (FLINK-4312) Remove Serializabiliy of ExecutionGraph

2016-08-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4312: --- Summary: Remove Serializabiliy of ExecutionGraph Key: FLINK-4312 URL: https://issues.apache.org/jira/browse/FLINK-4312 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4313) Inconsistent code for Key/Value in the CheckpointCoordinator

2016-08-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4313: --- Summary: Inconsistent code for Key/Value in the CheckpointCoordinator Key: FLINK-4313 URL: https://issues.apache.org/jira/browse/FLINK-4313 Project: Flink Iss

Re: Map Reduce Sorting

2016-08-04 Thread Fabian Hueske
Hi, the Reducer-side sorting is done with an external merge-sort. The sorter collects records in an in-memory buffer until it is completely filled, sorts the buffer using quicksort, and spills the sorted result to disk (if available a combiner is applied before spilling to reduce IO). After all da