Type erasure problem solely on cluster execution

2016-10-18 Thread Martin Junghanns
Hi, I am running into a type erasure problem which only occurs when I execute the code using a Flink cluster (1.1.2). I created a Gist [1] which reproduces the problem. I also added a unit test to show that it does not fail in local and collection mode. Maybe it is also interesting to mentio

Add MapState for keyed streams

2016-10-18 Thread SHI Xiaogang
Hi, all. I created the JIRA https://issues.apache.org/jira/browse/FLINK-4856 to propose adding MapStates into Flink. MapStates are very useful in our daily jobs. For example, when implementing DistinctCount, we store the values into a MapState and the result of each group(key) is exactly the numbe

[jira] [Created] (FLINK-4856) Add MapState for keyed streams

2016-10-18 Thread Xiaogang Shi (JIRA)
Xiaogang Shi created FLINK-4856: --- Summary: Add MapState for keyed streams Key: FLINK-4856 URL: https://issues.apache.org/jira/browse/FLINK-4856 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-4855) Add partitionedKeyBy to DataStream

2016-10-18 Thread Xiaowei Jiang (JIRA)
Xiaowei Jiang created FLINK-4855: Summary: Add partitionedKeyBy to DataStream Key: FLINK-4855 URL: https://issues.apache.org/jira/browse/FLINK-4855 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4854) Efficient Batch Operator in Streaming

2016-10-18 Thread Xiaowei Jiang (JIRA)
Xiaowei Jiang created FLINK-4854: Summary: Efficient Batch Operator in Streaming Key: FLINK-4854 URL: https://issues.apache.org/jira/browse/FLINK-4854 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4853) Clean up JobManager registration at the ResourceManager

2016-10-18 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4853: Summary: Clean up JobManager registration at the ResourceManager Key: FLINK-4853 URL: https://issues.apache.org/jira/browse/FLINK-4853 Project: Flink Issue T

[DISCUSS] Defining the Semantics of StreamingSQL

2016-10-18 Thread Fabian Hueske
Hi everybody, at Flink Forward we had a BOF session about StreamSQL. After the conference, some folks and I sat down and drafted a proposal for Flink's StreamSQL semantics. --> https://docs.google.com/document/d/1qVVt_16kdaZQ8RTfA_f4konQPW4tnl8THw6rzGUdaqU The proposal includes: - A definition f

[jira] [Created] (FLINK-4852) ClassCastException when assigning Watermarks with TimeCharacteristic.ProcessingTime

2016-10-18 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-4852: - Summary: ClassCastException when assigning Watermarks with TimeCharacteristic.ProcessingTime Key: FLINK-4852 URL: https://issues.apache.org/jira/browse/FLINK-4852

[jira] [Created] (FLINK-4851) Add FatalErrorHandler and MetricRegistry to ResourceManager

2016-10-18 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4851: Summary: Add FatalErrorHandler and MetricRegistry to ResourceManager Key: FLINK-4851 URL: https://issues.apache.org/jira/browse/FLINK-4851 Project: Flink Is

[jira] [Created] (FLINK-4850) FlinkML - SVM predict Operation for Vector and not LaveledVector

2016-10-18 Thread Thomas FOURNIER (JIRA)
Thomas FOURNIER created FLINK-4850: -- Summary: FlinkML - SVM predict Operation for Vector and not LaveledVector Key: FLINK-4850 URL: https://issues.apache.org/jira/browse/FLINK-4850 Project: Flink

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-18 Thread Aljoscha Krettek
Hi, yes, I think it's fine if we keep it in the same package as the Evictor. StreamRecord is more of an internal class that should not really be user facing, that's my motivation for replacing it. Cheers, Aljoscha On Mon, 17 Oct 2016 at 19:23 Vishnu Viswanath wrote: > Hi Aljoscha, > > Thanks fo

Re: Flink Metrics

2016-10-18 Thread Aljoscha Krettek
https://ci.apache.org/projects/flink/flink-docs-release-1.2/monitoring/metrics.html Or this: https://ci.apache.org/projects/flink/flink-docs-release-1.1/apis/metrics.html if you prefer Flink 1.1 On Mon, 17 Oct 2016 at 19:16 amir bahmanyari wrote: > Hi colleagues, > Is there a link that described