[ANNOUNCE] Apache Flink 0.9.1 released

2015-09-01 Thread Ufuk Celebi
The Apache Flink community is pleased to announce the availability of the 0.9.1 release. Apache Flink is an open source platform for scalable stream and batch data processing. Flink’s core consists of a streaming dataflow engine that provides data distribution, communication, and fault tolerance f

[jira] [Created] (FLINK-2600) Failing ElasticsearchSinkITCase.testNodeClient test case

2015-09-01 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2600: Summary: Failing ElasticsearchSinkITCase.testNodeClient test case Key: FLINK-2600 URL: https://issues.apache.org/jira/browse/FLINK-2600 Project: Flink Issue

[jira] [Created] (FLINK-2601) IOManagerAsync may produce NPE during shutdown

2015-09-01 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2601: - Summary: IOManagerAsync may produce NPE during shutdown Key: FLINK-2601 URL: https://issues.apache.org/jira/browse/FLINK-2601 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-2602) Gelly algorithms obtain new execution environments.

2015-09-01 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2602: --- Summary: Gelly algorithms obtain new execution environments. Key: FLINK-2602 URL: https://issues.apache.org/jira/browse/FLINK-2602 Project: Flink Issue Type: B

Re: 答复: Some questions about storm metrics

2015-09-01 Thread Kostas Tzoumas
Flink accumulators are documented here: https://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#accumulators--counters I think Aljoscha's idea is to implement Storm metrics on top of those. Huangwei, perhaps you can look whether the interfaces match (basically if Flink

Re: Some questions about storm metrics

2015-09-01 Thread huangwei (G)
Hi Kostas, Thank you for the information. I`ll take a look. And I`m comparing the storm metrics with Flink accumulators. I`ll let you know if I have some ideas. Flink accumulators are documented here: https://ci.apache.org/projects/flink/flink-docs-master/

Re: SGD Effective Learning Rate

2015-09-01 Thread Theodore Vasiloudis
I would also vote for option 1, implemented through a new (string?) Parameter for SGD. Also, see a previous discussion here about adaptive learning rates. On Mon, Aug 31, 2015 at

Outer-join operator integration with DataSet API (FLINK-2576)

2015-09-01 Thread Johann Kovacs
Hi all, we (Ricky and I) are currently working on the outer join implementation for Flink (FLINK-687, previous pull requests #907, #1052). I am now looking for advice on 2 issues specifically regarding the integration of the outer join operator with the DataSet API (FLINK-2576). 1. There are sev

Re: Outer-join operator integration with DataSet API (FLINK-2576)

2015-09-01 Thread Till Rohrmann
Hi Johann, I'd prefer 1.c, because the different join variants are semantically different and this should be IMO reflected in the API. Moreover, the `JoinHints` are used to give hints for the selection of the underlying strategy for the different join variants. For `leftOuterJoin` you could either

[jira] [Created] (FLINK-2603) Flink hangs before starting execution

2015-09-01 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-2603: - Summary: Flink hangs before starting execution Key: FLINK-2603 URL: https://issues.apache.org/jira/browse/FLINK-2603 Project: Flink Issue Type: Bug Compo

[jira] [Created] (FLINK-2604) Access to SessionID without holding lock in ZooKeeperLeaderElectionService

2015-09-01 Thread Ted Yu (JIRA)
Ted Yu created FLINK-2604: - Summary: Access to SessionID without holding lock in ZooKeeperLeaderElectionService Key: FLINK-2604 URL: https://issues.apache.org/jira/browse/FLINK-2604 Project: Flink I

[jira] [Created] (FLINK-2605) Unclosed RandomAccessFile may leak resource in StaticFileServerHandler

2015-09-01 Thread Ted Yu (JIRA)
Ted Yu created FLINK-2605: - Summary: Unclosed RandomAccessFile may leak resource in StaticFileServerHandler Key: FLINK-2605 URL: https://issues.apache.org/jira/browse/FLINK-2605 Project: Flink Issue

答复: Some questions about storm metrics

2015-09-01 Thread huangwei (G)
Dear all, I focused on the Flink-accumulator and found that there is not any feature to count the average of values. And there is a MultiReducedMetric class in storm that calculates the average. This class can be used internally to get the latency in storm. So as the first step, I`d like to add a