Re: IO metrics

2018-02-15 Thread Till Rohrmann
The metric `numButesOutPerSecond` measures the number of bytes the corresponding task emits per second over the network to a consuming task. If the task is a sink, then this metric will be 0, because there is no down stream operator. If you want to have additional information from your BucketingSi

[jira] [Created] (FLINK-8662) FutureUtilsTest#testRetryWithDelay unstable

2018-02-15 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8662: Summary: FutureUtilsTest#testRetryWithDelay unstable Key: FLINK-8662 URL: https://issues.apache.org/jira/browse/FLINK-8662 Project: Flink Issue Type: Bug

[DISCUSS] Flink security improvements

2018-02-15 Thread Shuyi Chen
Hi community, I would like to propose a few improvements in Flink security regarding scalability and extensibility. Here is the proposal: https://docs.google.com/document/d/10V7LiNlUJKeKZ58mkR7oVv1t6BrC6TZi3FGf2Dm6-i8/edit?usp=sharing Comments are highly appreciated. Please let me know what the

Re: [RESULT] [VOTE] Release 1.4.1, release candidate #1

2018-02-15 Thread Tzu-Li Tai
The voting time has passed and I'm happy to announce that we've collected enough votes to release this RC as Flink 1.4.1. +1 votes: - Fabian (binding) - Aljoscha (binding) - Timo (binding) - Gordon (binding) That's 4 votes, 4 binding. No 0 or -1 votes. Thanks to everyone who has contribut

[jira] [Created] (FLINK-8663) Execution of DataStreams result in non functionality of size of Window for countWindow

2018-02-15 Thread Subham (JIRA)
Subham created FLINK-8663: - Summary: Execution of DataStreams result in non functionality of size of Window for countWindow Key: FLINK-8663 URL: https://issues.apache.org/jira/browse/FLINK-8663 Project: Flink

Re: [RESULT] [VOTE] Release 1.4.1, release candidate #1

2018-02-15 Thread Fabian Hueske
Thanks Gordon for managing the release! 2018-02-15 13:22 GMT+01:00 Tzu-Li Tai : > The voting time has passed and I'm happy to announce that we've collected > enough votes to release this RC as Flink 1.4.1. > > +1 votes: > - Fabian (binding) > - Aljoscha (binding) > - Timo (binding) > - Gordon (bi

Re: [RESULT] [VOTE] Release 1.4.1, release candidate #1

2018-02-15 Thread Till Rohrmann
Thanks Gordon for being the release manager. Also thanks to the community for all the work which went into Flink 1.4.1. Cheers, Till On Thu, Feb 15, 2018 at 1:57 PM, Fabian Hueske wrote: > Thanks Gordon for managing the release! > > 2018-02-15 13:22 GMT+01:00 Tzu-Li Tai : > > > The voting time

Re: Why are checkpoint failures so serious?

2018-02-15 Thread Ron Crocker
Thanks Till and Aljoscha. Are there good options for 1.4? I’d rather not fork to get this, but I’ll do it if I have to. Ron > On Feb 14, 2018, at 2:43 AM, Aljoscha Krettek wrote: > > Hi Ron, > > Keep in mind, though, that this feature will only be available with the > upcoming Flink 1.5. Jus

[ANNOUNCE] Apache Flink 1.4.1 released

2018-02-15 Thread Tzu-Li (Gordon) Tai
The Apache Flink community is very happy to announce the release of Apache Flink 1.4.1, which is the first bugfix release for the Apache Flink 1.4 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming a

[jira] [Created] (FLINK-8664) Change termination future type of RpcEndpoint to Void

2018-02-15 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8664: Summary: Change termination future type of RpcEndpoint to Void Key: FLINK-8664 URL: https://issues.apache.org/jira/browse/FLINK-8664 Project: Flink Issue Typ

[jira] [Created] (FLINK-8665) Allow RpcEndpoint#postStop to complete asynchronously

2018-02-15 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8665: Summary: Allow RpcEndpoint#postStop to complete asynchronously Key: FLINK-8665 URL: https://issues.apache.org/jira/browse/FLINK-8665 Project: Flink Issue Typ

[jira] [Created] (FLINK-8666) Use AkkaUtils#testDispatcherConfig in MiniCluster

2018-02-15 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8666: Summary: Use AkkaUtils#testDispatcherConfig in MiniCluster Key: FLINK-8666 URL: https://issues.apache.org/jira/browse/FLINK-8666 Project: Flink Issue Type: I

Re: Support distinct aggregation over data stream on Table/SQL API

2018-02-15 Thread Rong Rong
Thanks Fabian for the review, I will incorporate the feedback and finalized the design doc and open a JIRA to track all sub-tasks. Please also feel free to comment if there's any other related DISTINCT aggregation use cases not covered by the design doc. One higher level question regarding #4, sh

Re: Support distinct aggregation over data stream on Table/SQL API

2018-02-15 Thread Fabian Hueske
Hi Rong, Thanks for the update! Please suggest JIRAs to close (or close them yourself if possible) if they are covered by the ones that you create. At the moment, we aim for feature parity between SQL and Table API. So ideally all features are available in both APIs. This is usually not too compl

[jira] [Created] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-15 Thread Bowen Li (JIRA)
Bowen Li created FLINK-8667: --- Summary: expose key in KeyedBroadcastProcessFunction#onTimer() Key: FLINK-8667 URL: https://issues.apache.org/jira/browse/FLINK-8667 Project: Flink Issue Type: Improve

Re: [ANNOUNCE] Apache Flink 1.4.1 released

2018-02-15 Thread Bowen Li
Congratulations everyone! On Thu, Feb 15, 2018 at 10:04 AM, Tzu-Li (Gordon) Tai wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.4.1, which is the first bugfix release for the Apache Flink 1.4 > series. > > > Apache Flink® is an open-source stream pro