Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-13 Thread Piotr Nowojski
+0.95 from my side. Network changes are mostly reviewed and should be merged by the end of this week. Piotrek > On 12 Feb 2018, at 17:41, Stephan Ewen wrote: > > I agree with the basic idea. I think there is no need to call it "soft > feature freeze" though - it is a feature freeze (no new fe

Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-13 Thread Till Rohrmann
+1 from my side. Cheers, Till On Tue, Feb 13, 2018 at 9:52 AM, Piotr Nowojski wrote: > +0.95 from my side. > > Network changes are mostly reviewed and should be merged by the end of > this week. > > Piotrek > > > On 12 Feb 2018, at 17:41, Stephan Ewen wrote: > > > > I agree with the basic idea

[jira] [Created] (FLINK-8642) Initialize descriptors before use at getBroadcastState().

2018-02-13 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-8642: - Summary: Initialize descriptors before use at getBroadcastState(). Key: FLINK-8642 URL: https://issues.apache.org/jira/browse/FLINK-8642 Project: Flink Iss

[jira] [Created] (FLINK-8643) Use JobManagerOptions#SLOT_REQUEST_TIMEOUT in ExecutionGraph

2018-02-13 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8643: Summary: Use JobManagerOptions#SLOT_REQUEST_TIMEOUT in ExecutionGraph Key: FLINK-8643 URL: https://issues.apache.org/jira/browse/FLINK-8643 Project: Flink I

[jira] [Created] (FLINK-8644) Shut down AkkaRpcActors with PoisonPill

2018-02-13 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8644: Summary: Shut down AkkaRpcActors with PoisonPill Key: FLINK-8644 URL: https://issues.apache.org/jira/browse/FLINK-8644 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8645) Support convenient extension of parent-first ClassLoader patterns

2018-02-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8645: --- Summary: Support convenient extension of parent-first ClassLoader patterns Key: FLINK-8645 URL: https://issues.apache.org/jira/browse/FLINK-8645 Project: Flink

[jira] [Created] (FLINK-8646) Move docs directory to flink-docs

2018-02-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8646: --- Summary: Move docs directory to flink-docs Key: FLINK-8646 URL: https://issues.apache.org/jira/browse/FLINK-8646 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-8647) Introduce JobMasterConfiguration

2018-02-13 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8647: Summary: Introduce JobMasterConfiguration Key: FLINK-8647 URL: https://issues.apache.org/jira/browse/FLINK-8647 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-8648) Allow for customization of emitRecordAndUpdateState in Kinesis connector

2018-02-13 Thread Thomas Weise (JIRA)
Thomas Weise created FLINK-8648: --- Summary: Allow for customization of emitRecordAndUpdateState in Kinesis connector Key: FLINK-8648 URL: https://issues.apache.org/jira/browse/FLINK-8648 Project: Flink

Re: [VOTE] Release 1.4.1, release candidate #1

2018-02-13 Thread Fabian Hueske
Hi, I check the diff between Flink 1.4.0 and Flink 1.4.1-RC1 for added/changed dependencies. I only found a version update of the Snappy dependency. Both, the previous and the new version, are ASL so this is fine. The signatures and hashes are OK. I also built the binary release and found no issu

[jira] [Created] (FLINK-8649) Scala StreamExecutionEnvironment.createInput should pass on the TypeInfo

2018-02-13 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-8649: -- Summary: Scala StreamExecutionEnvironment.createInput should pass on the TypeInfo Key: FLINK-8649 URL: https://issues.apache.org/jira/browse/FLINK-8649 Project: Flink

Re: [VOTE] Release 1.4.1, release candidate #1

2018-02-13 Thread Alexandru Gutan
Hi everyone, Is [FLINK-6352] [kafka] Timestamp-based offset configuration for FlinkKafkaConsumer going to make it into 1.4.1? Or it's left for 1.5? Best, Alex. On 13 February 2018 at 19:05, Fabian Hueske wrote: > Hi, > > I check the diff between Flin

Re: [VOTE] Release 1.4.1, release candidate #1

2018-02-13 Thread Fabian Hueske
Hi Alex, FLINK-6352 seems to be an improvement / new feature. These are included in minor releases like 1.5.0 but not in bug fix releases such as 1.4.1. Best, Fabian 2018-02-13 19:08 GMT+01:00 Alexandru Gutan : > Hi everyone, > > Is [FLINK-6352] [kafka] Timestamp-based offset configuration for

IO metrics

2018-02-13 Thread cw7k
Hi, couple questions on IO metrics listed here:https://ci.apache.org/projects/flink/flink-docs-release-1.4/monitoring/metrics.html#io We're trying to get metrics such as throughput to filesystem sinks.  Are the metrics listed on that page automatically recorded, and we just need to retrieve the

Why are checkpoint failures so serious?

2018-02-13 Thread Ron Crocker
What would it take to be a little more flexible in handling checkpoint failures? Right now I have a team that’s checkpointing into S3, via the FsStateBackend and an appropriate URL. Sometimes these checkpoints fail. They’re transient, though, and a retry would likely work. However, when they

Support distinct aggregation over data stream on Table/SQL API

2018-02-13 Thread Rong Rong
Hi Community, We are working on support of distinct aggregators over data stream on Table/SQL API. Currently there are seems to be many JIRAs related to distinct agg over stream use cases which are still pending (FLINK-6249 , FLINK-6260

[jira] [Created] (FLINK-8650) Add tests and documentation for WINDOW clause

2018-02-13 Thread Timo Walther (JIRA)
Timo Walther created FLINK-8650: --- Summary: Add tests and documentation for WINDOW clause Key: FLINK-8650 URL: https://issues.apache.org/jira/browse/FLINK-8650 Project: Flink Issue Type: Improve