Re: [DISCUSS] Flink 1.6 features

2018-07-04 Thread Stephan Ewen
Hi all! A late follow-up with some thoughts: In principle, all these are good suggestions and are on the roadmap. We are trying to make the release "by time", meaning for it at a certain date (roughly in two weeks) and take what features are ready into the release. Looking at the status of the f

Re: [DISCUSS] Flink 1.6 features

2018-06-24 Thread zhangminglei
Hi, Community By the way, there is a very important feature I think it should be. Currently, the BucketingSink does not support when a bucket is ready for user use. This situation will be very obvious when flink work with offline end. We called that real time/offline integration in business. In

Re: [DISCUSS] Flink 1.6 features

2018-06-18 Thread zhangminglei
;>> > >>>> Atomic cancel-with-savepoint: Agreed, this is important. Making this > >>>> work with all sources needs a bit more work. We should have this in the > >>>> roadmap. > >>>> > >>>> Elastic Bloomfilter

Re: [DISCUSS] Flink 1.6 features

2018-06-17 Thread zhangminglei
e should have this in the roadmap. >>>> >>>> Elastic Bloomfilters: This seems like an interesting new feature - the >>>> above suggested feature set was more about addressing some longer standing >>>> issues/requests. However, nothing should prevent co

Re: [DISCUSS] Flink 1.6 features

2018-06-17 Thread zhangminglei
lt;https://issues.apache.org/jira/browse/FLINK-5479> >> issues.apache.org <http://issues.apache.org/> >> Reported in ML: >> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-topic-partition-skewness-causes-watermark-not-being-emitted-td11008.html >>

Re: [DISCUSS] Flink 1.6 features

2018-06-17 Thread zhangminglei
p://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-topic-partition-skewness-causes-watermark-not-being-emitted-td11008.html > > <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-topic-partition-skewness-causes-watermark-not-being-emitte

Re: [DISCUSS] Flink 1.6 features

2018-06-16 Thread Elias Levy
Reported in ML: http://apache-flink-user-maili >>> ng-list-archive.2336050.n4.nabble.com/Kafka-topic-partition- >>> skewness-causes-watermark-not-being-emitted-td11008.html It's normally >>> not a common case to have Kafka partitions not producing any data, but >>> i

Re: [DISCUSS] Flink 1.6 features

2018-06-09 Thread sihua zhou
#x27;ll probably be good to handle this as well. I ... | From: Rico Bergmann Sent: Tuesday, June 5, 2018 9:12:00 PM To: Hao Sun Cc:dev@flink.apache.org; user Subject: Re: [DISCUSS] Flink 1.6 features +1 on K8s integration Am 06.06.2018 um 00:01 schrieb Hao Sun : adding my vote

Re: [DISCUSS] Flink 1.6 features

2018-06-08 Thread Elias Levy
normally >> not a common case to have Kafka partitions not producing any data, but >> it'll probably be good to handle this as well. I ... >> >> -- >> *From:* Rico Bergmann >> *Sent:* Tuesday, June 5, 2018 9:12:00 PM >> *To:

Re: [DISCUSS] Flink 1.6 features

2018-06-08 Thread Stephan Ewen
5, 2018 9:12:00 PM > *To:* Hao Sun > *Cc:* dev@flink.apache.org; user > *Subject:* Re: [DISCUSS] Flink 1.6 features > > +1 on K8s integration > > > > Am 06.06.2018 um 00:01 schrieb Hao Sun : > > adding my vote to K8S Job mode, maybe it is this? > > Smoothe

Re: [DISCUSS] Flink 1.6 features

2018-06-04 Thread Ben Yan
Flink 1.5 has happened (yay!) - so it is a good time > > From: Stephan Ewen > To: dev@flink.apache.org, user > Date: 06/04/2018 02:21 AM > Subject: [DISCUSS] Flink 1.6 features > -- > > > > Hi Flink Community! > > The release of Apache

Re: [DISCUSS] Flink 1.6 features

2018-06-04 Thread Che Lui Shum
, Shirley Shum From: Stephan Ewen To: dev@flink.apache.org, user Date: 06/04/2018 02:21 AM Subject:[DISCUSS] Flink 1.6 features Hi Flink Community! The release of Apache Flink 1.5 has happened (yay!) - so it is a good time to start talking about what to do for release 1.6

Re: [DISCUSS] Flink 1.6 features

2018-06-04 Thread Till Rohrmann
Before removing the legacy code, I would still wait a bit and see what the user feedback is. The legacy mode is a good safety net against severe deployment regressions. Thus, it should be a very conscious decision to remove the code. As far as I know, there is currently nobody actively working on

Re:[DISCUSS] Flink 1.6 features

2018-06-04 Thread sihua zhou
Hi Stephan, could you please also consider the "Elastic Filter " feature discussioned in thread http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/PROPOSAL-Introduce-Elastic-Bloom-Filter-For-Flink-td22430.html ? Best, Sihua On 06/4/2018 17:21,Stephan Ewen wrote: Hi Flink Comm

[DISCUSS] Flink 1.6 features

2018-06-04 Thread Stephan Ewen
Hi Flink Community! The release of Apache Flink 1.5 has happened (yay!) - so it is a good time to start talking about what to do for release 1.6. *== Suggested release timeline ==* I would propose to release around *end of July* (that is 8-9 weeks from now). The rational behind that: There was