[jira] [Created] (FLINK-13378) Wrong comment in SingleValueAggFunction.accumulateExpressions()

2019-07-23 Thread Louis Xu (JIRA)
Louis Xu created FLINK-13378: Summary: Wrong comment in SingleValueAggFunction.accumulateExpressions() Key: FLINK-13378 URL: https://issues.apache.org/jira/browse/FLINK-13378 Project: Flink Issu

Re: Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread Becket Qin
Congrats, Zhijiang! On Tue, Jul 23, 2019 at 2:01 PM Jark Wu wrote: > Congratulations Zhijiang! > > > On Tue, 23 Jul 2019 at 11:30, vino yang wrote: > > > Congratulations Zhijiang! > > > > Haibo Sun 于2019年7月23日周二 上午10:48写道: > > > > > Congrats, Zhejiang! > > > > > > > > > Best, > > > Haibo > > >

Re: [DISCUSS] Support temporary tables in SQL API

2019-07-23 Thread Aljoscha Krettek
I would be fine with option 3) but I think option 2) is the more implicit solution that has less surprising behaviour. Aljoscha > On 22. Jul 2019, at 23:59, Xuefu Zhang wrote: > > Thanks to Dawid for initiating the discussion. Overall, I agree with Timo > that for 1.9 we should have some quick

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-23 Thread Robert Metzger
+1 On Mon, Jul 22, 2019 at 10:27 AM Biao Liu wrote: > +1, make sense to me. > Mailing list seems to be a more "community" way. > > Timo Walther 于2019年7月22日周一 下午4:06写道: > > > +1 sounds good to inform people about instabilities or other issues > > > > Regards, > > Timo > > > > > > Am 22.07.19 um

[Requirement] CI report

2019-07-23 Thread Zili Chen
Hi, Currently, our flinkbot updates CI report on status changing. However, it updates via editing GitHub comment, which would not send a notification to pr creator once status updated. Said the "PENDING" status is not quite useful, is it possible that flinkbot updates a final status(FAILURE/SUCC

[jira] [Created] (FLINK-13379) Make Flink work without flink-shaded-hadoop jar

2019-07-23 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-13379: -- Summary: Make Flink work without flink-shaded-hadoop jar Key: FLINK-13379 URL: https://issues.apache.org/jira/browse/FLINK-13379 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-13380) Improve the usability of Flink session cluster on Kubernetes

2019-07-23 Thread Yun Tang (JIRA)
Yun Tang created FLINK-13380: Summary: Improve the usability of Flink session cluster on Kubernetes Key: FLINK-13380 URL: https://issues.apache.org/jira/browse/FLINK-13380 Project: Flink Issue T

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-23 Thread jincheng sun
+1 Robert Metzger 于2019年7月23日周二 下午4:01写道: > +1 > > On Mon, Jul 22, 2019 at 10:27 AM Biao Liu wrote: > > > +1, make sense to me. > > Mailing list seems to be a more "community" way. > > > > Timo Walther 于2019年7月22日周一 下午4:06写道: > > > > > +1 sounds good to inform people about instabilities or oth

[DISCUSS] Support computed column for Flink SQL

2019-07-23 Thread Danny Chan
In umbrella task FLINK-10232[1] we have introduced CREATE TABLE grammar in our new module flink-sql-parser. And we proposed to use computed column to describe the time attribute of process time in the design doc FLINK SQL DDL[2], so user may create a table with process time attribute as followin

[jira] [Created] (FLINK-13381) BinaryHashTableTest and BinaryExternalSorterTest is crashed on Travis

2019-07-23 Thread Jark Wu (JIRA)
Jark Wu created FLINK-13381: --- Summary: BinaryHashTableTest and BinaryExternalSorterTest is crashed on Travis Key: FLINK-13381 URL: https://issues.apache.org/jira/browse/FLINK-13381 Project: Flink

Re: [DISCUSS] Support temporary tables in SQL API

2019-07-23 Thread Kurt Young
Thanks Dawid for driving this discussion. Personally, I would +1 for using option #2 for 1.9.0 and go with option #1 in 1.10.0. Regarding Xuefu's concern about option #1, I think we could also try to reuse the in-memory catalog for the builtin temporary table storage. Regarding to option #2 and o

Re: [DISCUSS] Create a Flink ecosystem website

2019-07-23 Thread Robert Metzger
Thanks a lot Marta for offering to write a blog post about the community site! I'm not sure if multi-language support for the site is a good idea. I see the packages site as something similar to GitHub or Jira. The page itself contains very view things we could actually translate. The package owne

[ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Robert Metzger
Hi all, On behalf of the Flink PMC, I'm happy to announce that Kete Young is now part of the Apache Flink Project Management Committee (PMC). Kete has been a committer since February 2017, working a lot on Table API / SQL. He's currently co-managing the 1.9 release! Thanks a lot for your work for

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread JingsongLee
Congratulations Kurt! Best, Jingsong Lee -- From:Robert Metzger Send Time:2019年7月23日(星期二) 17:24 To:dev Subject:[ANNOUNCE] Kete Young is now part of the Flink PMC Hi all, On behalf of the Flink PMC, I'm happy to announce that Ket

Re: Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread wenlong.lwl
Congrats, Zhijiang! On Tue, 23 Jul 2019 at 15:59, Becket Qin wrote: > Congrats, Zhijiang! > > On Tue, Jul 23, 2019 at 2:01 PM Jark Wu wrote: > > > Congratulations Zhijiang! > > > > > > On Tue, 23 Jul 2019 at 11:30, vino yang wrote: > > > > > Congratulations Zhijiang! > > > > > > Haibo Sun 于20

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Zili Chen
Congratulations Kurt! Best, tison. JingsongLee 于2019年7月23日周二 下午5:29写道: > Congratulations Kurt! > > Best, Jingsong Lee > > > -- > From:Robert Metzger > Send Time:2019年7月23日(星期二) 17:24 > To:dev > Subject:[ANNOUNCE] Kete Young is n

Re: [DISCUSS] Support temporary tables in SQL API

2019-07-23 Thread JingsongLee
Thanks Dawid and other people. +1 for using option #3 for 1.9.0 and go with option #1 in 1.10.0. Regarding Xuefu's concern, I don't know how necessary it is for each catalog to deal with tmpView. I think Catalog is different from DB, we can have single concept for tmpView, that make user easier

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread wenlong.lwl
Congratulations Kurt! On Tue, 23 Jul 2019 at 17:24, Robert Metzger wrote: > Hi all, > > On behalf of the Flink PMC, I'm happy to announce that Kete Young is now > part of the Apache Flink Project Management Committee (PMC). > > Kete has been a committer since February 2017, working a lot on Tabl

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Dian Fu
Congrats, Kurt! > 在 2019年7月23日,下午5:33,Zili Chen 写道: > > Congratulations Kurt! > > Best, > tison. > > > JingsongLee 于2019年7月23日周二 下午5:29写道: > >> Congratulations Kurt! >> >> Best, Jingsong Lee >> >> >> -- >> From:Robert Metzge

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Congxian Qiu
Congratulations Kurt! Best, Congxian Dian Fu 于2019年7月23日周二 下午5:36写道: > Congrats, Kurt! > > > 在 2019年7月23日,下午5:33,Zili Chen 写道: > > > > Congratulations Kurt! > > > > Best, > > tison. > > > > > > JingsongLee 于2019年7月23日周二 下午5:29写道: > > > >> Congratulations Kurt! > >> > >> Best, Jingsong Lee > >

[jira] [Created] (FLINK-13382) Port DecimalITCase to unit tests

2019-07-23 Thread Jark Wu (JIRA)
Jark Wu created FLINK-13382: --- Summary: Port DecimalITCase to unit tests Key: FLINK-13382 URL: https://issues.apache.org/jira/browse/FLINK-13382 Project: Flink Issue Type: Sub-task Compone

Re: [DISCUSS] Support temporary tables in SQL API

2019-07-23 Thread JingsongLee
And I think we should recommend user to use catalog api to createTable and createFunction,(I guess most scenarios do not use temporary objects) in this way, it is good to option #3 Best, JingsongLee -- From:JingsongLee Send Time:

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread LakeShen
Congratulations Kurt! Congxian Qiu 于2019年7月23日周二 下午5:37写道: > Congratulations Kurt! > Best, > Congxian > > > Dian Fu 于2019年7月23日周二 下午5:36写道: > > > Congrats, Kurt! > > > > > 在 2019年7月23日,下午5:33,Zili Chen 写道: > > > > > > Congratulations Kurt! > > > > > > Best, > > > tison. > > > > > > > > > Jings

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Jark Wu
Congratulations Kurt! Well deserved. Cheers, Jark On Tue, 23 Jul 2019 at 17:43, LakeShen wrote: > Congratulations Kurt! > > Congxian Qiu 于2019年7月23日周二 下午5:37写道: > > > Congratulations Kurt! > > Best, > > Congxian > > > > > > Dian Fu 于2019年7月23日周二 下午5:36写道: > > > > > Congrats, Kurt! > > > > > >

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Xu Forward
Congratulations Kurt! best forward Jark Wu 于2019年7月23日周二 下午5:49写道: > Congratulations Kurt! Well deserved. > > Cheers, > Jark > > On Tue, 23 Jul 2019 at 17:43, LakeShen wrote: > > > Congratulations Kurt! > > > > Congxian Qiu 于2019年7月23日周二 下午5:37写道: > > > > > Congratulations Kurt! > > > Best,

Re: Will StreamingFileSink.forBulkFormat(...) support overriding OnCheckpointRollingPolicy?

2019-07-23 Thread Till Rohrmann
Hi, as the documentation for the StreamingFileSink indicates [1], it is required to enable checkpoints if you want to use bulk encoded output formats atm. I'm not sure whether there are concrete plans to change this behaviour in the future because it breaks with exactly once processing guarantees

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Yun Tang
Congratulations Kurt, Well deserved. Best From: Xu Forward Sent: Tuesday, July 23, 2019 17:53 To: dev Subject: Re: [ANNOUNCE] Kete Young is now part of the Flink PMC Congratulations Kurt! best forward Jark Wu 于2019年7月23日周二 下午5:49写道: > Congratulations Kurt!

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Danny Chan
Congratulations Kurt, Well deserved. Best, Danny Chan 在 2019年7月23日 +0800 PM5:24,dev@flink.apache.org,写道: > > Congratulations Kurt, Well deserved.

Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread Danny Chan
Congratulations Zhijiang! Best, Danny Chan 在 2019年7月22日 +0800 PM10:12,dev@flink.apache.org,写道: > > Congratulations Zhijiang!

Re: contributor permission application

2019-07-23 Thread zhang yue
No one responded to me,What else do I need to do? > 在 2019年7月17日,下午12:16,zhang yue 写道: > > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is mooonzhang.

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Biao Liu
Congrats Kurt! Well deserved! Danny Chan 于2019年7月23日周二 下午6:01写道: > Congratulations Kurt, Well deserved. > > Best, > Danny Chan > 在 2019年7月23日 +0800 PM5:24,dev@flink.apache.org,写道: > > > > Congratulations Kurt, Well deserved. >

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Terry Wang
Congrats Kurt! Well deserved! > 在 2019年7月23日,下午6:07,Biao Liu 写道: > > Congrats Kurt! > Well deserved! > > Danny Chan 于2019年7月23日周二 下午6:01写道: > >> Congratulations Kurt, Well deserved. >> >> Best, >> Danny Chan >> 在 2019年7月23日 +0800 PM5:24,dev@flink.apache.org,写道: >>> >>> Congratulations Kurt,

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Jeff Zhang
Congratulations Kurt Biao Liu 于2019年7月23日周二 下午6:07写道: > Congrats Kurt! > Well deserved! > > Danny Chan 于2019年7月23日周二 下午6:01写道: > > > Congratulations Kurt, Well deserved. > > > > Best, > > Danny Chan > > 在 2019年7月23日 +0800 PM5:24,dev@flink.apache.org,写道: > > > > > > Congratulations Kurt, Well de

Re: contributor permission application

2019-07-23 Thread highfei2011
Hi zhang yue, The new JIRA workflow is in effect, and contributors don't have to go to dev to apply for contributor permissions. If you are interested in JIRA, you can reply directly to JIRA (of course, for complex issues, also to clarify the implementation). Then there will be a committer/pm

Re: Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread JingsongLee
Congratulations Zhijiang! Best, Jingsong Lee -- From:wenlong.lwl Send Time:2019年7月23日(星期二) 17:34 To:dev Subject:Re: Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project Congrats, Zhijiang! On Tue, 23

Re: contributor permission application

2019-07-23 Thread Danny Chan
Hi, zhang yue There is no need to apply permission for JIRA issues now, you can left your message under the JIRA issues you are interested in, the committers would assign it to you if they saw your message. Best, Danny Chan 在 2019年7月23日 +0800 PM6:06,zhang yue ,写道: > No one responded to me,What

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Yun Gao
Congratulations Kurt! best, Yun -- From:Jeff Zhang Send Time:2019 Jul. 23 (Tue.) 18:14 To:dev Subject:Re: [ANNOUNCE] Kete Young is now part of the Flink PMC Congratulations Kurt Biao Liu 于2019年7月23日周二 下午6:07写道: > Congrats Kurt

[jira] [Created] (FLINK-13383) Customize the problem in the trigger

2019-07-23 Thread jinguishi (JIRA)
jinguishi created FLINK-13383: - Summary: Customize the problem in the trigger Key: FLINK-13383 URL: https://issues.apache.org/jira/browse/FLINK-13383 Project: Flink Issue Type: Bug Comp

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-23 Thread Jark Wu
Thank you all for your positive feedback. We have three binding +1s, so I think, we can proceed with this. Hi @Robert Metzger , could you create a request to INFRA for the mailing list? I'm not sure if this needs a PMC permission. Thanks, Jark On Tue, 23 Jul 2019 at 16:42, jincheng sun wrote:

Re: Will StreamingFileSink.forBulkFormat(...) support overriding OnCheckpointRollingPolicy?

2019-07-23 Thread Kostas Kloudas
Hi Elkhan, As Till pointed out, the fact that your files remain in-progress is the expected behaviour as the StreamingFileSink assumes checkpointing is enabled in order to work. There are no plans to change this behaviour but an issue that may be relevant for you is https://issues.apache.org/jira/

Use sql to access the flink state

2019-07-23 Thread zhang yue
Does flink have a plan to support sql to access flink state

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread aihua li
Congratulations Kurt, Well deserved. > 在 2019年7月23日,下午5:24,Robert Metzger 写道: > > Hi all, > > On behalf of the Flink PMC, I'm happy to announce that Kete Young is now > part of the Apache Flink Project Management Committee (PMC). > > Kete has been a committer since February 2017, working a lot

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Xintong Song
Congratulations, Kurt~! Thank you~ Xintong Song On Tue, Jul 23, 2019 at 6:55 PM aihua li wrote: > Congratulations Kurt, Well deserved. > > > 在 2019年7月23日,下午5:24,Robert Metzger 写道: > > > > Hi all, > > > > On behalf of the Flink PMC, I'm happy to announce that Kete Young is now > > part of th

Re:[ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Haibo Sun
Congrats Kurt! Best, Haibo At 2019-07-23 17:24:18, "Robert Metzger" wrote: >Hi all, > >On behalf of the Flink PMC, I'm happy to announce that Kete Young is now >part of the Apache Flink Project Management Committee (PMC). > >Kete has been a committer since February 2017, working a lot on Table A

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Bo WANG
Congratulations Kurt! Best, Bo WANG On Tue, Jul 23, 2019 at 5:24 PM Robert Metzger wrote: > Hi all, > > On behalf of the Flink PMC, I'm happy to announce that Kete Young is now > part of the Apache Flink Project Management Committee (PMC). > > Kete has been a committer since February 2017, w

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Guowei Ma
Congratulations Kurt! 发自我的 iPhone > 在 2019年7月23日,下午7:13,Bo WANG 写道: > > Congratulations Kurt! > > > Best, > > Bo WANG > > >> On Tue, Jul 23, 2019 at 5:24 PM Robert Metzger wrote: >> >> Hi all, >> >> On behalf of the Flink PMC, I'm happy to announce that Kete Young is now >> part of the

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread vino yang
Congratulations Kurt! Bo WANG 于2019年7月23日周二 下午7:13写道: > Congratulations Kurt! > > > Best, > > Bo WANG > > > On Tue, Jul 23, 2019 at 5:24 PM Robert Metzger > wrote: > > > Hi all, > > > > On behalf of the Flink PMC, I'm happy to announce that Kete Young is now > > part of the Apache Flink Project

Re: Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread Hequn Cheng
Congratulations Zhijiang! Best, Hequn On Tue, Jul 23, 2019 at 6:17 PM JingsongLee wrote: > Congratulations Zhijiang! > > Best, Jingsong Lee > > > -- > From:wenlong.lwl > Send Time:2019年7月23日(星期二) 17:34 > To:dev > Subject:Re: Re:

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Hequn Cheng
Congratulations Kurt! Best, Hequn On Tue, Jul 23, 2019 at 7:27 PM vino yang wrote: > Congratulations Kurt! > > Bo WANG 于2019年7月23日周二 下午7:13写道: > > > Congratulations Kurt! > > > > > > Best, > > > > Bo WANG > > > > > > On Tue, Jul 23, 2019 at 5:24 PM Robert Metzger > > wrote: > > > > > Hi all,

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-23 Thread Hequn Cheng
Hi Jark, Good idea. +1! On Tue, Jul 23, 2019 at 6:23 PM Jark Wu wrote: > Thank you all for your positive feedback. > > We have three binding +1s, so I think, we can proceed with this. > > Hi @Robert Metzger , could you create a request to > INFRA for the mailing list? > I'm not sure if this ne

[jira] [Created] (FLINK-13384) The backpressure monitoring tab in WebUI does not show correct results

2019-07-23 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-13384: Summary: The backpressure monitoring tab in WebUI does not show correct results Key: FLINK-13384 URL: https://issues.apache.org/jira/browse/FLINK-13384 Projec

Re: [DISCUSS] Support temporary tables in SQL API

2019-07-23 Thread Dawid Wysakowicz
I think we all agree so far that we should implement one of the short term solutions for 1.9 release (#2 or #3) and continue the discussion on option #1 for the next release. Personally I prefer option #2, because it is closest to the current behavior and as Kurt said it is the most intuitive one,

Re: Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread Andrey Zagrebin
Congratulations Zhijiang! Good work! Best, Andrey On Tue, Jul 23, 2019 at 1:40 PM Hequn Cheng wrote: > Congratulations Zhijiang! > > Best, Hequn > > On Tue, Jul 23, 2019 at 6:17 PM JingsongLee .invalid> > wrote: > > > Congratulations Zhijiang! > > > > Best, Jingsong Lee > > > > > > ---

Re: YARN parallelism vs Config

2019-07-23 Thread Till Rohrmann
Hi Dominik, the yarn-properties-USER file is mainly a legacy artifact which served the following purpose: Back in the days when starting a Yarn session cluster, one needed to specify the number of task managers with which to start the cluster. This number could not be changed. If now a user wanted

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Dawid Wysakowicz
Congratulations! Best, Dawid On 23/07/2019 13:39, Hequn Cheng wrote: > Congratulations Kurt! > > Best, Hequn > > On Tue, Jul 23, 2019 at 7:27 PM vino yang wrote: > >> Congratulations Kurt! >> >> Bo WANG 于2019年7月23日周二 下午7:13写道: >> >>> Congratulations Kurt! >>> >>> >>> Best, >>> >>> Bo WANG >>>

Re: Looking for reviewer: FLINK-13127

2019-07-23 Thread Till Rohrmann
I've assigned the issue to you David. I think this feature makes sense. The only question I have is why we need to sort the values. But let's discuss the issue on the Github PR. @Tison and @Xintong, let me know once the PR is in mergeable state. Cheers, Till On Tue, Jul 23, 2019 at 4:14 AM Xinto

Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread Dawid Wysakowicz
Congratulations! Best, Dawid On 23/07/2019 12:03, Danny Chan wrote: > Congratulations Zhijiang! > > Best, > Danny Chan > 在 2019年7月22日 +0800 PM10:12,dev@flink.apache.org,写道: >> Congratulations Zhijiang! signature.asc Description: OpenPGP digital signature

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Till Rohrmann
Congrats Kurt! Cheers, Till On Tue, Jul 23, 2019 at 3:00 PM Dawid Wysakowicz wrote: > Congratulations! > > Best, > > Dawid > > On 23/07/2019 13:39, Hequn Cheng wrote: > > Congratulations Kurt! > > > > Best, Hequn > > > > On Tue, Jul 23, 2019 at 7:27 PM vino yang wrote: > > > >> Congratulations

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-23 Thread Till Rohrmann
Good idea Jark. +1 for the proposal. Cheers, Till On Tue, Jul 23, 2019 at 1:59 PM Hequn Cheng wrote: > Hi Jark, > > Good idea. +1! > > On Tue, Jul 23, 2019 at 6:23 PM Jark Wu wrote: > > > Thank you all for your positive feedback. > > > > We have three binding +1s, so I think, we can proceed wi

Re: [DISSCUSS] Tolerate temporarily suspended ZooKeeper connections

2019-07-23 Thread Till Rohrmann
Hi Lamber-Ken, thanks for starting this discussion. I think there is benefit of not directly losing leadership if the ZooKeeper connection goes into the SUSPENDED state. In particular if we can guarantee that there is only a single JobMaster, it might make sense to not overly eagerly give up leade

?????? [DISSCUSS] Tolerate temporarily suspended ZooKeeper connections

2019-07-23 Thread ????????
Ok, If you have any suggestions, we can talk aobut the details under FLINK-10052. Best. -- -- ??: "Till Rohrmann"; : 2019??7??23??(??) 9:19 ??: "dev"; : Re: [DISSCUSS] Tolerate temporarily suspended ZooKeeper connections

Re: [Requirement] CI report

2019-07-23 Thread Andrey Zagrebin
Hi, @Tison I guess it was done because there were many associated comments notified by everyone involved in PR. I agree that it would be actually useful for a PR's author to get notifications about failed/succeeded CI builds, not sure how easy it is though. Best, Andrey On Tue, Jul 23, 2019 at

Re: instable checkpointing after migration to flink 1.8

2019-07-23 Thread Fabian Hueske
Hi Bekir, Another user reported checkpointing issues with Flink 1.8.0 [1]. These seem to be resolved with Flink 1.8.1. Hope this helps, Fabian [1] https://lists.apache.org/thread.html/991fe3b09fd6a052ff52e5f7d9cdd9418545e68b02e23493097d9bc4@%3Cuser.flink.apache.org%3E Am Mi., 17. Juli 2019 um 0

[jira] [Created] (FLINK-13385) Align Hive data type mapping with FLIP-37

2019-07-23 Thread Timo Walther (JIRA)
Timo Walther created FLINK-13385: Summary: Align Hive data type mapping with FLIP-37 Key: FLINK-13385 URL: https://issues.apache.org/jira/browse/FLINK-13385 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-13386) Friction in the new default API

2019-07-23 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-13386: Summary: Friction in the new default API Key: FLINK-13386 URL: https://issues.apache.org/jira/browse/FLINK-13386 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-13387) Can not download taskmanger & jobmanager's logs in the old UI

2019-07-23 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-13387: Summary: Can not download taskmanger & jobmanager's logs in the old UI Key: FLINK-13387 URL: https://issues.apache.org/jira/browse/FLINK-13387 Project: Flink

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread zhijiang
Congrats Kurt! Best, Zhijiang -- From:Till Rohrmann Send Time:2019年7月23日(星期二) 21:08 To:dev Subject:Re: [ANNOUNCE] Kete Young is now part of the Flink PMC Congrats Kurt! Cheers, Till On Tue, Jul 23, 2019 at 3:00 PM Dawid Wysakowic

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Rong Rong
Congratulations Kurt!! -- Rong On Tue, Jul 23, 2019 at 7:31 AM zhijiang wrote: > Congrats Kurt! > > Best, > Zhijiang > -- > From:Till Rohrmann > Send Time:2019年7月23日(星期二) 21:08 > To:dev > Subject:Re: [ANNOUNCE] Kete Young is now

[jira] [Created] (FLINK-13388) Update UI screenshots in the documentation to the new default UI

2019-07-23 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-13388: Summary: Update UI screenshots in the documentation to the new default UI Key: FLINK-13388 URL: https://issues.apache.org/jira/browse/FLINK-13388 Project: Fli

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-23 Thread Hugo Louro
+1 > On Jul 23, 2019, at 6:15 AM, Till Rohrmann wrote: > > Good idea Jark. +1 for the proposal. > > Cheers, > Till > >> On Tue, Jul 23, 2019 at 1:59 PM Hequn Cheng wrote: >> >> Hi Jark, >> >> Good idea. +1! >> >>> On Tue, Jul 23, 2019 at 6:23 PM Jark Wu wrote: >>> >>> Thank you all for y

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Fabian Hueske
Congrats Kurt! Cheers, Fabian Am Di., 23. Juli 2019 um 16:42 Uhr schrieb Rong Rong : > Congratulations Kurt!! > > -- > Rong > > On Tue, Jul 23, 2019 at 7:31 AM zhijiang .invalid> > wrote: > > > Congrats Kurt! > > > > Best, > > Zhijiang > > ---

Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread zhijiang
Thanks everyone! This is definitely a honor for me. It is very pleasant to work with you guys and I would try my best to contribute to the community future. Best, Zhijiang -- From:Dawid Wysakowicz Send Time:2019年7月23日(星期二) 21:01 T

[jira] [Created] (FLINK-13389) Setting DataStream return type breaks some type conversion between Table and DataStream

2019-07-23 Thread Rong Rong (JIRA)
Rong Rong created FLINK-13389: - Summary: Setting DataStream return type breaks some type conversion between Table and DataStream Key: FLINK-13389 URL: https://issues.apache.org/jira/browse/FLINK-13389 Pro

Re: Timestamp(timezone) conversion bug in non blink Table/SQL runtime

2019-07-23 Thread Rong Rong
Hi Shuyi, I think there were some discussions in the mailing list [1,2] and JIRA tickets [3,4] that might be related. Since the table-blink planner doesn't produce such error, I think this problem is valid and should be fixed. Thanks, Rong [1] http://apache-flink-user-mailing-list-archive.233605

Re: [DISCUSS] Publish the PyFlink into PyPI

2019-07-23 Thread Stephan Ewen
Hi! Sorry for the late involvement. Here are some thoughts from my side: Definitely +1 to publishing to PyPy, even if it is a binary release. Community growth into other communities is great, and if this is the natural way to reach developers in the Python community, let's do it. This is not abou

Re: [DISCUSS] Flink client api enhancement for downstream project

2019-07-23 Thread Stephan Ewen
Hi all! This thread has stalled for a bit, which I assume ist mostly due to the Flink 1.9 feature freeze and release testing effort. I personally still recognize this issue as one important to be solved. I'd be happy to help resume this discussion soon (after the 1.9 release) and see if we can do

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Xuefu Z
Congratulations, Kurt! On Tue, Jul 23, 2019 at 7:48 AM Fabian Hueske wrote: > Congrats Kurt! > > Cheers, Fabian > > Am Di., 23. Juli 2019 um 16:42 Uhr schrieb Rong Rong >: > > > Congratulations Kurt!! > > > > -- > > Rong > > > > On Tue, Jul 23, 2019 at 7:31 AM zhijiang > .invalid> > > wrote: >

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-07-23 Thread Stephan Ewen
@hugo For your suggestions, I would ask to start a separate discussion thread. I think this mail thread has converged towards merging the initial suggestion as a starting point and refining it later based on new discussions. Best, Stephan On Thu, Jun 27, 2019 at 10:48 PM Hugo Louro wrote: > +1

[jira] [Created] (FLINK-13390) Clarify the exact meaning of state size when executing incremental checkpoint

2019-07-23 Thread Yun Tang (JIRA)
Yun Tang created FLINK-13390: Summary: Clarify the exact meaning of state size when executing incremental checkpoint Key: FLINK-13390 URL: https://issues.apache.org/jira/browse/FLINK-13390 Project: Flink

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-07-23 Thread Hugo Louro
Sounds good @stephan! Thanks. On Tue, Jul 23, 2019 at 10:15 AM Stephan Ewen wrote: > @hugo For your suggestions, I would ask to start a separate discussion > thread. > I think this mail thread has converged towards merging the initial > suggestion as a starting point and refining it later based

Probing of simple repartition hash join

2019-07-23 Thread Benjamin Burkhardt
Hi all, Let’s imagine a simple repartition hash Join oft two tables. As soon as the first table is hashed completely (all EndOfPartition Events sent) the shipping and probing of the second table starts. What I can’t find: 1. What triggers to start the probing exactly? 2. Where can I find it in

Re: [DISCUSS] Allow at-most-once delivery in case of failures

2019-07-23 Thread Stephan Ewen
Hi all! This is an interesting discussion for sure. Concerning user requests for changes modes, I also hear the following quite often: - reduce the expensiveness of checkpoint alignment (unaligned checkpoints) to make checkpoints fast/stable under high backpressure - more fine-grained failove

Re: [DISCUSS] Support temporary tables in SQL API

2019-07-23 Thread Xuefu Z
I favored #3 if that wasn't obvious. Usability issue with #2 makes Hive too hard to use. #3 keeps the old behavior for existing users who don't have Hive and thus there is only one, in-memory catalog. If a user does register Hive, he/she understands that there are multiple catalogs and that fully

Re: [DISCUSS] Flink client api enhancement for downstream project

2019-07-23 Thread Zili Chen
Hi Stephan, Thanks for waking up this thread. Jeff and I had a discussion yesterday sharing our respective observations and ideas of client api enhancements. We are glad to make some progress in Flink 1.10. It's really nice to hear that you're gonna participate this thread soon. In ML threads we

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Becket Qin
Congrats, Kurt. Well deserved! Jiangjie (Becket) Qin On Wed, Jul 24, 2019 at 1:11 AM Xuefu Z wrote: > Congratulations, Kurt! > > On Tue, Jul 23, 2019 at 7:48 AM Fabian Hueske wrote: > > > Congrats Kurt! > > > > Cheers, Fabian > > > > Am Di., 23. Juli 2019 um 16:42 Uhr schrieb Rong Rong < > wal

Re: [DISCUSS] Flink client api enhancement for downstream project

2019-07-23 Thread Jeff Zhang
Thanks Stephan, I will follow up this issue in next few weeks, and will refine the design doc. We could discuss more details after 1.9 release. Stephan Ewen 于2019年7月24日周三 上午12:58写道: > Hi all! > > This thread has stalled for a bit, which I assume ist mostly due to the > Flink 1.9 feature freeze a

[jira] [Created] (FLINK-13391) Blink-planner should not invoke deprecated getReturnType

2019-07-23 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-13391: Summary: Blink-planner should not invoke deprecated getReturnType Key: FLINK-13391 URL: https://issues.apache.org/jira/browse/FLINK-13391 Project: Flink Issu

Re: [DISCUSS] Allow at-most-once delivery in case of failures

2019-07-23 Thread SHI Xiaogang
Hi Stephan, I agree with you that the implementation of "at-most-once" or "best-effort" recovery will benefit from pluggable shuffle service and pluggable scheduler. Actually we made some attempts in our private repository and it turns out that it requires quite a lot of work to implement this w

[jira] [Created] (FLINK-13392) WindowAggregate inherited from Aggregate incorrectly

2019-07-23 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-13392: --- Summary: WindowAggregate inherited from Aggregate incorrectly Key: FLINK-13392 URL: https://issues.apache.org/jira/browse/FLINK-13392 Project: Flink Issue Type

Re: [DISCUSS] Publish the PyFlink into PyPI

2019-07-23 Thread Jeff Zhang
+1 for publishing pyflink to pypi. Regarding including jar, I just want to make sure which flink binary distribution we would ship with pyflink since we have multiple flink binary distributions (w/o hadoop). Personally, I prefer to use the hadoop-included binary distribution. And I just want to c

Re: Probing of simple repartition hash join

2019-07-23 Thread Caizhi Weng
Hi Benjamin, As you mentioned hash join I assume that you are referring to `HashJoinOperator` in blink planner. The input is selected by `nextSelection` method. As you can see, it will first read all records in the build side then read all records in the probe side. So the probing will only start

Re: [DISCUSS] Flink project bylaws

2019-07-23 Thread Becket Qin
Hi folks, Thanks for all the feedback. It seems that there are a few concerns over the emeritus status after 6 months of inactivity. Given that the main purpose is just to make sure 2/3 majority can pass and we sort of have a solution for that, I just updated the draft with the following changes:

Re: [DISCUSS] Allow at-most-once delivery in case of failures

2019-07-23 Thread Biao Liu
Hi Stephan & Xiaogang, It's great to see this discussion active again! It makes sense to me that doing some private optimization and trial through plugin. I understand that the community could not satisfy every one and every requirement due to limited resources. The pluggable strategy is a good w

Re: flink-mapr-fs failed in travis

2019-07-23 Thread JingsongLee
Hi @chesnay : Thanks for fix on travis, Do you have any idea about why we build failed in local? It looks like it's been compiled all the time. (It should have nothing to do with your previous changes) Caused by: org.eclipse.aether.transfer.ArtifactTransferException: Could not transfer artifac

Re: flink-mapr-fs failed in travis

2019-07-23 Thread JingsongLee
Sorry, "It looks like it's been compiled all the time." should be: "It looks like it can not be compiled all the time in local." Best, Jingsong Lee -- From:JingsongLee Send Time:2019年7月24日(星期三) 10:54 To:Jark Wu ; dev ; chesnay

[jira] [Created] (FLINK-13393) Blink-planner not support generic TableSource

2019-07-23 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-13393: Summary: Blink-planner not support generic TableSource Key: FLINK-13393 URL: https://issues.apache.org/jira/browse/FLINK-13393 Project: Flink Issue Type: Sub

Re: [DISCUSS] Publish the PyFlink into PyPI

2019-07-23 Thread Dian Fu
Hi Stephan & Jeff, Thanks a lot for sharing your thoughts! Regarding the bundled jars, currently only the jars in the flink binary distribution is packaged in the pyflink package. That maybe a good idea to also bundle the other jars such as flink-hadoop-compatibility. We may need also consider

[jira] [Created] (FLINK-13394) secure MapR repo URL is not work in E2E crontab builds

2019-07-23 Thread Zhenghua Gao (JIRA)
Zhenghua Gao created FLINK-13394: Summary: secure MapR repo URL is not work in E2E crontab builds Key: FLINK-13394 URL: https://issues.apache.org/jira/browse/FLINK-13394 Project: Flink Issue

[jira] [Created] (FLINK-13395) Add source and sink connector for Aliyun Log Service

2019-07-23 Thread Ke Li (JIRA)
Ke Li created FLINK-13395: - Summary: Add source and sink connector for Aliyun Log Service Key: FLINK-13395 URL: https://issues.apache.org/jira/browse/FLINK-13395 Project: Flink Issue Type: New Featur

Apply for confluence Wiki create and edit permission

2019-07-23 Thread Xuannan Su
Hi, I’d like to make a FLIP of the pluggable intermediate result storage, phase 2 of FLIP-36[1]. Could you please give me the create and edit permission for this page[2]. My Id: Xuannan Su Best, Xuannan [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-36%3A+Support+Interactive+Pro

  1   2   >