[jira] [Created] (FLINK-16160) Schema#proctime and Schema#rowtime don't work in TableEnvironment#connect code path

2020-02-19 Thread Zhenghua Gao (Jira)
Zhenghua Gao created FLINK-16160: Summary: Schema#proctime and Schema#rowtime don't work in TableEnvironment#connect code path Key: FLINK-16160 URL: https://issues.apache.org/jira/browse/FLINK-16160 P

Re: Total recovery time estimation after checkpoint recovery

2020-02-19 Thread Till Rohrmann
All right here is the copy: Multiple factors affect the total recovery time. First of all, Flink needs to detect that something went wrong. In the worst case this happens through the missing heartbeat of a died machine. The default heartbeat value is configured to 50s but one can tune it. Next, F

[jira] [Created] (FLINK-16161) Statistics zero should be unknown in HiveCatalog

2020-02-19 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-16161: Summary: Statistics zero should be unknown in HiveCatalog Key: FLINK-16161 URL: https://issues.apache.org/jira/browse/FLINK-16161 Project: Flink Issue Type:

[jira] [Created] (FLINK-16162) Bump flink-shaded to 10.0

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16162: Summary: Bump flink-shaded to 10.0 Key: FLINK-16162 URL: https://issues.apache.org/jira/browse/FLINK-16162 Project: Flink Issue Type: Bug C

[jira] [Created] (FLINK-16163) Migrate to flink-shaded-zookeeper

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16163: Summary: Migrate to flink-shaded-zookeeper Key: FLINK-16163 URL: https://issues.apache.org/jira/browse/FLINK-16163 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16164) Disable maven-site-plugin

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16164: Summary: Disable maven-site-plugin Key: FLINK-16164 URL: https://issues.apache.org/jira/browse/FLINK-16164 Project: Flink Issue Type: Bug

Re: [DISCUSS] Improvements on FLIP Process

2020-02-19 Thread Xintong Song
I'm also not a fun of discussing FLIPs with google docs. I think google docs is probably ok for smaller scope early discussions before raising the discussion on the mailing list, when the draft is not completed and is expected to change frequently. Once it is proposed to the community, as many peo

Re: Hotfixes on the master

2020-02-19 Thread Robert Metzger
Thank you for your response. Your response makes me realize that I should have first asked whether other committers consider the amount of hotfix commits problematic or not. >From the number of responses to my message, I have the feeling that most committers are not concerned. I personally believe

[jira] [Created] (FLINK-16165) NestedLoopJoin fallback to HashJoin when build records number is very large

2020-02-19 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-16165: Summary: NestedLoopJoin fallback to HashJoin when build records number is very large Key: FLINK-16165 URL: https://issues.apache.org/jira/browse/FLINK-16165 Project:

[jira] [Created] (FLINK-16166) Javadoc generation fails on Java 11

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16166: Summary: Javadoc generation fails on Java 11 Key: FLINK-16166 URL: https://issues.apache.org/jira/browse/FLINK-16166 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16167) update python_shell document execution

2020-02-19 Thread yuwenbing (Jira)
yuwenbing created FLINK-16167: - Summary: update python_shell document execution Key: FLINK-16167 URL: https://issues.apache.org/jira/browse/FLINK-16167 Project: Flink Issue Type: Improvement

Re: Hotfixes on the master

2020-02-19 Thread Aljoscha Krettek
Side comment: the problem of not knowing where a commit came from could be fixed by always including merge commits, just saying... ;-) Aljoscha On 19.02.20 11:43, Robert Metzger wrote: Thank you for your response. Your response makes me realize that I should have first asked whether other comm

[jira] [Created] (FLINK-16168) Add build debugging profile

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16168: Summary: Add build debugging profile Key: FLINK-16168 URL: https://issues.apache.org/jira/browse/FLINK-16168 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16169) Harden BlobServerRangeTest

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16169: Summary: Harden BlobServerRangeTest Key: FLINK-16169 URL: https://issues.apache.org/jira/browse/FLINK-16169 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16170) SearchTemplateRequest ClassNotFoundException when use flink-sql-connector-elasticsearch7

2020-02-19 Thread Jark Wu (Jira)
Jark Wu created FLINK-16170: --- Summary: SearchTemplateRequest ClassNotFoundException when use flink-sql-connector-elasticsearch7 Key: FLINK-16170 URL: https://issues.apache.org/jira/browse/FLINK-16170 Projec

Re: Hotfixes on the master

2020-02-19 Thread Piotr Nowojski
Hi, I agree with question posted by Till, what problems are we trying to solve? Regarding merging unreviewed commits, I’m +1 for disallowing those things. Anything that is trivial enough that I would accept as being merged without review, is also trivial enough to review. The additional review

[jira] [Created] (FLINK-16171) Ban unused dependencies

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16171: Summary: Ban unused dependencies Key: FLINK-16171 URL: https://issues.apache.org/jira/browse/FLINK-16171 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16172) Add baseline set of allowed unused dependencies

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16172: Summary: Add baseline set of allowed unused dependencies Key: FLINK-16172 URL: https://issues.apache.org/jira/browse/FLINK-16172 Project: Flink Issue

[jira] [Created] (FLINK-16173) Reduce noise for used undeclared dependencies

2020-02-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16173: Summary: Reduce noise for used undeclared dependencies Key: FLINK-16173 URL: https://issues.apache.org/jira/browse/FLINK-16173 Project: Flink Issue T

[jira] [Created] (FLINK-16174) Add a better tryYield() method to MailboxExecutor to return the lowest priority of the remaining mails

2020-02-19 Thread Haibo Sun (Jira)
Haibo Sun created FLINK-16174: - Summary: Add a better tryYield() method to MailboxExecutor to return the lowest priority of the remaining mails Key: FLINK-16174 URL: https://issues.apache.org/jira/browse/FLINK-16174

Re: [Discuss] Update the pull request description template.

2020-02-19 Thread Till Rohrmann
I actually wanted to second Chesnay but apparently my impression is a bit wrong. Out of the last 10 closed PRs (admittedly a small sample size) only 2 did not fill out the template. I did not check for correctness though. Assuming that people use the template, I believe it is a good idea to update

Re: Hotfixes on the master

2020-02-19 Thread Arvid Heise
Let me be a troll, but couldn't we just disable push to master for committers? That would make smaller backports harder, but it would also eliminate unreviewed commits. And we wouldn't need to draw a line between minor for direct push and bigger changes that need review. On Wed, Feb 19, 2020 at 1

Re: Hotfixes on the master

2020-02-19 Thread Chesnay Schepler
@Arvid Pretty sure that goes against ASF rules. On 19/02/2020 14:26, Arvid Heise wrote: Let me be a troll, but couldn't we just disable push to master for committers? That would make smaller backports harder, but it would also eliminate unreviewed commits. And we wouldn't need to draw a line be

Re: [DISCUSS] AssignerWithPeriodicWatermarks with max delay

2020-02-19 Thread Till Rohrmann
Hi Eduardo, great to hear that you want to contribute to Flink. I'm not too deeply involved in idle watermarks but I know that there is FLIP-27 [1] which has the aim of reworking Flink's source interface. Part of it is to solve the problem of idle watermarks. The idea would be to solve the proble

Re: [VOTE] FLIP-75: Flink Web UI Improvement Proposal

2020-02-19 Thread Till Rohrmann
Thanks for starting this vote Yadong. Should we split the vote thread into multiple vote threads for each FLIP? I fear that having them all in one thread will quickly become confusing. Cheers, Till On Tue, Feb 18, 2020 at 12:27 PM Piotr Nowojski wrote: > Hi, > > +1 (binding) for FLIP-98 > +1 (b

Re: [DISCUSS] Drop connectors for Elasticsearch 2.x and 5.x

2020-02-19 Thread Till Rohrmann
+1 for removing ES2 and updating ES5 in 1.11. +1 for revisiting the removal of ES5 for 1.12. Cheers, Till On Tue, Feb 18, 2020 at 1:28 PM Chesnay Schepler wrote: > Since one of the reasons for dropping ES2 was that it blocks some > critical updates for the ES5 connector I'd prefer to keep ES5

[jira] [Created] (FLINK-16175) Add configOption to set CaseSensitive for SQL

2020-02-19 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-16175: -- Summary: Add configOption to set CaseSensitive for SQL Key: FLINK-16175 URL: https://issues.apache.org/jira/browse/FLINK-16175 Project: Flink Issue Type: Improve

Re: [DISCUSS] Improvements on FLIP Process

2020-02-19 Thread Till Rohrmann
+1 for Aljoscha's proposal. This, of course, does not mean that one cannot use Google docs in order to prepare the FLIP discussion. Cheers, Till On Wed, Feb 19, 2020 at 11:15 AM Xintong Song wrote: > I'm also not a fun of discussing FLIPs with google docs. > > I think google docs is probably o

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

2020-02-19 Thread Till Rohrmann
Thanks for making the release possible Chesnay and everyone who was involved! Cheers, Till On Wed, Feb 19, 2020 at 7:47 AM jincheng sun wrote: > Thanks a lot for the release Chesnay! > And thanks to everyone who make this release possible! > > Best, > Jincheng > > > Chesnay Schepler 于2020年2月19

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-19 Thread Till Rohrmann
Thanks for volunteering as one of our release managers Zhijiang. +1 for the *anticipated feature freeze date* end of April. As we go along and collect more data points we might be able to strengthen our initial anticipation. Cheers, Till On Wed, Feb 19, 2020 at 4:44 AM Zhijiang wrote: > Thanks

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-19 Thread Aljoscha Krettek
+1 Although I would hope that it can be more than just "anticipated". Best, Aljoscha On 19.02.20 15:40, Till Rohrmann wrote: Thanks for volunteering as one of our release managers Zhijiang. +1 for the *anticipated feature freeze date* end of April. As we go along and collect more data points

[jira] [Created] (FLINK-16176) Use AppendingBuffer in HttpFunction

2020-02-19 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16176: Summary: Use AppendingBuffer in HttpFunction Key: FLINK-16176 URL: https://issues.apache.org/jira/browse/FLINK-16176 Project: Flink Issue Type: Task

[DISCUSS] Extend (or maintain) "shell" script support for Windows

2020-02-19 Thread Aljoscha Krettek
Hi, the background is this series of Jira Issues and PRs around extending the .bat scripts for windows: https://issues.apache.org/jira/browse/FLINK-5333. I would like to resolve this, by either closing the Jira Issues as "Won't Do" or finally merging these PRs. The questions I have are: -

[jira] [Created] (FLINK-16177) Integrate Operator Coordinators with Checkpoints

2020-02-19 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-16177: Summary: Integrate Operator Coordinators with Checkpoints Key: FLINK-16177 URL: https://issues.apache.org/jira/browse/FLINK-16177 Project: Flink Issue Type:

[jira] [Created] (FLINK-16178) Prerequisite cleanups and refactorings in the Checkpoint Coordinator

2020-02-19 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-16178: Summary: Prerequisite cleanups and refactorings in the Checkpoint Coordinator Key: FLINK-16178 URL: https://issues.apache.org/jira/browse/FLINK-16178 Project: Flink

Re: [DISCUSS] Extend (or maintain) "shell" script support for Windows

2020-02-19 Thread Chesnay Schepler
Note that with FLINK-15925 we effectively broke the start-cluster.bat script in 1.10. Overall, I would be fine with dropping the .bat scripts because they are a big maintenance problem for us. We don't have anyone using these scripts regularly on our end (even I don't). If there were a way to

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

2020-02-19 Thread Zhijiang
Thanks Chesnay for making the release efficiently and also thanks to all the other participants! Best, Zhijiang -- From:Till Rohrmann Send Time:2020 Feb. 19 (Wed.) 22:21 To:dev Subject:Re: [ANNOUNCE] Apache Flink-shaded 10.0 rel

Re: [VOTE] FLIP-75: Flink Web UI Improvement Proposal

2020-02-19 Thread Zhijiang
+1 for splitting the vote thread as @Till mentioned. I was also wondering whether need to review all the listed FLIPs before voting. If making them separately, then I am very willing to take some interested ones for vote. :) Best, Zhijiang -

Re: [VOTE] FLIP-75: Flink Web UI Improvement Proposal

2020-02-19 Thread Yadong Xie
Hi all Thanks for all the response I will split the vote thread into multiple vote threads for each FLIP later and this vote is cancelled now. Zhijiang 于2020年2月20日 周四00:29写道: > +1 for splitting the vote thread as @Till mentioned. > > I was also wondering whether need to review all the listed FL

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-19 Thread Dian Fu
Thanks Stephan kicking off this discussion and Zhijiang volunteering as one of the release managers. +1 for the "feature freeze date" around end of April. There are still more than 2 months left, so I think it's a reasonable time. Thanks, Dian > 在 2020年2月19日,下午10:52,Aljoscha Krettek 写道: > >

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

2020-02-19 Thread Dian Fu
Thanks Chesnay for the great work and everyone involved! Regards, Dian > 在 2020年2月20日,上午12:21,Zhijiang 写道: > > Thanks Chesnay for making the release efficiently and also thanks to all the > other participants! > > Best, > Zhijiang > > > -

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

2020-02-19 Thread Zhu Zhu
Thanks Chesnay for the great work and everyone who helps with the improvements and release! Thanks, Zhu Zhu Dian Fu 于2020年2月20日周四 上午9:44写道: > Thanks Chesnay for the great work and everyone involved! > > Regards, > Dian > > > 在 2020年2月20日,上午12:21,Zhijiang 写道: > > > > Thanks Chesnay for making t

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-19 Thread tison
Thanks for kicking off the discussion Stephan! +1 for the *anticipated feature freeze date* end of April and Zhijiang & Piotr to be the release managers. Best, tison. Dian Fu 于2020年2月20日周四 上午9:41写道: > Thanks Stephan kicking off this discussion and Zhijiang volunteering as > one of the release

[jira] [Created] (FLINK-16179) Use configuration from TableFactory in hive connector

2020-02-19 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-16179: Summary: Use configuration from TableFactory in hive connector Key: FLINK-16179 URL: https://issues.apache.org/jira/browse/FLINK-16179 Project: Flink Issue T

[jira] [Created] (FLINK-16180) Replacing vertexExecution in ScheduledUnit with executionVertexID

2020-02-19 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-16180: --- Summary: Replacing vertexExecution in ScheduledUnit with executionVertexID Key: FLINK-16180 URL: https://issues.apache.org/jira/browse/FLINK-16180 Project: Flink Issu

Re: [DISCUSS] Extend (or maintain) "shell" script support for Windows

2020-02-19 Thread Yang Wang
I tend to drop the windows bat script to start/stop the cluster. Since there are various windows versions(e.g. xp, win7, win10, etc.) and do not have sensational compatibility. Also we do not have the e2e tests to guarantee the scripts work well. On the other hand, i completely agree that local de

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-19 Thread Yuan Mei
+1 3-month sounds a very reasonable duration for a release. On Thu, Feb 20, 2020 at 9:53 AM tison wrote: > Thanks for kicking off the discussion Stephan! > > +1 for the *anticipated feature freeze date* end of April and > Zhijiang & Piotr to be the release managers. > > Best, > tison. > > > Dia

Re: [Discuss] Update the pull request description template.

2020-02-19 Thread Xintong Song
Thanks for the feedbacks, Chesnay and Till. And thanks for the pointer, Congxian. I don't know how often committers and reviewers checks and benefits from the PR description. From your feedbacks and the number of responses to this discussion, it's probably not often. However, as a contributor and

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-19 Thread Xintong Song
Thanks for the kicking off. +1 for Zhijiang & Piotr (if he agrees to) being the release managers. Thanks for the volunteering. +1 for the *anticipated feature freeze date* end of April Thank you~ Xintong Song On Thu, Feb 20, 2020 at 10:30 AM Yuan Mei wrote: > +1 > > 3-month sounds a very re

Re: [DISCUSS] Extend (or maintain) "shell" script support for Windows

2020-02-19 Thread Xintong Song
I'm also in favor of dropping the bat scripts. I can hardly image people using Flink Windows deployment in their production. But maybe throwing a survey on the user ML to double check on that? Thank you~ Xintong Song On Thu, Feb 20, 2020 at 10:28 AM Yang Wang wrote: > I tend to drop the wind

[jira] [Created] (FLINK-16181) IfCallGen will throw NPE for primitive types in blink

2020-02-19 Thread Benchao Li (Jira)
Benchao Li created FLINK-16181: -- Summary: IfCallGen will throw NPE for primitive types in blink Key: FLINK-16181 URL: https://issues.apache.org/jira/browse/FLINK-16181 Project: Flink Issue Type:

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

2020-02-19 Thread Yu Li
Thanks Chesnay and all participants for making the release possible! Best Regards, Yu On Thu, 20 Feb 2020 at 09:50, Zhu Zhu wrote: > Thanks Chesnay for the great work and everyone who helps with the > improvements and release! > > Thanks, > Zhu Zhu > > Dian Fu 于2020年2月20日周四 上午9:44写道: > > > Th

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-19 Thread Yu Li
Thanks Stephan for the kicking off! And thanks Piotr and Zhijiang for volunteering as the release managers! Aiming for a shorter release cycle than 1.10 makes a lot of sense, and +1 to target the feature freeze date around end of April. Best Regards, Yu On Thu, 20 Feb 2020 at 10:37, Xintong Son