[jira] [Created] (FLINK-14446) Design a Java end to end test framework for supporting more external system

2019-10-17 Thread Zheng Hu (Jira)
Zheng Hu created FLINK-14446: Summary: Design a Java end to end test framework for supporting more external system Key: FLINK-14446 URL: https://issues.apache.org/jira/browse/FLINK-14446 Project: Flink

Re: [DISCUSS] What do we gain by supporting customized High-Availability services

2019-10-17 Thread Zili Chen
Another perspective is that a stable, carefully-designed interface with clear semantic could be safer to customize. Following the discussion in FLINK-10333 our JobGraphStore is actually required performing write operation only with leadership, which is a basic requirement for coordination rather

Re: [DISCUSS] FLIP-65: New type inference for Table API UDFs

2019-10-17 Thread Hequn Cheng
+1 to start a vote. Good to see that it is backward compatibility, as python UDFs will also be affected. BTW, do we target this Flip to release-1.10? Best, Hequn On Wed, Oct 16, 2019 at 6:19 PM Timo Walther wrote: > Hi everyone, > > thanks for the comments in the doc. The feedback so far was

[jira] [Created] (FLINK-14445) Python module build failed when making sdist

2019-10-17 Thread Yun Tang (Jira)
Yun Tang created FLINK-14445: Summary: Python module build failed when making sdist Key: FLINK-14445 URL: https://issues.apache.org/jira/browse/FLINK-14445 Project: Flink Issue Type: Bug

Re: [NOTICE] Binary licensing is now auto-generated

2019-10-17 Thread vino yang
Thanks Chesnay! Great job! Best, Vino Jark Wu 于2019年10月18日周五 上午9:51写道: > Thanks Chesnay! This is really a great job! > > Best, > Jark > > > 在 2019年10月17日,22:03,未来阳光 <2217232...@qq.com> 写道: > > > > Thanks for this improvement Chesnay ! > > > > > > > > > > ---Original--- > > From: "Chesnay Schepl

Re: [NOTICE] Binary licensing is now auto-generated

2019-10-17 Thread Hequn Cheng
Cool! Thanks a lot for the improvement, Chesnay! On Fri, Oct 18, 2019 at 9:51 AM Jark Wu wrote: > Thanks Chesnay! This is really a great job! > > Best, > Jark > > > 在 2019年10月17日,22:03,未来阳光 <2217232...@qq.com> 写道: > > > > Thanks for this improvement Chesnay ! > > > > > > > > > > ---Original--- >

Re: [NOTICE] Binary licensing is now auto-generated

2019-10-17 Thread Jark Wu
Thanks Chesnay! This is really a great job! Best, Jark > 在 2019年10月17日,22:03,未来阳光 <2217232...@qq.com> 写道: > > Thanks for this improvement Chesnay ! > > > > > ---Original--- > From: "Chesnay Schepler" Date: Thu, Oct 17, 2019 21:37 PM > To: "dev@flink.apache.org" Subject: [NOTICE] Binary licen

[jira] [Created] (FLINK-14444) Publish BOMs for Flink

2019-10-17 Thread Michael Holler (Jira)
Michael Holler created FLINK-1: -- Summary: Publish BOMs for Flink Key: FLINK-1 URL: https://issues.apache.org/jira/browse/FLINK-1 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-14443) Enable checkpointing for JDBC sink/output

2019-10-17 Thread None none (Jira)
None none created FLINK-14443: - Summary: Enable checkpointing for JDBC sink/output Key: FLINK-14443 URL: https://issues.apache.org/jira/browse/FLINK-14443 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-14442) Add time based interval execution to JDBC connectors.

2019-10-17 Thread None none (Jira)
None none created FLINK-14442: - Summary: Add time based interval execution to JDBC connectors. Key: FLINK-14442 URL: https://issues.apache.org/jira/browse/FLINK-14442 Project: Flink Issue Type: I

Re: [DISCUSS] FLIP-72: Introduce Pulsar Connector

2019-10-17 Thread Rong Rong
Hi Yijie, I also agree with Jark on separating the Catalog part into another FLIP. With FLIP-27[1] also in the air, it is also probably great to split and unblock the sink implementation contribution. I would suggest either putting in a detail implementation plan section in the doc, or (maybe too

Re: [VOTE] FLIP-68: Extend Core Table System with Pluggable Modules

2019-10-17 Thread Bowen Li
Thanks for pointing them out, Dawid. I've went over the overall doc again and corrected the above typos. - ModuleManager#listFunctions() returns Set - ModuleManager holds a LinkedHashMap to keep loaded modules in order - ModuleFactory#createModule(Map) and returns Module On Thu, Oct 17, 2019 at

Re: [VOTE] Release 1.9.1, release candidate #1

2019-10-17 Thread Till Rohrmann
+1 (binding) - Verified signatures and checksums - Source archive does not contain any new binaries - Successfully built Flink from sources for Hadoop 2.7.5 and Scala 2.12 - Verified that no new dependencies have been added - Verified that the last release-1.9 cron job passed. The cron job being e

[jira] [Created] (FLINK-14441) Fix ValueLiteralExpression#getValueAs when valueClass is Period.class

2019-10-17 Thread hailong wang (Jira)
hailong wang created FLINK-14441: Summary: Fix ValueLiteralExpression#getValueAs when valueClass is Period.class Key: FLINK-14441 URL: https://issues.apache.org/jira/browse/FLINK-14441 Project: Flink

[jira] [Created] (FLINK-14440) Enable BatchFineGrainedRecoveryITCase to pass with scheduler NG

2019-10-17 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14440: --- Summary: Enable BatchFineGrainedRecoveryITCase to pass with scheduler NG Key: FLINK-14440 URL: https://issues.apache.org/jira/browse/FLINK-14440 Project: Flink Issue

[jira] [Created] (FLINK-14439) RestartPipelinedRegionStrategy leverage tracked partition availability for better failover experience in DefaultScheduler

2019-10-17 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14439: --- Summary: RestartPipelinedRegionStrategy leverage tracked partition availability for better failover experience in DefaultScheduler Key: FLINK-14439 URL: https://issues.apache.org/jira/brow

Re: [NOTICE] Binary licensing is now auto-generated

2019-10-17 Thread ????????
Thanks for this improvement Chesnay ! ---Original--- From: "Chesnay Schepler"https://cwiki.apache.org/confluence/display/FLINK/Licensing>; accordingly.

Re: [NOTICE] Binary licensing is now auto-generated

2019-10-17 Thread Zili Chen
Thanks for this improvement Chesnay ;-) Best, tison. Chesnay Schepler 于2019年10月17日周四 下午9:37写道: > Hello, > > I just merged FLINK-14008 to 1.8, 1.9 and 1.10, which means that from > now on the tricky part of the binary licensing (NOTICE-binary, > licenses-binary) is automatically generated durin

[NOTICE] Binary licensing is now auto-generated

2019-10-17 Thread Chesnay Schepler
Hello, I just merged FLINK-14008 to 1.8, 1.9 and 1.10, which means that from now on the tricky part of the binary licensing (NOTICE-binary, licenses-binary) is automatically generated during the release process. As such these files have been removed from the root directory of the project (th

Re: [VOTE] FLINK-67: Cluster partition life-cycle

2019-10-17 Thread Till Rohrmann
Thanks for creating this FLIP and starting the VOTE for it. +1 (binding) Cheers, Till On Thu, Oct 17, 2019 at 5:08 AM Yun Gao wrote: > Hi Chesnay, > > +1 (non-binding). > > Very thanks for driving this. > > Best, > Yun > > >

[jira] [Created] (FLINK-14438) Fix RowTypeInfo.equals()

2019-10-17 Thread Timo Walther (Jira)
Timo Walther created FLINK-14438: Summary: Fix RowTypeInfo.equals() Key: FLINK-14438 URL: https://issues.apache.org/jira/browse/FLINK-14438 Project: Flink Issue Type: Improvement Co

[jira] [Created] (FLINK-14437) Drop the legacy planner

2019-10-17 Thread Timo Walther (Jira)
Timo Walther created FLINK-14437: Summary: Drop the legacy planner Key: FLINK-14437 URL: https://issues.apache.org/jira/browse/FLINK-14437 Project: Flink Issue Type: Sub-task Compon

Re: [DISCUSS] What do we gain by supporting customized High-Availability services

2019-10-17 Thread Zili Chen
A challenge is how we ensure the support for customized implementation. When we introduce JobGraphStore#releaseJobGraph we actually change quite a bit codepath in Dispatcher. While we are unable to test arbitrarily customized implementation our compatibility promise is actually no more than compila

[DISCUSS] What do we gain by supporting customized High-Availability services

2019-10-17 Thread Zili Chen
Hi devs, Recently the community excludes customize support on new restart strategies[1], which reminds me to think of which kind of customized support a framework like Flink should provides. The key idea is pluggable is not customizable. We might handle a series of implementation of restart stra

[jira] [Created] (FLINK-14436) Add getter for ContextEnvironment instance in StreamContextEnvironment

2019-10-17 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-14436: --- Summary: Add getter for ContextEnvironment instance in StreamContextEnvironment Key: FLINK-14436 URL: https://issues.apache.org/jira/browse/FLINK-14436 Project: Flink

[jira] [Created] (FLINK-14435) Add TaskManagerResourceInfo in TaskManagerDetailsInfo to show TaskManager Resource

2019-10-17 Thread lining (Jira)
lining created FLINK-14435: -- Summary: Add TaskManagerResourceInfo in TaskManagerDetailsInfo to show TaskManager Resource Key: FLINK-14435 URL: https://issues.apache.org/jira/browse/FLINK-14435 Project: Flink

[jira] [Created] (FLINK-14434) Dispatcher#createJobManagerRunner should returns on creation succeed, not after startJobManagerRunner

2019-10-17 Thread Zili Chen (Jira)
Zili Chen created FLINK-14434: - Summary: Dispatcher#createJobManagerRunner should returns on creation succeed, not after startJobManagerRunner Key: FLINK-14434 URL: https://issues.apache.org/jira/browse/FLINK-14434

[jira] [Created] (FLINK-14433) Move generated Jaas conf file from /tmp directory to Job specific directory

2019-10-17 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-14433: - Summary: Move generated Jaas conf file from /tmp directory to Job specific directory Key: FLINK-14433 URL: https://issues.apache.org/jira/browse/FLINK-14433

[jira] [Created] (FLINK-14432) Add 'SHOW SYSTEM FUNCTIONS' support in SQL CLI

2019-10-17 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-14432: Summary: Add 'SHOW SYSTEM FUNCTIONS' support in SQL CLI Key: FLINK-14432 URL: https://issues.apache.org/jira/browse/FLINK-14432 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-14431) Update TaskManager's memory information to match its memory composition

2019-10-17 Thread lining (Jira)
lining created FLINK-14431: -- Summary: Update TaskManager's memory information to match its memory composition Key: FLINK-14431 URL: https://issues.apache.org/jira/browse/FLINK-14431 Project: Flink

Re: [VOTE] FLIP-68: Extend Core Table System with Pluggable Modules

2019-10-17 Thread Dawid Wysakowicz
Hi all, Generally I'm fine with the design. Before I cast my +1 I wanted to clarify one thing. Is the module name in ModuleFactory#createModule necessary? Can't it be just?: interface ModuleFactory extends TableFactory {    Module createModule(Map properties); } The name under which the module w

[jira] [Created] (FLINK-14430) BaseArraySerializerTest.testDuplicate fails on travis

2019-10-17 Thread Jark Wu (Jira)
Jark Wu created FLINK-14430: --- Summary: BaseArraySerializerTest.testDuplicate fails on travis Key: FLINK-14430 URL: https://issues.apache.org/jira/browse/FLINK-14430 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-14429) Wrong app final status when running yarn-cluster in non-detached mode

2019-10-17 Thread liupengcheng (Jira)
liupengcheng created FLINK-14429: Summary: Wrong app final status when running yarn-cluster in non-detached mode Key: FLINK-14429 URL: https://issues.apache.org/jira/browse/FLINK-14429 Project: Flink

[jira] [Created] (FLINK-14428) Non-consistency key access in KeyedProcessFunction when use keyed state in both processElement and onTimer method

2019-10-17 Thread vinoyang (Jira)
vinoyang created FLINK-14428: Summary: Non-consistency key access in KeyedProcessFunction when use keyed state in both processElement and onTimer method Key: FLINK-14428 URL: https://issues.apache.org/jira/browse/FLIN

[jira] [Created] (FLINK-14427) 批流融合

2019-10-17 Thread qinkaixin (Jira)
qinkaixin created FLINK-14427: - Summary: 批流融合 Key: FLINK-14427 URL: https://issues.apache.org/jira/browse/FLINK-14427 Project: Flink Issue Type: Improvement Environment: 批流融合

Re: [DISCUSS] FLIP-59: Enable execution configuration from Configuration object

2019-10-17 Thread Timo Walther
Sounds good to me. Thanks, Timo On 17.10.19 09:30, Kostas Kloudas wrote: Hi Timo, I agree that distinguishing between "executor" and "execution" when scanning through a configuration file can be difficult. These names were mainly influenced by the fact that FLIP-73 introduced the "Executor".

Re: [DISCUSS] FLIP-59: Enable execution configuration from Configuration object

2019-10-17 Thread Kostas Kloudas
Hi Timo, I agree that distinguishing between "executor" and "execution" when scanning through a configuration file can be difficult. These names were mainly influenced by the fact that FLIP-73 introduced the "Executor". In addition, I agree that "deployment" or "deploy" sound good alternatives. Be