Re: [DISCUSS] Flink Kerberos Improvement

2018-12-17 Thread Shuyi Chen
Hi Rong, thanks a lot for the proposal. Currently, Flink assume the keytab is located in a remote DFS. Pre-installing Keytabs statically in YARN node local filesystem is a common approach, so I think we should support this mode in Flink natively. As an optimazation to reduce the KDC access frequenc

Re: [VOTE] Release 1.7.1, release candidate #2

2018-12-17 Thread jincheng sun
Hi Chesnay, +1(non-binding) - run `mvn clean install` locally with success - run all TestCases(both java and scala), except NettyEpollITCase in the flink-test module in IDEA locally with success (errors has checked in FLINK-11178) hequn Chen, tison and myself had check the test case error in

[VOTE] Release 1.5.6, release candidate #1

2018-12-17 Thread Thomas Weise
Hi everyone, Please review and vote on the release candidate #1 for the version 1.5.6, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], * t

Re: [DISCUSS] Flink SQL DDL Design

2018-12-17 Thread Jark Wu
Hi Timo, I think I get your point why it would be better to put Table Update Mode in MVP. But because this is a sophisticated problem, we need to think about it carefully and need some discussions offline. We will reach out to here when we have a clear design. 8). Support row/map/array data type

[jira] [Created] (FLINK-11188) Bounded over should not enable state retention time

2018-12-17 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-11188: --- Summary: Bounded over should not enable state retention time Key: FLINK-11188 URL: https://issues.apache.org/jira/browse/FLINK-11188 Project: Flink Issue Type

[DISCUSS] Flink Kerberos Improvement

2018-12-17 Thread Rong Rong
Hi All, We have been experimenting integration of Kerberos with Flink in our Corp environment and found out some limitations on the current Flink-Kerberos security mechanism running with Apache YARN. Based on the Hadoop Kerberos security guide [1]. Apparently there are only a subset of the sugges

Re: StreamingFileSink causing AmazonS3Exception

2018-12-17 Thread Addison Higham
Issue opened here: https://issues.apache.org/jira/browse/FLINK-11187 On Mon, Dec 17, 2018 at 2:37 PM Addison Higham wrote: > Oh this is timely! > > I hope I can save you some pain Kostas! (cc-ing to flink dev to get > feedback there for what I believe to be a confirmed bug) > > > I was just abou

[jira] [Created] (FLINK-11187) StreamingFileSink with S3 backend transient socket timeout issues

2018-12-17 Thread Addison Higham (JIRA)
Addison Higham created FLINK-11187: -- Summary: StreamingFileSink with S3 backend transient socket timeout issues Key: FLINK-11187 URL: https://issues.apache.org/jira/browse/FLINK-11187 Project: Flink

Re: StreamingFileSink causing AmazonS3Exception

2018-12-17 Thread Addison Higham
Oh this is timely! I hope I can save you some pain Kostas! (cc-ing to flink dev to get feedback there for what I believe to be a confirmed bug) I was just about to open up a flink issue for this after digging (really) deep and figuring out the issue over the weekend. The problem arises due the

[jira] [Created] (FLINK-11186) Support for event-time balancing for multiple Kafka comsumer partitions

2018-12-17 Thread Tom Schamberger (JIRA)
Tom Schamberger created FLINK-11186: --- Summary: Support for event-time balancing for multiple Kafka comsumer partitions Key: FLINK-11186 URL: https://issues.apache.org/jira/browse/FLINK-11186 Project

[jira] [Created] (FLINK-11185) StreamSourceOperatorWatermarksTest failed with InterruptedException

2018-12-17 Thread Biao Liu (JIRA)
Biao Liu created FLINK-11185: Summary: StreamSourceOperatorWatermarksTest failed with InterruptedException Key: FLINK-11185 URL: https://issues.apache.org/jira/browse/FLINK-11185 Project: Flink

[jira] [Created] (FLINK-11184) Rework TableSource and TableSink interfaces

2018-12-17 Thread Timo Walther (JIRA)
Timo Walther created FLINK-11184: Summary: Rework TableSource and TableSink interfaces Key: FLINK-11184 URL: https://issues.apache.org/jira/browse/FLINK-11184 Project: Flink Issue Type: New F

Re: [DISCUSS] Releasing Flink 1.6.3

2018-12-17 Thread Tzu-Li (Gordon) Tai
Thanks. I'll proceed to create a release candidate for 1.6.3 now. Hopefully we can have the release out by the end of this week / early next week. Cheers, Gordon On Thu, Dec 13, 2018 at 9:36 AM Jeff Zhang wrote: > +1 for a more stable flink 1.6 release. > > Hequn Cheng 于2018年12月13日周四 上午9:32写道

Re: [VOTE] Release 1.7.1, release candidate #2

2018-12-17 Thread jincheng sun
Hi Chesnay, Thanks for bring up the 1.7.1-rc2 release vote! I had do some test check as follows: 1. Local source code compilation [mvn clean install] [success] 2. Run all TestCases(both java and scala),except NettyEpollITCase in the flink-test module in IDEA [find some errors] 3. Remove the FLIN

[jira] [Created] (FLINK-11183) Flink 1.7 wrong memory graphite metrics

2018-12-17 Thread Mario Georgiev (JIRA)
Mario Georgiev created FLINK-11183: --- Summary: Flink 1.7 wrong memory graphite metrics Key: FLINK-11183 URL: https://issues.apache.org/jira/browse/FLINK-11183 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-11182) JobManagerHACheckpointRecoveryITCase need be improved

2018-12-17 Thread sunjincheng (JIRA)
sunjincheng created FLINK-11182: --- Summary: JobManagerHACheckpointRecoveryITCase need be improved Key: FLINK-11182 URL: https://issues.apache.org/jira/browse/FLINK-11182 Project: Flink Issue Typ

[jira] [Created] (FLINK-11180) ProcessFailureCancelingITCase#testCancelingOnProcessFailure

2018-12-17 Thread sunjincheng (JIRA)
sunjincheng created FLINK-11180: --- Summary: ProcessFailureCancelingITCase#testCancelingOnProcessFailure Key: FLINK-11180 URL: https://issues.apache.org/jira/browse/FLINK-11180 Project: Flink Is

[jira] [Created] (FLINK-11181) SimpleRecoveryITCaseBase test error

2018-12-17 Thread sunjincheng (JIRA)
sunjincheng created FLINK-11181: --- Summary: SimpleRecoveryITCaseBase test error Key: FLINK-11181 URL: https://issues.apache.org/jira/browse/FLINK-11181 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-11179) JoinCancelingITCase#testCancelSortMatchWhileDoingHeavySorting test error

2018-12-17 Thread sunjincheng (JIRA)
sunjincheng created FLINK-11179: --- Summary: JoinCancelingITCase#testCancelSortMatchWhileDoingHeavySorting test error Key: FLINK-11179 URL: https://issues.apache.org/jira/browse/FLINK-11179 Project: Flin

[jira] [Created] (FLINK-11178) Check flink-test module for 1.7.1-rc2

2018-12-17 Thread sunjincheng (JIRA)
sunjincheng created FLINK-11178: --- Summary: Check flink-test module for 1.7.1-rc2 Key: FLINK-11178 URL: https://issues.apache.org/jira/browse/FLINK-11178 Project: Flink Issue Type: Test

[jira] [Created] (FLINK-11177) Node health tracker

2018-12-17 Thread ryantaocer (JIRA)
ryantaocer created FLINK-11177: -- Summary: Node health tracker Key: FLINK-11177 URL: https://issues.apache.org/jira/browse/FLINK-11177 Project: Flink Issue Type: Sub-task Components: Jo

Re: CEP - Support for multiple pattern

2018-12-17 Thread Dawid Wysakowicz
Hi Jiayi, There is a ticket[1] for supporting dynamic patterns which I would say is super set of what you are actually suggesting. [1]https://issues.apache.org/jira/browse/FLINK-7129 On 17/12/2018 03:17, fudian.fd wrote: > Hi Jiayi, > > As far as I know, there is no plan to support this feature.

[jira] [Created] (FLINK-11176) Improve the harness tests to use the code-generated operator

2018-12-17 Thread Dian Fu (JIRA)
Dian Fu created FLINK-11176: --- Summary: Improve the harness tests to use the code-generated operator Key: FLINK-11176 URL: https://issues.apache.org/jira/browse/FLINK-11176 Project: Flink Issue Typ

[jira] [Created] (FLINK-11175) The sample code describing the Processing time used in TableSource is incorrect

2018-12-17 Thread vinoyang (JIRA)
vinoyang created FLINK-11175: Summary: The sample code describing the Processing time used in TableSource is incorrect Key: FLINK-11175 URL: https://issues.apache.org/jira/browse/FLINK-11175 Project: Flin