Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-21 Thread Yu Li
+1 (non-binding) - Checked release notes: OK - Checked sums and signatures: OK - Source release - contains no binaries: OK - contains no 1.9-SNAPSHOT references: OK - build from source: OK (8u101) - mvn clean verify: OK (8u101) - Binary release - no examples appear to be m

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-21 Thread LINZ, Arnaud
Hello, I think that's a good idea. I suppose that most corporate users use a vendor version and already compile their flink version with vendor repos anyway. Arnaud PS - FYI, for CDH6 (based on hadoop3), I've managed to build a 1.10 version by modifying pom.xml files and using "hidden" Cloudera p

[jira] [Created] (FLINK-17317) Schema.rowtime() method not working correctly, throws 'Window aggregate can only be defined over a time attribute column' exception

2020-04-21 Thread bianhaihua (Jira)
bianhaihua created FLINK-17317: -- Summary: Schema.rowtime() method not working correctly, throws 'Window aggregate can only be defined over a time attribute column' exception Key: FLINK-17317 URL: https://issues.apac

[jira] [Created] (FLINK-17316) Have HourlyTips solutions use TumblingEventTimeWindows.of

2020-04-21 Thread David Anderson (Jira)
David Anderson created FLINK-17316: -- Summary: Have HourlyTips solutions use TumblingEventTimeWindows.of Key: FLINK-17316 URL: https://issues.apache.org/jira/browse/FLINK-17316 Project: Flink

[jira] [Created] (FLINK-17315) UnalignedCheckpointITCase.shouldPerformUnalignedCheckpointMassivelyParallel failed in timeout

2020-04-21 Thread Zhijiang (Jira)
Zhijiang created FLINK-17315: Summary: UnalignedCheckpointITCase.shouldPerformUnalignedCheckpointMassivelyParallel failed in timeout Key: FLINK-17315 URL: https://issues.apache.org/jira/browse/FLINK-17315

[DISCUSS] Should max/min be part of the hierarchy of config option?

2020-04-21 Thread Yangze Guo
Hi, everyone, I'm working on FLINK-16605 Add max limitation to the total number of slots[1]. In the PR, I, Gary and Xintong has a discussion[2] about the config option of this limit. The central question is whether the "max" should be part of the hierarchy or part of the property itself. It means

[jira] [Created] (FLINK-17314) 【Flink Kafka Connector】The Config(connector.topic)support list topic

2020-04-21 Thread zhisheng (Jira)
zhisheng created FLINK-17314: Summary: 【Flink Kafka Connector】The Config(connector.topic)support list topic Key: FLINK-17314 URL: https://issues.apache.org/jira/browse/FLINK-17314 Project: Flink

[jira] [Created] (FLINK-17313) Validation error when insert decimal/timestamp/varchar with precision into sink using TypeInformation of row

2020-04-21 Thread Terry Wang (Jira)
Terry Wang created FLINK-17313: -- Summary: Validation error when insert decimal/timestamp/varchar with precision into sink using TypeInformation of row Key: FLINK-17313 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-17312) Support sql client savepoint

2020-04-21 Thread lun zhang (Jira)
lun zhang created FLINK-17312: - Summary: Support sql client savepoint Key: FLINK-17312 URL: https://issues.apache.org/jira/browse/FLINK-17312 Project: Flink Issue Type: Improvement Comp

[jira] [Created] (FLINK-17311) Add executable permissions to the script in the wheel package

2020-04-21 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-17311: Summary: Add executable permissions to the script in the wheel package Key: FLINK-17311 URL: https://issues.apache.org/jira/browse/FLINK-17311 Project: Flink

[jira] [Created] (FLINK-17310) Test blink planner failed to generate JobGraph when the checkpoint mode enable

2020-04-21 Thread LionelZ (Jira)
LionelZ created FLINK-17310: --- Summary: Test blink planner failed to generate JobGraph when the checkpoint mode enable Key: FLINK-17310 URL: https://issues.apache.org/jira/browse/FLINK-17310 Project: Flink

[jira] [Created] (FLINK-17309) TPC-DS fail to run data generator

2020-04-21 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17309: Summary: TPC-DS fail to run data generator Key: FLINK-17309 URL: https://issues.apache.org/jira/browse/FLINK-17309 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17308) ExecutionGraphCache cachedExecutionGraphs not cleanup cause OOM Bug

2020-04-21 Thread yujunyong (Jira)
yujunyong created FLINK-17308: - Summary: ExecutionGraphCache cachedExecutionGraphs not cleanup cause OOM Bug Key: FLINK-17308 URL: https://issues.apache.org/jira/browse/FLINK-17308 Project: Flink

[DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-21 Thread Robert Metzger
Hi all, for the upcoming 1.11 release, I started looking into adding support for Hadoop 3[1] for Flink. I have explored a little bit already into adding a shaded hadoop 3 into “flink-shaded”, and some mechanisms for switching between Hadoop 2 and 3 dependencies in the Flink build. However, Chesna

[jira] [Created] (FLINK-17307) Add collector to DeserializationSchema

2020-04-21 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17307: Summary: Add collector to DeserializationSchema Key: FLINK-17307 URL: https://issues.apache.org/jira/browse/FLINK-17307 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-17306) Add open/close methods to DeserializationSchema

2020-04-21 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17306: Summary: Add open/close methods to DeserializationSchema Key: FLINK-17306 URL: https://issues.apache.org/jira/browse/FLINK-17306 Project: Flink Issue

[jira] [Created] (FLINK-17305) Add open/close and collector to (De)serializationSchema

2020-04-21 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17305: Summary: Add open/close and collector to (De)serializationSchema Key: FLINK-17305 URL: https://issues.apache.org/jira/browse/FLINK-17305 Project: Flink

[RESULT][VOTE] FLIP-124: Add open/close and Collector to (De)SerializationSchema

2020-04-21 Thread Dawid Wysakowicz
Hi all, The voting time for FLIP-124 has passed. I'm closing the vote now. There were 4 +1 votes, 3 of which are binding: - Jark (binding) - Aljoscha (binding) - Benchao (non-binding) - Timo (binding) There were no disapproving votes. Thus, FLIP-124 has been accepted. Thanks everyone for join

Re: [DISCUSS] FLIP-126: Unify (and separate) Watermark Assigners

2020-04-21 Thread Timo Walther
Thanks for the proposal Aljoscha. This is a very useful unification. We have considered this FLIP already in the interfaces for FLIP-95 [1] and look forward to update to the new unified watermark generators once FLIP-126 has been accepted. Regards, Timo [1] https://github.com/apache/flink/pul

Re: [DISCUSS] Generating java code?

2020-04-21 Thread Chesnay Schepler
I've had an offline discussion with Till and we came to the following conclusion: All out-lined approaches work perfectly when Flink is built in it's entirety with maven. None of the out-lined approach work perfectly when Flink is _not_ built in it's entirety. The source-file generation appr

[jira] [Created] (FLINK-17304) Kafka two streams cannot use Flink SQL to query inner join

2020-04-21 Thread xingyuan cheng (Jira)
xingyuan cheng created FLINK-17304: -- Summary: Kafka two streams cannot use Flink SQL to query inner join Key: FLINK-17304 URL: https://issues.apache.org/jira/browse/FLINK-17304 Project: Flink

[jira] [Created] (FLINK-17303) Return TableResult for Python TableEnvironment

2020-04-21 Thread godfrey he (Jira)
godfrey he created FLINK-17303: -- Summary: Return TableResult for Python TableEnvironment Key: FLINK-17303 URL: https://issues.apache.org/jira/browse/FLINK-17303 Project: Flink Issue Type: Improv

[jira] [Created] (FLINK-17302) Add multiget() interface for state of rocksdb statebackend

2020-04-21 Thread Peidian Li (Jira)
Peidian Li created FLINK-17302: -- Summary: Add multiget() interface for state of rocksdb statebackend Key: FLINK-17302 URL: https://issues.apache.org/jira/browse/FLINK-17302 Project: Flink Issu

[jira] [Created] (FLINK-17301) TaskManagerRunnerStartupTest.testStartupWhenNetworkStackFailsToInitialize fails on OSX

2020-04-21 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17301: -- Summary: TaskManagerRunnerStartupTest.testStartupWhenNetworkStackFailsToInitialize fails on OSX Key: FLINK-17301 URL: https://issues.apache.org/jira/browse/FLINK-17301

[jira] [Created] (FLINK-17299) Add remote channel throughput benchmark

2020-04-21 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-17299: --- Summary: Add remote channel throughput benchmark Key: FLINK-17299 URL: https://issues.apache.org/jira/browse/FLINK-17299 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17300) Log the lineage information between ExecutionAttemptID and AllocationID

2020-04-21 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-17300: -- Summary: Log the lineage information between ExecutionAttemptID and AllocationID Key: FLINK-17300 URL: https://issues.apache.org/jira/browse/FLINK-17300 Project: Flink

[jira] [Created] (FLINK-17297) Log the lineage information between ExecutionAttemptID and SlotRequestID

2020-04-21 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-17297: -- Summary: Log the lineage information between ExecutionAttemptID and SlotRequestID Key: FLINK-17297 URL: https://issues.apache.org/jira/browse/FLINK-17297 Project: Flink

[jira] [Created] (FLINK-17298) Log the lineage information between ExecutionAttemptID and SlotRequestID

2020-04-21 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-17298: -- Summary: Log the lineage information between ExecutionAttemptID and SlotRequestID Key: FLINK-17298 URL: https://issues.apache.org/jira/browse/FLINK-17298 Project: Flink

[jira] [Created] (FLINK-17296) Support "create table if not exists" in JDBC table sink.

2020-04-21 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-17296: -- Summary: Support "create table if not exists" in JDBC table sink. Key: FLINK-17296 URL: https://issues.apache.org/jira/browse/FLINK-17296 Project: Flink Issue Ty

[jira] [Created] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

2020-04-21 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-17295: -- Summary: Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber Key: FLINK-17295 URL: https://issues.apache.org/jira/browse/FLINK-17295 Project

[RESULT][VOTE] FLIP-118: Improve Flink's ID System

2020-04-21 Thread Yangze Guo
Hi all, The voting time for FLIP-118[1] has passed. I'm closing the vote now. There were 3 + 1 votes, 3 of which are binding: - Till (binding) - Zhijiang (binding) - Zhu Zhu (binding) - Victor Wong (non-binding) There were no -1 votes. Thus, FLIP-118 has been accepted. Thanks everyone for joi

[jira] [Created] (FLINK-17294) Using "DataSource" instead of "DriverManager" to get connection in JDBC connector

2020-04-21 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-17294: -- Summary: Using "DataSource" instead of "DriverManager" to get connection in JDBC connector Key: FLINK-17294 URL: https://issues.apache.org/jira/browse/FLINK-17294 Project

[jira] [Created] (FLINK-17293) Port training exercises data sets to a generator

2020-04-21 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-17293: --- Summary: Port training exercises data sets to a generator Key: FLINK-17293 URL: https://issues.apache.org/jira/browse/FLINK-17293 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-17292) Translate Fault Tolerance tutorial to Chinese

2020-04-21 Thread David Anderson (Jira)
David Anderson created FLINK-17292: -- Summary: Translate Fault Tolerance tutorial to Chinese Key: FLINK-17292 URL: https://issues.apache.org/jira/browse/FLINK-17292 Project: Flink Issue Type:

[jira] [Created] (FLINK-17291) Translate tutorial on event-driven applications to chinese

2020-04-21 Thread David Anderson (Jira)
David Anderson created FLINK-17291: -- Summary: Translate tutorial on event-driven applications to chinese Key: FLINK-17291 URL: https://issues.apache.org/jira/browse/FLINK-17291 Project: Flink

[jira] [Created] (FLINK-17290) Translate Streaming Analytics tutorial to chinese

2020-04-21 Thread David Anderson (Jira)
David Anderson created FLINK-17290: -- Summary: Translate Streaming Analytics tutorial to chinese Key: FLINK-17290 URL: https://issues.apache.org/jira/browse/FLINK-17290 Project: Flink Issue T

[GitHub] [flink-web] azagrebin commented on a change in pull request #328: Add blog post: "Memory Management improvements with Apache Flink 1.10"

2020-04-21 Thread GitBox
azagrebin commented on a change in pull request #328: URL: https://github.com/apache/flink-web/pull/328#discussion_r411995827 ## File path: _posts/2020-04-17-memory-management-improvements-flink-1.10.md ## @@ -0,0 +1,87 @@ +--- +layout: post +title: "Memory Management Improveme

[GitHub] [flink-web] azagrebin commented on a change in pull request #328: Add blog post: "Memory Management improvements with Apache Flink 1.10"

2020-04-21 Thread GitBox
azagrebin commented on a change in pull request #328: URL: https://github.com/apache/flink-web/pull/328#discussion_r411995447 ## File path: _posts/2020-04-17-memory-management-improvements-flink-1.10.md ## @@ -0,0 +1,87 @@ +--- +layout: post +title: "Memory Management Improveme

[GitHub] [flink-web] azagrebin commented on a change in pull request #328: Add blog post: "Memory Management improvements with Apache Flink 1.10"

2020-04-21 Thread GitBox
azagrebin commented on a change in pull request #328: URL: https://github.com/apache/flink-web/pull/328#discussion_r411994775 ## File path: _posts/2020-04-17-memory-management-improvements-flink-1.10.md ## @@ -0,0 +1,87 @@ +--- +layout: post +title: "Memory Management Improveme

[GitHub] [flink-web] azagrebin commented on a change in pull request #328: Add blog post: "Memory Management improvements with Apache Flink 1.10"

2020-04-21 Thread GitBox
azagrebin commented on a change in pull request #328: URL: https://github.com/apache/flink-web/pull/328#discussion_r411994181 ## File path: _posts/2020-04-17-memory-management-improvements-flink-1.10.md ## @@ -0,0 +1,87 @@ +--- +layout: post +title: "Memory Management Improveme

[jira] [Created] (FLINK-17289) Translate tutorials/etl.md to chinese

2020-04-21 Thread David Anderson (Jira)
David Anderson created FLINK-17289: -- Summary: Translate tutorials/etl.md to chinese Key: FLINK-17289 URL: https://issues.apache.org/jira/browse/FLINK-17289 Project: Flink Issue Type: Improve

[GitHub] [flink-web] azagrebin commented on a change in pull request #328: Add blog post: "Memory Management improvements with Apache Flink 1.10"

2020-04-21 Thread GitBox
azagrebin commented on a change in pull request #328: URL: https://github.com/apache/flink-web/pull/328#discussion_r411989670 ## File path: _posts/2020-04-17-memory-management-improvements-flink-1.10.md ## @@ -0,0 +1,87 @@ +--- +layout: post +title: "Memory Management Improveme

[GitHub] [flink-web] azagrebin commented on a change in pull request #328: Add blog post: "Memory Management improvements with Apache Flink 1.10"

2020-04-21 Thread GitBox
azagrebin commented on a change in pull request #328: URL: https://github.com/apache/flink-web/pull/328#discussion_r411984361 ## File path: _posts/2020-04-17-memory-management-improvements-flink-1.10.md ## @@ -0,0 +1,87 @@ +--- +layout: post +title: "Memory Management Improveme

Re: Apply to contribute to Flink

2020-04-21 Thread Leonard Xu
Hi,Lee Welcome to Flink community! Currently, you do not need a JIRA permission. Just ping committers if your want to work on some JIRA ticket and them will assign the ticket to you And then you can prepare your PR and so on, you will get more details from the contribution guide[1]. Best, Leon

[GitHub] [flink-shaded] zentol opened a new pull request #84: [FLINK-17287][github] Disable merge commit button

2020-04-21 Thread GitBox
zentol opened a new pull request #84: URL: https://github.com/apache/flink-shaded/pull/84 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: Apply to contribute to Flink

2020-04-21 Thread Till Rohrmann
Here is some information about how to contribute to Flink [1]. [1] https://flink.apache.org/contributing/contribute-code.html Cheers, Till On Tue, Apr 21, 2020 at 10:16 AM Till Rohrmann wrote: > Hi Lee, > > there are no special permissions required to contribute to Flink. The way > it works is

Re: Apply to contribute to Flink

2020-04-21 Thread Till Rohrmann
Hi Lee, there are no special permissions required to contribute to Flink. The way it works is that you write on a JIRA issue for which you would like to contribute. Once a committer sees it you can discuss with him your solution approach. Once she signs it off she will assign you to the ticket and

[jira] [Created] (FLINK-17288) Speedup loading from savepoints into RocksDB by bulk load

2020-04-21 Thread Jun Qin (Jira)
Jun Qin created FLINK-17288: --- Summary: Speedup loading from savepoints into RocksDB by bulk load Key: FLINK-17288 URL: https://issues.apache.org/jira/browse/FLINK-17288 Project: Flink Issue Type: I

[jira] [Created] (FLINK-17287) Disable merge commit button

2020-04-21 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17287: Summary: Disable merge commit button Key: FLINK-17287 URL: https://issues.apache.org/jira/browse/FLINK-17287 Project: Flink Issue Type: Improvement