Re: [VOTE] Release 1.11.0, release candidate #4

2020-07-01 Thread Jark Wu
Hi, I'm very sorry but we just found a blocker issue FLINK-18461 [1] in the new feature of changelog source (CDC). This bug will result in queries on changelog source can’t be inserted into upsert sink (e.g. ES, JDBC, HBase), which is a common case in production. CDC is one of the important featur

Re: [DISCUSS] Sql-client lack support for new features

2020-07-01 Thread Kurt Young
Thanks Jingsong for bringing this up discussion and sorry for the late reply. I'm in general +1 for #1, and want to expand the scope of #2. First of all, I think the approach Jingsong proposed in #2 can help with covering more e2e use cases of SQL, which also draws a clean line between how to des

Re: [VOTE] Release 1.11.0, release candidate #4

2020-07-01 Thread Zhijiang
Hi Thomas, Thanks for the efficient feedback. Regarding the suggestion of adding the release notes document, I agree with your point. Maybe we should adjust the vote template accordingly in the respective wiki to guide the following release processes. Regarding the performance regression, cou

[jira] [Created] (FLINK-18461) Changelog source can't be insert into upsert sink

2020-07-01 Thread Jark Wu (Jira)
Jark Wu created FLINK-18461: --- Summary: Changelog source can't be insert into upsert sink Key: FLINK-18461 URL: https://issues.apache.org/jira/browse/FLINK-18461 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-18460) If the Python UDFs are called before calling the Python Dependency Management API, the Python Dependency Management would not will not take effect.

2020-07-01 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-18460: - Summary: If the Python UDFs are called before calling the Python Dependency Management API, the Python Dependency Management would not will not take effect. Key: FLINK-18460 URL: https

Re: [VOTE] Release 1.11.0, release candidate #4

2020-07-01 Thread Thomas Weise
Hi Till, Yes, we don't have the setting in flink-conf.yaml. Generally, we carry forward the existing configuration and any change to default configuration values would impact the upgrade. Yes, since it is an incompatible change I would state it in the release notes. Thanks, Thomas BTW I found

[jira] [Created] (FLINK-18459) ClassNotFoundException in ProcessFunction property object's callback and promise

2020-07-01 Thread Xinhao Li (Jira)
Xinhao Li created FLINK-18459: - Summary: ClassNotFoundException in ProcessFunction property object's callback and promise Key: FLINK-18459 URL: https://issues.apache.org/jira/browse/FLINK-18459 Project: F

Re: Extend the Table API & SQL Documentation

2020-07-01 Thread Seth Wiesman
Hi Ayeshmantha, I'm happy to see your enthusiasm and excited to review your application! Seth On Wed, Jul 1, 2020 at 4:54 AM Ayeshmantha Perera wrote: > Hi Aljoscha, Seth > > I am Ayeshmantha Perera. I am interested in participating in > the project:- Extend the Table API & SQL Documentation

Re: Flink JDK compatibility problem.

2020-07-01 Thread Chesnay Schepler
My understanding is that you can only remove the exports by either a) removing all usages or b) migrating the project to modules and declare the JDK dependencies that way. a) is not viable AFAIK and in at least one case would require dropping features (the JMX reporter), while b) appears to be

Re: Flink JDK compatibility problem.

2020-07-01 Thread Niels Basjes
Hi, I've been fiddling around to try to see if this really works when compiling with Java 14. I have the simplest form of this fix working and I've put up a pull request for just that. https://github.com/apache/flink/pull/12799 I also found that there are two different values for java.version that

Re: [VOTE] FLIP-128: Enhanced Fan Out for AWS Kinesis Consumers

2020-07-01 Thread Tzu-Li (Gordon) Tai
+1 On Wed, Jul 1, 2020, 8:57 PM Cranmer, Danny wrote: > Hi all, > > I'd like to start a voting thread for FLIP-128 [1], which we've reached > consensus > in [2]. > > This voting will be open for minimum 3 days till 13:00 UTC, July 4th. > > Thanks, > Danny Cranmer > > [1] > https://cwiki.apache.

[VOTE] FLIP-128: Enhanced Fan Out for AWS Kinesis Consumers

2020-07-01 Thread Cranmer, Danny
Hi all, I'd like to start a voting thread for FLIP-128 [1], which we've reached consensus in [2]. This voting will be open for minimum 3 days till 13:00 UTC, July 4th. Thanks, Danny Cranmer [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-128%3A+Enhanced+Fan+Out+for+AWS+Kinesis+Cons

[jira] [Created] (FLINK-18458) Setting the property java.version makes the build brittle and harder to debug.

2020-07-01 Thread Niels Basjes (Jira)
Niels Basjes created FLINK-18458: Summary: Setting the property java.version makes the build brittle and harder to debug. Key: FLINK-18458 URL: https://issues.apache.org/jira/browse/FLINK-18458 Projec

[jira] [Created] (FLINK-18457) Fix invalid links in "Detecting Patterns" page of "Streaming Concepts"

2020-07-01 Thread Roc Marshal (Jira)
Roc Marshal created FLINK-18457: --- Summary: Fix invalid links in "Detecting Patterns" page of "Streaming Concepts" Key: FLINK-18457 URL: https://issues.apache.org/jira/browse/FLINK-18457 Project: Flink

Extend the Table API & SQL Documentation

2020-07-01 Thread Ayeshmantha Perera
Hi Aljoscha, Seth I am Ayeshmantha Perera. I am interested in participating in the project:- Extend the Table API & SQL Documentation To give a short introduction. I participated in GSoD last year with openMRS and built a Rest API documentation site for them with the use of the SLATE markdown te

Re: Flink JDK compatibility problem.

2020-07-01 Thread Chesnay Schepler
oh cool, yes that should work nicely then. On 01/07/2020 10:50, Niels Basjes wrote: Hi, > This is difficult to do since you cannot have multiple jdk activations for a single profile in maven Well actually you can have multiple versions of JDK activate the java11 profile. http://maven.apach

Re: Flink JDK compatibility problem.

2020-07-01 Thread Niels Basjes
Hi, > This is difficult to do since you cannot have multiple jdk activations for a single profile in maven Well actually you can have multiple versions of JDK activate the java11 profile. http://maven.apache.org/guides/introduction/introduction-to-profiles.html quote: 1. 2. 3. [1.3,1

Re: [DISCUSS] FLIP-128: Enhanced Fan Out for AWS Kinesis Consumers

2020-07-01 Thread Tzu-Li (Gordon) Tai
Thanks for updating the FLIP Danny. Changes look good to me. Please feel free to proceed with a vote soon. On Tue, Jun 30, 2020 at 11:19 PM Cranmer, Danny wrote: > Hey Gordon, > > I have updated the FLIP [1] to include support for configurable > registration strategies: > - Added 2 additional co

Re: [VOTE] Release 1.11.0, release candidate #4

2020-07-01 Thread Till Rohrmann
Hi Thomas, just to confirm: When starting the image in local mode, then you don't have any of the JobManager memory configuration settings configured in the effective flink-conf.yaml, right? Does this mean that you have explicitly removed `jobmanager.heap.size: 1024m` from the default configuratio