[jira] [Created] (FLINK-22536) Promote the critical log in FineGrainedSlotManager to INFO level

2021-04-29 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-22536: -- Summary: Promote the critical log in FineGrainedSlotManager to INFO level Key: FLINK-22536 URL: https://issues.apache.org/jira/browse/FLINK-22536 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.12.3 released

2021-04-29 Thread Till Rohrmann
Great to hear. Thanks a lot for being our release manager Arvid and to everyone who has contributed to this release! Cheers, Till On Thu, Apr 29, 2021 at 4:11 PM Arvid Heise wrote: > Dear all, > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.12.3, which i

Re: Does flink support multi cluster deployment with HA on multi k8s clusters

2021-04-29 Thread Till Rohrmann
The reason why this feature is not part of Flink is that it is not trivial to solve. There are definitely different solutions to the problem. I think that a solution will probably be built around Flink and not integrated into it because it goes a bit beyond what Flink's current focus is. I can tell

[jira] [Created] (FLINK-22535) Resource leak would happen if exception thrown during AbstractInvokable#restore of task life

2021-04-29 Thread Yun Tang (Jira)
Yun Tang created FLINK-22535: Summary: Resource leak would happen if exception thrown during AbstractInvokable#restore of task life Key: FLINK-22535 URL: https://issues.apache.org/jira/browse/FLINK-22535

[ANNOUNCE] Apache Flink 1.12.3 released

2021-04-29 Thread Arvid Heise
Dear all, The Apache Flink community is very happy to announce the release of Apache Flink 1.12.3, which is the third bugfix release for the Apache Flink 1.12 series. Apache FlinkĀ® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data

[jira] [Created] (FLINK-22534) Set delegation token's service name as credential alias

2021-04-29 Thread Junfan Zhang (Jira)
Junfan Zhang created FLINK-22534: Summary: Set delegation token's service name as credential alias Key: FLINK-22534 URL: https://issues.apache.org/jira/browse/FLINK-22534 Project: Flink Issue

[RESULT][VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Dawid Wysakowicz
I am happy to announce that we have approved the 1.13.0 release. Thank you all for making it happen! There were 12 approving votes, 5 of which were binding * Piotr Nowojski (binding) * Zhu Zhu (binding) * Jark Wu (binding) * Dian Fu (binding) * Robert Metzger (binding) * Xintong Song

[jira] [Created] (FLINK-22533) Allow creating custom metrics

2021-04-29 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-22533: Summary: Allow creating custom metrics Key: FLINK-22533 URL: https://issues.apache.org/jira/browse/FLINK-22533 Project: Flink Issue Type: Improvement

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread David Anderson
+1 (non-binding) Checks: - I built from source, successfully. - I tested the new backpressure metrics and UI. I found one non-critical bug that's been around for years, and for which a fix has already been merged for 1.13.1 (https://issues.apache.org/jira/browse/FLINK-22489

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Dawid Wysakowicz
Thank you all for helping to verify the release. Really appreciated! I will conclude the vote in a separate thread. Best, Dawid On 29/04/2021 14:16, Robert Metzger wrote: > Thanks for creating the RC and managing the release process so far Guowei > and Dawid! > > +1 (binding) > > Checks: > - I d

[jira] [Created] (FLINK-22532) Improve the support for remote functions in the DataStream integration

2021-04-29 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-22532: Summary: Improve the support for remote functions in the DataStream integration Key: FLINK-22532 URL: https://issues.apache.org/jira/browse/FLINK-22532 Project: Flin

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Robert Metzger
Thanks for creating the RC and managing the release process so far Guowei and Dawid! +1 (binding) Checks: - I deployed the RC on AWS EMR (session cluster and per-job cluster). I confirmed a minor issue Arvid Heise told me offline about: https://issues.apache.org/jira/browse/FLINK-22509. I believe

[jira] [Created] (FLINK-22531) Improve the support for finite streaming jobs with async operations.

2021-04-29 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-22531: Summary: Improve the support for finite streaming jobs with async operations. Key: FLINK-22531 URL: https://issues.apache.org/jira/browse/FLINK-22531 Project: Flink

[jira] [Created] (FLINK-22530) RuntimeException after subsequent windowed grouping in TableAPI

2021-04-29 Thread Christopher Rost (Jira)
Christopher Rost created FLINK-22530: Summary: RuntimeException after subsequent windowed grouping in TableAPI Key: FLINK-22530 URL: https://issues.apache.org/jira/browse/FLINK-22530 Project: Flin

[jira] [Created] (FLINK-22529) StateFun Kinesis ingresses should support configs that are available via FlinkKinesisConsumer's ConsumerConfigConstants

2021-04-29 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-22529: --- Summary: StateFun Kinesis ingresses should support configs that are available via FlinkKinesisConsumer's ConsumerConfigConstants Key: FLINK-22529 URL: https://issues

Re: Does flink support multi cluster deployment with HA on multi k8s clusters

2021-04-29 Thread Enrique
Hi Till and Bhagi, As part of our product, we also have a production requirement to deploy Flink in multi zones and currently have it configured with Kubernetes HA. Till, is the reason this is not supported out of the box also due to the fact Kubernetes HA relies on RWX storage and this is consid

[jira] [Created] (FLINK-22528) Document latency tracking metrics for state accesses

2021-04-29 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-22528: - Summary: Document latency tracking metrics for state accesses Key: FLINK-22528 URL: https://issues.apache.org/jira/browse/FLINK-22528 Project: Flink Issue

[jira] [Created] (FLINK-22527) Give friendly hint when click FlameGraph without rest.flamegraph.enabled

2021-04-29 Thread Yun Tang (Jira)
Yun Tang created FLINK-22527: Summary: Give friendly hint when click FlameGraph without rest.flamegraph.enabled Key: FLINK-22527 URL: https://issues.apache.org/jira/browse/FLINK-22527 Project: Flink

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Yun Tang
+1 (non-binding) - built from source code with scala 2.11 succeeded - submit state machine example and it runed well with expected commit id shown in UI. - enable state latency tracking with slf4j metrics reporter and all behaves as expected. - Click 'FlameGraph' but found the we UI did not give

Re: Does flink support multi cluster deployment with HA on multi k8s clusters

2021-04-29 Thread bhagi@R
Can you explain clearly... How to configure HA service with k8s for different DC's for Flink cluster .. -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

[jira] [Created] (FLINK-22526) Rename TopicId to topic in Kafka related code

2021-04-29 Thread dengziming (Jira)
dengziming created FLINK-22526: -- Summary: Rename TopicId to topic in Kafka related code Key: FLINK-22526 URL: https://issues.apache.org/jira/browse/FLINK-22526 Project: Flink Issue Type: Improve

RE: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Zhou, Brian
+1 (non-binding) - Build the Pravega Flink connector with RC artifacts and all tests pass - Start a cluster, Run Pravega reader and writer application on it successfully Thanks, Brian -Original Message- From: Leonard Xu Sent: Thursday, April 29, 2021 16:53 To: dev Subject: Re: [VOTE]

[jira] [Created] (FLINK-22525) The zone id in exception message should be GMT+08:00 instead of GMT+8:00

2021-04-29 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-22525: -- Summary: The zone id in exception message should be GMT+08:00 instead of GMT+8:00 Key: FLINK-22525 URL: https://issues.apache.org/jira/browse/FLINK-22525 Project: Flink

Re: Does flink support multi cluster deployment with HA on multi k8s clusters

2021-04-29 Thread Till Rohrmann
Hi Bhagi, out of the box, Flink does not support this functionality. What you could try to do is to configure a stretch K8s cluster running on different DCs and then having an HA service (ZK or K8s) and blob storage being able to survive a DC outage. That way Flink should also be able to survive a

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Leonard Xu
+1 (non-binding) - verified signatures and hashes - built from source code with scala 2.11 succeeded - started a cluster, WebUI was accessible, ran some simple SQL jobs, no suspicious log output - tested time functions and time zone usage in SQL Client, the query result is as expected - the web

Re: [DISCUSS] Using timeouts in JUnit tests

2021-04-29 Thread Till Rohrmann
I think for the maven tests we use this log4j.properties file [1]. [1] https://github.com/apache/flink/blob/master/tools/ci/log4j.properties Cheers, Till On Wed, Apr 28, 2021 at 4:47 AM Dong Lin wrote: > Thanks for the detailed explanations! Regarding the usage of timeout, now I > agree that i

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Xingbo Huang
+1 (non-binding) - verified checksum and signature - test upload `apache-flink` and `apache-flink-libraries` to test.pypi - pip install `apache-flink-libraries` and `apache-flink` in mac os - started cluster and run row-based operation test - started cluster and test python general group window ag

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Dian Fu
+1 (binding) - Verified the signature and checksum - Installed PyFlink successfully using the source package - Run a few PyFlink examples: Python UDF, Pandas UDF, Python DataStream API with state access, Python DataStream API with batch execution mode - Reviewed the website PR Regards, Dian > 2

Re: [VOTE] Release 1.13.0, release candidate #2

2021-04-29 Thread Jark Wu
+1 (binding) - checked/verified signatures and hashes - started cluster and run some e2e sql queries using SQL Client, results are as expect: * read from kafka source, window aggregate, lookup mysql database, write into elasticsearch * window aggregate using legacy window syntax and new window T