Re: MetricRegistryTestUtils java class (flink-runtime/metrics) not found in source code version 1.14.3

2022-01-31 Thread Martijn Visser
Hi Prasanna, Just a quick note that the Github links are all pointing to release candidate 1 for 1.14.3. The released version is in https://github.com/apache/flink/blob/release-1.14.3/flink-runtime/src/test/java/org/apache/flink/runtime/metrics/MetricRegistryTestUtils.java Best regards, Martijn

MetricRegistryTestUtils java class (flink-runtime/metrics) not found in source code version 1.14.3

2022-01-31 Thread Prasanna kumar
Hi, Team, We are writing our own prometheus reporter to make sure that we are capturing data in histograms rather than summaries. We were able to do it successfully in version 1.12.7. But while upgrading to version 1.14.3 , we find that MetricRegistryTestUtils is not available in the src code gi

Re: MetricRegistryTestUtils java class (flink-runtime/metrics) not found in source code version 1.14.3

2022-01-31 Thread Prasanna kumar
NVM was able to find it in a different place https://github.com/apache/flink/blob/release-1.14.3-rc1/flink-runtime/src/test/java/org/apache/flink/runtime/metrics/MetricRegistryTestUtils.java On Tue, Feb 1, 2022 at 11:58 AM Prasanna kumar < prasannakumarram...@gmail.com> wrote: > Hi, > > Team, We

[jira] [Created] (FLINK-25901) Investigate why hostname might be resolved to different ips on azure pipeline

2022-01-31 Thread Yun Gao (Jira)
Yun Gao created FLINK-25901: --- Summary: Investigate why hostname might be resolved to different ips on azure pipeline Key: FLINK-25901 URL: https://issues.apache.org/jira/browse/FLINK-25901 Project: Flink

[jira] [Created] (FLINK-25900) Create view example does not assign alias to functions resulting in generated names like EXPR$5

2022-01-31 Thread Mans Singh (Jira)
Mans Singh created FLINK-25900: -- Summary: Create view example does not assign alias to functions resulting in generated names like EXPR$5 Key: FLINK-25900 URL: https://issues.apache.org/jira/browse/FLINK-25900

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-01-31 Thread Thomas Weise
HI Xintong, Thanks for the feedback and please see responses below --> On Fri, Jan 28, 2022 at 12:21 AM Xintong Song wrote: > Thanks Thomas for drafting this FLIP, and everyone for the discussion. > > I also have a few questions and comments. > > ## Job Submission > Deploying a Flink session cl

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Andrew Otto
Any SSE/EventSource Java Client should work. I have not personally used one. From a quick search, maybe https://github.com/launchdarkly/okhttp-eventsource or something like it? On Mon, Jan 31, 2022 at 11:45 AM Francesco Guardiani < france...@ververica.com> wrote: > > Shameless plug: Maybe th

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Andrew Otto
https://golb.hplar.ch/2018/02/Access-Server-Sent-Events-from-Java.html looks like a nice tutorial. On Mon, Jan 31, 2022 at 12:27 PM Andrew Otto wrote: > Any SSE/EventSource Java Client should work. I have not personally used > one. From a quick search, maybe > https://github.com/launchdarkly/o

[jira] [Created] (FLINK-25899) Add Java connected components example to flink-statefun-playground

2022-01-31 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-25899: - Summary: Add Java connected components example to flink-statefun-playground Key: FLINK-25899 URL: https://issues.apache.org/jira/browse/FLINK-25899 Project: Flink

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Francesco Guardiani
> Shameless plug: Maybe the Wikipedia EventStreams SSE API would make for a great connector example in Flink? Sounds like a great idea! Do you have a ready to use Java Client for that?

[jira] [Created] (FLINK-25898) Add README.md to flink-statefun/statefun-sdk-js

2022-01-31 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-25898: - Summary: Add README.md to flink-statefun/statefun-sdk-js Key: FLINK-25898 URL: https://issues.apache.org/jira/browse/FLINK-25898 Project: Flink Issue Type:

[jira] [Created] (FLINK-25897) Update project configuration gradle doc to 7.x version

2022-01-31 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-25897: --- Summary: Update project configuration gradle doc to 7.x version Key: FLINK-25897 URL: https://issues.apache.org/jira/browse/FLINK-25897 Project: Flink

[jira] [Created] (FLINK-25896) Buffer debloating issues with high parallelism

2022-01-31 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-25896: -- Summary: Buffer debloating issues with high parallelism Key: FLINK-25896 URL: https://issues.apache.org/jira/browse/FLINK-25896 Project: Flink Issue Type

[jira] [Created] (FLINK-25895) Add ExecNodeGraph ser/de

2022-01-31 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-25895: --- Summary: Add ExecNodeGraph ser/de Key: FLINK-25895 URL: https://issues.apache.org/jira/browse/FLINK-25895 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Jing Ge
Thanks @Martijn for driving this! +1 for deprecating and removing it. All the concerns mentioned previously are valid. It is good to know that the upcoming connector template/archetype will help the user for the kickoff. Beyond that, speaking of using a real connector as a sample, since Flink is he

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Andrew Otto
Shameless plug: Maybe the Wikipedia EventStreams SSE API would make for a great connector example in Flink? :D On Mon, Jan 31, 2022 at 5:41 AM Martijn Visser wrote: > Hi all, > > Than

[jira] [Created] (FLINK-25894) Explicitly configure japicmp oldVersion for flink-streaming-java

2022-01-31 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-25894: Summary: Explicitly configure japicmp oldVersion for flink-streaming-java Key: FLINK-25894 URL: https://issues.apache.org/jira/browse/FLINK-25894 Project: Fli

Re: [DISCUSS] Looking for maintainers for Cassandra connector or decide to remove connector

2022-01-31 Thread Marco Zühlke
Hi, just discovered the voting thread and wanted to raise my hand to in an attempt to maintain the Apache Cassandra connector. At work Kafka -> Flink -> Cassandra is a very common usage pattern for me. >From other ongoing threads I got that the connectors would be removed from >main repositor

[RESULT][VOTE] Apache Flink Stateful Functions 3.2.0, release candidate #1

2022-01-31 Thread Till Rohrmann
Hi everyone, I am pleased to announce that we have unanimously approved this release: There are 5 approving votes, 3 of which are binding: - Mingmin Xu (non-binding) - Igal Shilman (binding) - Seth Wiesman (non-binding) - Tzu-Li Tai (binding) - Till Rohrmann (binding) There are no disapproving v

Re: [VOTE] Apache Flink Stateful Functions 3.2.0, release candidate #1

2022-01-31 Thread Till Rohrmann
Thanks a lot for the votes everyone! We have reached the required number of binding votes :-) I will close the vote now and post the result as a separate email. Cheers, Till On Sat, Jan 29, 2022 at 5:29 PM Till Rohrmann wrote: > +1 (binding) > > - verified checksums and signatures > - built fro

Re: [Consulting] Should a Flink class loader be a singleton?

2022-01-31 Thread Till Rohrmann
Hi Zhiping, I am pulling in Timo who knows the sql client probably best. He might be able to help you. In general, this sounds like a bug to me. Maybe you can provide us with the full stack trace and maybe even the debug logs of the failing run. Cheers, Till On Sun, Jan 30, 2022 at 4:21 AM Zhipi

JDBC: Support connection pooling

2022-01-31 Thread Dario Heinisch
Hey there, Hope everyone is well! Correct me if I am wrong but it seems like Flink does not support connection pooling for JDBC sinks. So for every sink we open a connection, if we have N sinks we have N open connections. There are multiple JDBC connection pooling libraries which can be used

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

2022-01-31 Thread Gabor Somogyi
Thanks for the confirmation, now it works! G On Mon, Jan 31, 2022 at 12:25 PM Chesnay Schepler wrote: > You should have permissions now. Note that I saw 2 accounts matching > your name, and I picked gaborgsomogyi. > > On 31/01/2022 11:28, Gabor Somogyi wrote: > > Not sure if the mentioned writ

Re: [VOTE] Deprecate Cassandra connector

2022-01-31 Thread Ada Wong
+1 Martijn Visser 于2022年1月31日周一 18:48写道: > > Hi everyone, > > I would like to open up a vote to deprecate Cassandra in Flink 1.15 and > remove it in the next version. I've previously mentioned that we were > looking for maintainers for Cassandra, but so far none have come forward > [1]. > > The v

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

2022-01-31 Thread Chesnay Schepler
You should have permissions now. Note that I saw 2 accounts matching your name, and I picked gaborgsomogyi. On 31/01/2022 11:28, Gabor Somogyi wrote: Not sure if the mentioned write right already given or not but I still don't see any edit button. G On Fri, Jan 28, 2022 at 5:08 PM Gabor Somo

[VOTE] Remove Twitter connector

2022-01-31 Thread Martijn Visser
Hi everyone, I would like to open up a vote to remove the Twitter connector in Flink 1.15. This was brought up previously for a discussion [1]. The vote will last for at least 72 hours, and will be accepted by a consensus of active committers. Best regards, Martijn Visser https://twitter.com/Ma

[VOTE] Deprecate Cassandra connector

2022-01-31 Thread Martijn Visser
Hi everyone, I would like to open up a vote to deprecate Cassandra in Flink 1.15 and remove it in the next version. I've previously mentioned that we were looking for maintainers for Cassandra, but so far none have come forward [1]. The vote will last for at least 72 hours, and will be accepted b

[VOTE] Deprecate NiFi connector

2022-01-31 Thread Martijn Visser
Hi everyone, I would like to open up a vote to deprecate NiFi in Flink 1.15 and remove it in the next version. I've previously mentioned that we were looking for maintainers for NiFi, but so far none have come forward [1]. The vote will last for at least 72 hours, and will be accepted by a consen

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Martijn Visser
Hi all, Thanks for your feedback. It's not about having this connector in the main repo, that has been voted on already. This is strictly about the connector itself, since it's not maintained and most probably also can't be used due to changes in Twitter's API that aren't reflected in our connecto

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Francesco Guardiani
Hi, I agree with the concern about having this connector in the main repo. But I think in general it doesn't harm to have a sample connector to show how to develop a custom connector, and I think that the Twitter connector can be a good candidate for such a template. It needs rework for sure, as i

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

2022-01-31 Thread Gabor Somogyi
Not sure if the mentioned write right already given or not but I still don't see any edit button. G On Fri, Jan 28, 2022 at 5:08 PM Gabor Somogyi wrote: > Hi Robert, > > That would be awesome. > > My cwiki username: gaborgsomogyi > > G > > > On Fri, Jan 28, 2022 at 5:06 PM Robert Metzger > wr

[jira] [Created] (FLINK-25893) ResourceManagerServiceImpl's lifecycle can lead to exceptions

2022-01-31 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-25893: - Summary: ResourceManagerServiceImpl's lifecycle can lead to exceptions Key: FLINK-25893 URL: https://issues.apache.org/jira/browse/FLINK-25893 Project: Flink

[jira] [Created] (FLINK-25892) Develop ArchUnit test for connectors

2022-01-31 Thread Jing Ge (Jira)
Jing Ge created FLINK-25892: --- Summary: Develop ArchUnit test for connectors Key: FLINK-25892 URL: https://issues.apache.org/jira/browse/FLINK-25892 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-25891) NoClassDefFoundError AsyncSSLPrivateKeyMethod in benchmark

2022-01-31 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-25891: - Summary: NoClassDefFoundError AsyncSSLPrivateKeyMethod in benchmark Key: FLINK-25891 URL: https://issues.apache.org/jira/browse/FLINK-25891 Project: Flink

[jira] [Created] (FLINK-25890) Implement scroll tracking on Flink documentation

2022-01-31 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-25890: -- Summary: Implement scroll tracking on Flink documentation Key: FLINK-25890 URL: https://issues.apache.org/jira/browse/FLINK-25890 Project: Flink Issue Ty

[jira] [Created] (FLINK-25889) Implement scroll tracking on Flink project website

2022-01-31 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-25889: -- Summary: Implement scroll tracking on Flink project website Key: FLINK-25889 URL: https://issues.apache.org/jira/browse/FLINK-25889 Project: Flink Issue

Re: [VOTE] FLIP-211: Kerberos delegation token framework

2022-01-31 Thread Márton Balassi
+1 (binding) Given [1] I consider the issue David raised resolved. Thanks David and please confirm here. [1] https://lists.apache.org/thread/cvwknd5fhohj0wfv8mfwn70jwpjvxrjj On Mon, Jan 24, 2022 at 11:07 AM David Morávek wrote: > Hi Gabor, > > Thanks for driving this. This is headed in a righ

[jira] [Created] (FLINK-25888) Capture time that the job spends on deploying tasks

2022-01-31 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-25888: Summary: Capture time that the job spends on deploying tasks Key: FLINK-25888 URL: https://issues.apache.org/jira/browse/FLINK-25888 Project: Flink I

[jira] [Created] (FLINK-25887) FLIP-193: Snapshots ownership follow ups

2022-01-31 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-25887: Summary: FLIP-193: Snapshots ownership follow ups Key: FLINK-25887 URL: https://issues.apache.org/jira/browse/FLINK-25887 Project: Flink Issue Type:

[jira] [Created] (FLINK-25886) Hard-coded ZK version in FlinkContainersBuilder#buildZookeeperContainer

2022-01-31 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-25886: Summary: Hard-coded ZK version in FlinkContainersBuilder#buildZookeeperContainer Key: FLINK-25886 URL: https://issues.apache.org/jira/browse/FLINK-25886 Proje