Re: Pulsar connector 2.9.1 failing job submission in standalone.

2022-02-20 Thread Ananth Gundabattula
Thanks for the response Guowei. * Tried a telnet to the jobmanager host:port and I get “127.0.0.1:8086: nodename nor servname provided, or not known” which suggests that the network access is fine ? * I resubmitted the word count example and it ran fine to completion. For the pulsar sc

Re: Apache Flink - Continuously streaming data using jdbc connector

2022-02-20 Thread Guowei Ma
Hi, You can try flink's cdc connector [1] to see if it meets your needs. [1] https://github.com/ververica/flink-cdc-connectors Best, Guowei On Mon, Feb 21, 2022 at 6:23 AM M Singh wrote: > Hi Folks: > > I am trying to monitor a jdbc source and continuously streaming data in an > application

Re: Pulsar connector 2.9.1 failing job submission in standalone.

2022-02-20 Thread Guowei Ma
Hi, Ansanth I don't see any error logs on the server side, so it's hard to tell what the specific problem is. From the current log, there are two things to try first: 1. From the client's log, it is a 5-minute timeout, so you can telnet 127.0.0.1:8086 to see if there is a problem with the local n

Re: No effect from --allowNonRestoredState or "execution.savepoint.ignore-unclaimed-state" in K8S application mode

2022-02-20 Thread Yang Wang
By design, we should support arbitrary config keys via the CLI when using generic CLI mode. Do you have also specified the "--fromSavepoint" along with "--allowNonRestoredState" when submitting a Flink job via "flink run-application"? >From the current code base, it seems that the CLI options(e.g

Re: CVE-2021-44228 - Log4j2 vulnerability

2022-02-20 Thread Francis Conroy
The release notification email came out a few days ago. On Mon, 21 Feb 2022 at 14:18, Surendra Lalwani wrote: > Hi Team, > > Any updates on Flink 1.13.6 version release? > > Regards, > Surendra Lalwani > > > On Fri, Feb 4, 2022 at 1:23 PM Martijn Visser > wrote: > >> Hi Surendra, >> >> You ca

Re: CVE-2021-44228 - Log4j2 vulnerability

2022-02-20 Thread Surendra Lalwani
Hi Team, Any updates on Flink 1.13.6 version release? Regards, Surendra Lalwani On Fri, Feb 4, 2022 at 1:23 PM Martijn Visser wrote: > Hi Surendra, > > You can follow the discussion on this topic in the Dev mailing list [1]. I > would expect it in the next couple of weeks. > > Best regards, >

Pulsar connector 2.9.1 failing job submission in standalone.

2022-02-20 Thread Ananth Gundabattula
Hello All, I have a Pyflink script that needs to read from Pulsar and process the data. I have done the following to implement a prototype. 1. Since I need Pyflink way to connect to Pulsar , I checked out the code from master branch as advised in a different thread. (PyFlink Pulsar connecto

Apache Flink - Continuously streaming data using jdbc connector

2022-02-20 Thread M Singh
Hi Folks: I am trying to monitor a jdbc source and continuously streaming data in an application using the jdbc connector.  However, the application stops after reading the data in the table. I've checked the docs (https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/jdbc/)

Re: How to flatten ARRAY in Table API

2022-02-20 Thread Matthias Broecheler
Thank you, David, that's what I had been looking for! On Sun, Feb 20, 2022 at 3:52 AM David Anderson wrote: > Matthias, > > You can use a CROSS JOIN UNNEST, as mentioned very briefly in the docs [1]. > > Something like this should work: > > SELECT > id, customerid, productid, quantity, ... > F

Flink Statefun and Feature computation

2022-02-20 Thread Federico D'Ambrosio
Hello everyone, It's been quite a while since I wrote to the Flink ML, because in my current job never actually arose the need for a stateful stream processing system, until now. Since the last version I actually tried was Flink 1.9, well before Stateful Functions, I had a few questions about som

Re: How to flatten ARRAY in Table API

2022-02-20 Thread David Anderson
Matthias, You can use a CROSS JOIN UNNEST, as mentioned very briefly in the docs [1]. Something like this should work: SELECT id, customerid, productid, quantity, ... FROM orders CROSS JOIN UNNEST(entries) AS items (productid, quantity, unit_price, discount); [1] https://nightlies.apache.or

Job Manager High Availability using Kubernetes HA Services is not working with custom S3 encrypted client

2022-02-20 Thread Almog Rozencwajg
Hi, We are using Flink version 1.12.2 running on Kubernetes using native Kubernetes integration. We are trying to use the job manager HA describes in the Flink official documentation Kubernetes HA Services

Re: Fwd: How to get memory specific metrics for tasknodes

2022-02-20 Thread Sigalit Eliazov
Hello. Related metric issue. I am looking for a way to expose flink metrics via opentelemerty to the gcp could monitoring dashboard. Does anyone has experience with that? Thanks בתאריך יום ו׳, 18 בפבר׳ 2022, 21:55, מאת Chesnay Schepler ‏< ches...@apache.org>: > As I said, this is not possible. I