Re: NodePort conflict for multiple HA application-mode standalone Kubernetes deploys in same namespace

2022-07-24 Thread Yang Wang
Removing the nodePort for every different Flink application is necessary so that it could pick up a random port. Moreover, I believe you also need to change some other yamls. For example, having a different name for JobManager/TaskManager yamls, update the jobmanager-service.yaml and flink-configu

Re: [ANNOUNCE] Apache Flink Kubernetes Operator 1.1.0 released

2022-07-24 Thread Yang Wang
Congrats! Thanks Gyula for driving this release, and thanks to all contributors! Best, Yang Gyula Fóra 于2022年7月25日周一 10:44写道: > The Apache Flink community is very happy to announce the release of Apache > Flink Kubernetes Operator 1.1.0. > > The Flink Kubernetes Operator allows users to manage

[ANNOUNCE] Apache Flink Kubernetes Operator 1.1.0 released

2022-07-24 Thread Gyula Fóra
The Apache Flink community is very happy to announce the release of Apache Flink Kubernetes Operator 1.1.0. The Flink Kubernetes Operator allows users to manage their Apache Flink applications and their lifecycle through native k8s tooling like kubectl. Please check out the release blog post for

Re: PyFlink SQL: force maximum use of slots

2022-07-24 Thread Dian Fu
>> I understand that in the Datastream world parallelism means each slot will get a subset of events. However, how does that work in the SQL world where you need to do joins between tables? In Table API & SQL, each slot will also only get a subset of events. >> If the events in tables A and B are

Re: Decompressing RMQ streaming messages

2022-07-24 Thread Francis Conroy
Hi Venkat, I guess you're using another compression algorithm which isn't zlib, you'll have to adapt the code to work with your algorithm of choice. Kind regards, Francis On Fri, 22 Jul 2022 at 17:27, Ramana wrote: > Hi Francis - Thanks for the snippet. I tried using the same, however I get >

Re: Write JSON string to JDBC as JSONB?

2022-07-24 Thread John Tipper
There may well be a better way, but I've been able to achieve this by executing the following in the DB: CREATE CAST(VARCHAR AS JSONB) WITH INOUT AS IMPLICIT; I think you can also probably do CREATE CAST(VARCHAR AS JSONB) WITHOUT FUNCTION AS IMPLICIT; However, I am working in AWS and AWS does

Write JSON string to JDBC as JSONB?

2022-07-24 Thread John Tipper
Hi all, I am using PyFlink and SQL and have a JSON string that I wish to write to a JDBC sink (it's a Postgresql DB). I'd like to write that string to a column that is of type JSONB (or even JSON). I'm getting exceptions when Flink tries to write the column: Batch entry 0 INSERT INTO my_table(

Re: NodePort conflict for multiple HA application-mode standalone Kubernetes deploys in same namespace

2022-07-24 Thread Javier Vegas
Partial answer to my own question: Removing the hardcoded `nodePort: 30081` entry from jobmanager-rest-service.yaml, Flink assigns random ports so there are no conflicts and multiple Flink application-mode jobs can be deployed. However the jobs seem to communicate with each other, when launching th