Confluent Kafka conection error

2023-11-22 Thread Tauseef Janvekar
Dear Team, We are facing the below issue while connecting to confluent kafka Can someone please help here. 2023-11-23 06:09:36,989 INFO org.apache.flink.runtime.executiongraph. ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out (1/1) (496f859d5379cd751a3fc473625125f3_cbc357c

Re: [PyFlink] Collect multiple elements in CoProcessFunction

2023-11-22 Thread Alexander Fedulov
Hi David, Thanks for the confirmation. Let's fix the docs: https://github.com/apache/flink/pull/23776 Thanks, Alex On Sun, 19 Nov 2023 at 01:55, David Anderson wrote: > Hi, Alex! > > Yes, in PyFlink the various flatmap and process functions are implemented > as generator functions, so they us

Re: Is RestClusterClient recommended?

2023-11-22 Thread Chesnay Schepler
Don't use the RestClusterClient; you can generate one from the openapi spec (see the docs). On 16/11/2023 20:36, Adrian Alexandru Vasiliu wrote: Hello, For a programmatic use in Java of the Flink REST API, which of these options would be the best choice? 1. Direct use via a REST client 2.

Error while trying to connect to Kafka from Flink runner

2023-11-22 Thread Поротиков Станислав Вячеславович via user
Hello! I am trying to run Beam pipeline in local docker-compose environment on top of Flink. I wrote my own Dockerfile for Flink jobmanager and taskmanager. I need to connect to secure Kafka cluster through kerberos. Dockerfile for my-image-apache-beam/flink:1.16-java11: FROM flink:1.16-java11

[ANNOUNCE] Apache Flink Kubernetes Operator 1.7.0 released

2023-11-22 Thread Gyula Fóra
The Apache Flink community is very happy to announce the release of Apache Flink Kubernetes Operator 1.7.0. The Flink Kubernetes Operator allows users to manage their Apache Flink applications and their lifecycle through native k8s tooling like kubectl. Release highlights: - Standalone autoscale