Dependency injection and flink.

Hi, I'm trying to integrate a dependency injection framework with flink. When I searched the user-mailing list, I found the following thread in flink which discussed this in the past: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Dependency-Injection-and-Flink-td18880.html S

Subtask distribution in Flink

Hi, I am trying to understand how subtask distribution works in Flink. Let's assume a setup of a Flink cluster with a fixed number of TaskManagers in a kubernetes cluster. Let's say I have a flink job with all the operators having the same parallelism and with the same Slot sharing group. The ope

Re: Subtask distribution in Flink

link/flink-docs-master/docs/ops/state/task_failure_recovery/ > > Best, > Weihua > > > On Mon, Mar 27, 2023 at 3:22 PM santhosh venkat < > santhoshvenkat1...@gmail.com> wrote: > > > Hi, > > > > I am trying to understand how subtask distribution work

Emitting metrics from Flink SQL LookupTableSource

Hi, We are trying to develop Flink SQL connectors in my company for proprietary data-stores. One problem we observed is that the Flink-SQL LookupTablesource/LookupFunction does not seem to have capabilities to emit any metrics(i.e there is no metric group wired into either through LookupSourceCont

Integrating new connector with Flink SQL.

Hi, Please correct me if I'm wrong anywhere. I'm just new to Flink and trying to navigate the landscape. Within my company, currently we're trying to develop a connector for our internal change data capture system(brooklin) for flink. We are planning to use Flink SQL as a primary API to build str

Re: Integrating new connector with Flink SQL.

nnector of the table is just a wrapper of DataStream. They > should not have core differences. > > I believe we should migrate KafkaDynamicSource to the new > source KafkaSource in the Flink 1.14. Maybe @Qingsheng Ren is working on > this. > > Best, > Jingsong > > On Thu,

Flink Kubernetes operator

Hi, I have a few questions about the Flink OSS Kubernetes operator. Apologies if they’re basic. 1. It seems like the auto-scaler logic is triggered as part of the operator reconciliation loop

Kubernetes operator questions

Hi, I am a newbie to the Flink-kubernetes operator. We are planning to adopt/use it in my company, and it would be great if someone can help answer my questions. 1. It seems like the kubernetes operator is coupled with the auto-scaler. The operator is managing the lifecycle of the Flink job