RE: Flink Kubernetes Operator Application mode multiple jobs

Hi Raihan, We have encountered the same issue though we are using Flink Kubernetes Operator 1.6. Biao Geng's explanation is correct. We also have a detailed briefing in this jira ticket but it seems that submitting multiple jobs is not allowed b

Re:Is there open requests to support Redis Datastream connector

Hi, Tony. There are some related works in Flink commu to support Redis source / sink connector. You can see more here[1][2][3][4]. However, these JIRAs are still WIP. The good news is that the PR in jira[1] is already available. You can directly download the PR and package it into a conn

Re:Re: Evolving Flink SQL statement set and restoring from savepoints

Hi, if the processing logic is modified, then the representation of the topology would change. Consequently, the UIDs that are determined by the topological order might change as well, which could potentially cause state recovery to fail. For further details, you can refer to [1]. Currently, th

Is there open requests to support Redis Datastream connector

Hi team, I need a Redis sink connector for my Flink app but the best I can find is from Bahir, which is deprecated. I am wondering if someone in the community is wor

Re: Issue in PrefetchCount

Hi ajay, When you have 3 parallelisms you will have 3 independent clients. If you want to keep prefetch count 3 you need to set setRequestedChannelMax as 1 and setParallelism 3. So All 3 clients can have one connection. Talat On Tue, May 7, 2024 at 5:52 AM ajay pandey wrote: > Hi Flink Team, >

Re: Exception in Flink 1.18 (Time should be non negative)

Hi Lasse, If there's a significant difference in the system time between Flink TaskManagers, it can lead to negative time calculations when comparing timestamps from different sources. On Mon, May 6, 2024 at 5:40 AM Lasse Nedergaard < lassenedergaardfl...@gmail.com> wrote: > Hi. > > In Flink job

Re: Evolving Flink SQL statement set and restoring from savepoints

Hi Keith, When you add a new insert statement to your EXECUTE STATEMENT you change your job graph with independent two graphs.Unfortunately, Flink doesn't currently provide a way to directly force specific UIDs for operators through configuration or SQL hints. This is primarily due to how Flink's

Re: Flink Kubernetes Operator Application mode multiple jobs

Hi Raihan, I believe the flink k8s operator has some implicit assumption that each application should contain only one job so that it can manage the lifecycle of the job reasonably. Your usage of deploying multiple jobs in a single python file(i.e. in a single flink application) may be not preferr

RE: [EXTERNAL] Re: Coordinator of operator ... does not exist or the job vertex this operator belongs to is not initialized.

Hi Biao, I figured that the error happens only when there is a JOIN in the select. But I will put together a simple example. Thank you, Ed Skhisov Architect | www.intradiem.com 303.588.2518 Mailing Address: 2500 Dallas Hwy Ste 202, Dept #37049 Marietta, GA 30064 [ci

Evolving Flink SQL statement set and restoring from savepoints

Hello, I'm running into issues restoring from savepoint after changing SQL statement. [ERROR] Could not execute SQL statement. Reason: > java.lang.IllegalStateException: Failed to rollback to > checkpoint/savepoint > file:/tmp/flink-savepoints/savepoint-52c344-3bedb8204ff0. Cannot map > checkpoin