Re: Clarification on checkpoint/savepoint usage with Kafka (and RabbitMQ)

2025-03-26 Thread Gabor Somogyi
> Are they two different things? There are no consumer and broker offsets, there are offsets which belong to a topic + partition pair. > And which offset is saved in the checkpoint/savepoint? Which Flink thinks is processed already. Regarding the PROD deploy now you know the risks so feel free to

Session Window Join in pyflink

2025-03-26 Thread Hugo POLSINELLI
Hello everyone, I've been struggling for a while to perform a session-window join using pyflink / SQL API. From my understanding it seems that the table API requires an equality on the window_start and window_end parameters. Unfortunately, in the case of session join (with static gap) it is rar

Re: Clarification on checkpoint/savepoint usage with Kafka (and RabbitMQ)

2025-03-26 Thread mejri houssem
Hello Gabor, Thanks for your response. I just want to clarify one thing: is there any difference between the Kafka source offset and the Kafka broker offset? Are they two different things? And which offset is saved in the checkpoint/savepoint? For our use case, we intend to take a savepoint only

Re: Submitting multiple DELETE statements in Flink SQL

2025-03-26 Thread Kirill Lyashko
Just adding user@flink.apache.org On Fri, 21 Mar 2025 at 19:08, Kirill Lyashko wrote: > Ok, I'll ask them as well, thanks. > > On Fri, 21 Mar 2025 at 18:16, Alexey Novakov wrote: > >> This is really weird. >> >> I would recommend you also to ask on Flink Dev List. This can be an >> outdated Fli

Kafka -< Paimon Action flow of Avro encoded data

2025-03-26 Thread George
Hi all... modified my producer to now avro encode both the key and the value of the message: on Control Center it's all looking good, also got past the magic byte problem. Getting the error as lower down though. Thinking I got my comment wrong, specifically with regard to the key.format and key

Re: Too long jobs recover after JobManager fail with Kubernetes HA

2025-03-26 Thread Vladislav Keda
Hi, We have identified the cause of the problem: ConfigMaps on the Kubernetes cluster were taking increasingly longer to update as the number of jobs grew (due to the expanding size of the ConfigMaps). The default value *high-availability.kubernetes.leader-election.retry-period=5s* was too frequen

Re: ssl certificate reload capabilities

2025-03-26 Thread Gabor Somogyi
Hi Nicolas, As I've suggested in the jira too a FLIP would be required because this is touching the hearth of the Flink authentication logic. In general +1 from my side to have such functionality just like we have in the operator. BR, G On Mon, Mar 10, 2025 at 9:49 AM Nicolas Fraison < nicolas.

Re: Slack invitation

2025-03-26 Thread Gabor Somogyi
I don't have access to fix this, hope the appropriate person will pick this up... G On Wed, Mar 26, 2025 at 9:57 AM Or Keren wrote: > Hi Gabor, > > Unfortunately not. > > [image: PastedGraphic-1.png] > > Thanks for the quick reply! > > On 26 Mar 2025, at 10:54, Gabor Somogyi wrote: > > Hi Or,

Re: Slack invitation

2025-03-26 Thread Or Keren
Hi Gabor, Unfortunately not.  Thanks for the quick reply! > On 26 Mar 2025, at 10:54, Gabor Somogyi wrote: > > Hi Or, > > Is the link in the official place [1] not working? > > [1] https://flink.apache.org/what-is-flink/community/#slack > > BR, > G > > > On Wed, Mar 26, 2025 at 9:44 AM

Re: Slack invitation

2025-03-26 Thread Gabor Somogyi
Hi Or, Is the link in the official place [1] not working? [1] https://flink.apache.org/what-is-flink/community/#slack BR, G On Wed, Mar 26, 2025 at 9:44 AM Or Keren wrote: > Hey, > > Can I can an invitation for your slack channel please? > > Thanks, > Or. >

RE: Slack invitation

2025-03-26 Thread Ariana Allison
Hi, Thanks for response . This Information is about the people who visit the show. Firstly, I will send you sample list ,look on it . The list is really helpful for your business. I will send you a sample list, check the list once and if you like it, please let me know. Please respond my emai

Slack invitation

2025-03-26 Thread Or Keren
Hey, Can I can an invitation for your slack channel please? Thanks, Or.