RE: Sharing data among flink operator pipeline

2025-08-25 Thread Kamal Mittal via user
Ok thanks. From: Kyle Lahnakoski Sent: 25 August 2025 18:51 To: Kamal Mittal ; user@flink.apache.org Subject: Re: Sharing data among flink operator pipeline You don't often get email from kyle.lahnako...@xe.com. Learn why this is important<https://aka.ms/LearnAboutSenderIdentificatio

Re: Sharing data among flink operator pipeline

2025-08-25 Thread Kyle Lahnakoski via user
@flink.apache.org Subject: RE: Sharing data among flink operator pipeline No, I am not talking about Kafka Message Key. Rather key/value pair which comes separately as below. Headers org.apache.kafka.clients.consumer.ConsumerRecord.headers() From: Nikola Milutinovic Sent: 25 August 2025 14:56 To: user

RE: Sharing data among flink operator pipeline

2025-08-25 Thread Kamal Mittal via user
No, I am not talking about Kafka Message Key. Rather key/value pair which comes separately as below. Headers org.apache.kafka.clients.consumer.ConsumerRecord.headers() From: Nikola Milutinovic Sent: 25 August 2025 14:56 To: user@flink.apache.org Subject: Re: Sharing data among flink operator

Re: Sharing data among flink operator pipeline

2025-08-25 Thread shenzhongwei
unsubscribe 原始邮件 发件人:Nikola Milutinovic

Re: Sharing data among flink operator pipeline

2025-08-25 Thread Nikola Milutinovic
Hi Kamal. When you say “Kafka Headers”, are you referring to “Kafka Message Key”? In Kafka, messages come as Key/Value pairs. You can omit the key, but if you do have it, you can read it in the job and then use it when writing to the other topic. Nix. From: Kamal Mittal via user Date: Thursd

Re: Sharing data among flink operator pipeline

2025-08-21 Thread shenzhongwei
unsubscribe 原始邮件 发件人:Pedro Mázala

Re: Sharing data among flink operator pipeline

2025-08-21 Thread Pedro Mázala
Hello there, Kamal! Whenever I need to keep passing data downstream, I reflect it on my POJO. Usually, I call those fields metadata and access them downstream. The state will also segment data by operator, in other words, an operator cannot access stored data from other operators (unless you use b