Hi Alex and Yang,
Apologies for the delayed reply…
Yes I’d also love to share/exchange ideas. I’ll have a FLIP ready between this
week and the next and we could continue the conversation there, does that sound
good?
Alex N. Indeed your solution sounds extremely similar! Let’s see what common
Thanks Alexander for looking into email.
- Should this reusable ProcessFunction filter out data or simply tag
>them? For example, filtering data for green deployments would be
> suitable
>in the case of Async IO outputs.
Consider a Flink job that mutates data in an external service us
Hi Alex,
- Should this reusable ProcessFunction filter out data or simply tag
>them? For example, filtering data for green deployments would be
> suitable
>in the case of Async IO outputs.
Could you clarify the idea a bit more, it is not quite clear what you mean.
- Should we also
Hello Sergio and Jose,
Apologies for jumping into the conversation. I’m very interested in what
you’ve learned about blue/green Flink deployments. I’m currently working on
a project aimed at achieving no-downtime Flink deployments, so your
insights would be highly valuable.
Thank you,
Yang
>> Hi Sergio,
>> >> +1 for starting a FLIP.
>> >> I am wondering how non zero values for table.exec.source.idle-timeout
>> and
>> >> table.exec.state.ttl side effects, as they are based on clock time. It
>> will
>> >> be interest
> table.exec.state.ttl side effects, as they are based on clock time. It
> will
> >> be interesting to identify these less stable scenarios and see what we
> can
> >> do with them.
> >>
> >> Kind regards, David.
> >>
> >>
> >&
> Date: Wednesday, 4 December 2024 at 09:56
>> To: schong...@apple.com.invalid
>> Cc: dev@flink.apache.org
>> Subject: [EXTERNAL] Re: Blue/Green Deployments support for Flink
>> Hi Sergio,
>>
>> Out of the box blue/green deployments would be a great
egards, David.
>
>
>
>
> From: Maximilian Michels
> Date: Wednesday, 4 December 2024 at 09:56
> To: schong...@apple.com.invalid
> Cc: dev@flink.apache.org
> Subject: [EXTERNAL] Re: Blue/Green Deployments support for Flink
> Hi Sergio,
>
> Out of the box blue/green de
, David.
From: Maximilian Michels
Date: Wednesday, 4 December 2024 at 09:56
To: schong...@apple.com.invalid
Cc: dev@flink.apache.org
Subject: [EXTERNAL] Re: Blue/Green Deployments support for Flink
Hi Sergio,
Out of the box blue/green deployments would be a great addition to Flink.
+1 for
Hi Sergio,
Out of the box blue/green deployments would be a great addition to Flink.
+1 for starting a FLIP. That will allow us to better describe the
architecture and flesh out the technical details. I reckon the handover
between the two pipelines is going to be the most difficult part.
Particul
Hi Danny… and community,
At this point would it make sense for me to begin putting a FLIP together with
more details and perhaps continue the conversation from there?
Thanks,
Sergio
> On Nov 30, 2024, at 7:29 AM, Sergio Chong Loo wrote:
>
> Hey Danny
>
> Thanks for digging deeper into this t
Hey Danny
Thanks for digging deeper into this topic!
Indeed we’ve been giving a thought to most of these points but you’ve raised a
couple of interesting ones, here are some ideas (inline):
> On Nov 27, 2024, at 4:00 AM, Danny Cranmer wrote:
>
> Hello Sergio,
>
> Thankyou for starting this
Hello Sergio,
Thankyou for starting this discussion, I have a few questions.
> having 2 identical pipelines running side-by-side
How do you ensure correctness between the 2 identical pipelines? For
example, processing time semantics or late data can result in different
outputs.
Some Sources have
13 matches
Mail list logo
