Re: [DISCUSS] FLIP-XXX: Blue/Green Deployments for Flink on Kubernetes: Phase 2 (with Coordination)

FLIP-504: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=337677650 - Sergio > On Jan 13, 2025, at 3:16 PM, Sergio Chong Loo wrote: > > Hi folks, > > As mentioned in [1], this FLIP represents the 2nd phase to add Blue/Green > deployments support. >

Re: [DISCUSS] FLIP-XXX: Blue/Green Deployments for Flink on Kubernetes: Phase 1 (basic)

FLIP-503: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=337677648 - Sergio > On Jan 13, 2025, at 2:39 PM, Sergio Chong Loo wrote: > > Hi folks, > > As proposed in [1] we would like to more formally continue the discussion to > add Blue/Green deployment

[DISCUSS] FLIP-XXX: Blue/Green Deployments for Flink on Kubernetes: Phase 2 (with Coordination)

Hi folks, As mentioned in [1], this FLIP represents the 2nd phase to add Blue/Green deployments support. This phase adds the capability to coordinate, in a more granular and extensible way, the transition between the 2 jobs. Here’s the Google Doc: https://docs.google.com/document/d/1ee-75ZFp

[DISCUSS] FLIP-XXX: Blue/Green Deployments for Flink on Kubernetes: Phase 1 (basic)

Hi folks, As proposed in [1] we would like to more formally continue the discussion to add Blue/Green deployments support to Flink via the Kubernetes Operator. For clarity and easier review experience we’ve separated this effort into 2 phases: 1) Blue/Green Deployments for Flink on Kubernetes:

Re: Blue/Green Deployments support for Flink

Hi Alex and Yang, Apologies for the delayed reply… Yes I’d also love to share/exchange ideas. I’ll have a FLIP ready between this week and the next and we could continue the conversation there, does that sound good? Alex N. Indeed your solution sounds extremely similar! Let’s see what common

Re: Blue/Green Deployments support for Flink

addition to Flink. >> >> +1 for starting a FLIP. That will allow us to better describe the >> architecture and flesh out the technical details. I reckon the handover >> between the two pipelines is going to be the most difficult part. >> Particularly, how to ensure that bo

Re: Blue/Green Deployments support for Flink

Hi Danny… and community, At this point would it make sense for me to begin putting a FLIP together with more details and perhaps continue the conversation from there? Thanks, Sergio > On Nov 30, 2024, at 7:29 AM, Sergio Chong Loo wrote: > > Hey Danny > > Thanks for digging d

Re: Blue/Green Deployments support for Flink

- Blue’s Gate will gradually start emitting records as soon as each subtask’s Watermark crosses the configured transition value > > Thanks, > Danny > > On Mon, Nov 25, 2024 at 6:25 PM Sergio Chong Loo > wrote: >> >> Hi, >> >> As part of ou

Re: Proposal to modify Flink’s startup sequence for MINIMUM downtime across deployments

inimum downtime. Down side is, you need >> to maintain two S3 buckets. >> >> I leave it to Flink committers and experts to comments as I may have >> completely misunderstood the problem and internal operations. >> >> -A >> >> On Tue, Mar 19, 2

Proposal to modify Flink’s startup sequence for MINIMUM downtime across deployments

Hello Flink Community, We have a particular challenging scenario, which we’d like to run by the rest of the community experts and check 1. If anything can be done with existing functionality that we’re overlooking, or 2. The feasibility of this proposal. I tried to keep it concise in a 1-pager