Re: Proposal to modify Flink’s startup sequence for MINIMUM downtime across deployments

2024-03-19 Thread Asimansu Bera
nk committers and experts to comment as I may have completely misunderstood the problem and internal operations. -A On Tue, Mar 19, 2024 at 1:52 PM Asimansu Bera wrote: > Hello Sergio, > I'm a newbie(not an expert) and give it a try. > > If I presume you've only a reference

Re: Proposal to modify Flink’s startup sequence for MINIMUM downtime across deployments

2024-03-19 Thread Asimansu Bera
Hello Sergio, I'm a newbie(not an expert) and give it a try. If I presume you've only a reference state on Flink and no other states and Kafka is the source, you may see below approach as an option , should test. a. Create two applications - Primary and Secondary (blue and green) b. Create two S3

Apache Flink : Vector database connector

2024-03-16 Thread Asimansu Bera
Hello Dev, Vector databases like Waveiate are utilized in GenAI-based applications to store vector data in numeric format, supporting CRUD operations. Write-ahead logging (WAL) is employed to capture any changes made to the vector databases. For streaming-based applications, it's uncertain if trac