Re: [DISCUSS][FLIP-536] Add latest checkpoint details endpoint to Rest API

2025-07-18 Thread Poorvank Bhatia
Hi Ahmed, Thank you for the FLIP. +1 (non-binding) for this feature. I have two implementation questions: 1. Approach for finding latest checkpoints: Since the FLIP mentions "utilizing existing CheckpointStatsCache,

Looking for reviewers and voters for flink-connector-aws v5.1.0 release

2025-07-18 Thread Daren Wong
Hi devs, The vote thread for flink-connector-aws v5.1.0 RC1 is open at https://lists.apache.org/thread/5zpjy2s1gxjlm9q8n5w52lg3gxsgfgdp A few devs and I have tested it and shared the results on the thread, and currently looking for more reviewers, testers and voters. If you are interested to

[jira] [Created] (FLINK-38120) FLIP-536 Add latest checkpoint details endpoint

2025-07-18 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-38120: --- Summary: FLIP-536 Add latest checkpoint details endpoint Key: FLINK-38120 URL: https://issues.apache.org/jira/browse/FLINK-38120 Project: Flink Issue Type: Imp

[DISCUSS][FLIP-536] Add latest checkpoint details endpoint to Rest API

2025-07-18 Thread Ahmed Hamdy
Hi Devs, I would like to start a discussion on FLIP-536[1] for adding a "latest" checkpoint details endpoint to Flink's REST Api. This is a common case I have personally encountered when integrating components with Flink using the Rest API. Let me know your thoughts. 1- https://cwiki.apache.org/c

2025/07/17 CHI Eastern time zone workgroup meeting minutes

2025-07-18 Thread David Radley
Hi , Disussed ongoing work around onboarding the http connector. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=373886222 The 2025/07/17 CHI Eastern time zone workgroup meeting minutes are Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales

Re: [DISCUSS][FLIP-536] Add latest checkpoint details endpoint to Rest API

2025-07-18 Thread David Radley
Hi Ahmed, Thanks for submitting this Flip. What do you think of having /jobs/:jobid/checkpoints with query params to specify sorted criteria and direction and the number of returned elements (page size). This would appear to be more of a standard (and flexible) way of doing a search. To get the

Re: [DISCUSS][FLIP-536] Add latest checkpoint details endpoint to Rest API

2025-07-18 Thread Ahmed Hamdy
Hi David, Thanks for the feedback, I guess an alternative approach would be adding paging and sorting to the checkpointing stats query, however this will still require 2 REST api calls to get the latest checkpoint details as the stats endpoint only gives a summary not the details, I am open to addi