Samrat002 opened a new pull request, #27187:
URL: https://github.com/apache/flink/pull/27187

   ### Setup And Testing Details 
   
   1. POC is tested with the minio setup in local docker setup
   2. Used the wordCount Application to read from the minio bucket and write 
output to the minio output dir 
   3. Used streaming mode and enabled checkpointing to the MinIO bucket 
   
   ### Callout :
   1. Very minimal Unit test added in the patch. This patch is intended for poc 
purposes 
   2. Only tested with the WordCount Application. I am in progress to test the 
patch with an actual S3 bucket and a more genuine Flink application that reads 
from a Kafka topic and writes to S3, with checkpointing on S3 
   
   ### Outcome
   Able to verify read, write and checkpointing using the native-s3-filesystem
   
   Jobmanager log: 
https://drive.google.com/file/d/1lfEJRn9F-r72YgU_uyyQFlEg2VAN_3qJ/view?usp=sharing
   
   TaskManager log : 
   
[taskmanager-1.log](https://github.com/user-attachments/files/23292642/taskmanager-1.log)
   
   
   <img width="1512" height="868" alt="Screenshot 2025-11-03 at 1 19 35 AM" 
src="https://github.com/user-attachments/assets/8faaff1d-50ee-4aa7-86ef-4ccccae13c9e";
 />
   <img width="1512" height="916" alt="Screenshot 2025-11-03 at 1 19 59 AM" 
src="https://github.com/user-attachments/assets/0f0f6443-3cbb-47fa-9369-8ece3a525240";
 />
   <img width="1512" height="883" alt="Screenshot 2025-11-03 at 1 20 43 AM" 
src="https://github.com/user-attachments/assets/6e6070c3-f184-4d94-a82d-739d03eb309e";
 />
   
   <img width="1490" height="849" alt="Screenshot 2025-11-03 at 1 20 52 AM" 
src="https://github.com/user-attachments/assets/cc93579c-ce2c-4122-a8d0-d16ed6e51ea4";
 />
   <img width="1512" height="857" alt="Screenshot 2025-11-03 at 1 21 10 AM" 
src="https://github.com/user-attachments/assets/dde3487c-1354-41d1-8370-6be759c0aa32";
 />
   <img width="1503" height="867" alt="Screenshot 2025-11-03 at 1 22 27 AM" 
src="https://github.com/user-attachments/assets/ba20c473-d784-455b-8b90-8159b7b04961";
 />
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to