Hi, I am working on pushing data to s3 from different kafka topics. My use-case is to push data in s3 every 15 mins or whenever window size exceeds X MBs. What is the simplest way to do this?
I am able to push data every 15 mins using windowing but I am not able to trigger the push function when window size exceeds X MBs. Triggering write based on number of events is not the correct parameter here since messages in kafka are of different size. Does anyone in the group has similar use-case? Any help is highly appreciated. -- Thanks, Rajneesh
