Hi all, we have a use case we are stuck on. We would like to take streaming input data and create files (s3) every XX minutes or when the size of records exceeds a size limit. the forRowFormate works great as the rolling policy supports both of these use cases.
However one missing feature is the ability to add a header into the files. The header would be static and the same across all files. We have looked into using forBulkFormat but then we lose the ability to control size and time as the rolling policy must be onCheckpoint. Does anyone have and ideas on how to implement this? Kyle
