Hi, I am not able to roll the files based on file size as the bulkFormat has onCheckpointRollingPolicy.
One way is to write CustomStreamingFileSink and provide RollingPolicy like RowFormatBuilder. Is this the correct way to go ahead ? Another way is to write ParquetEncoder and use RowFormatBuilder. P.S. Curious to know Why was the RollingPolicy not exposed in case of BulkFormat ? Regards, Vinay Patil