Currently the BucketingSink allows addition of part prefix, pending 
prefix/suffix and in-progress prefix/suffix via setter methods. Can we also 
support setting part suffixes?
An instance where this maybe useful: I am currently writing GZIP compressed 
output to S3 using the BucketingSink and I would want the uploaded files to 
have a ".gz" or ".zip" extensions (if the files does not have such an 
extensionelse they are written as garbled bytes and don't get rendered 
correctly for reading). I don't see a way of doing this apart from setting a 
part file prefix with the required file extension.  

Thanks
Lakshmi

Reply via email to