Re: StreamingFileSink output formatting to CSV

2021-06-03 Thread Chesnay Schepler
This is handled by the StringEncoder; the one you use (SimpleStringEncoder) just calls toString on the input element. I don't think Flink provides a CSV StringEncoder, but if all you want is remove the parenthesis, then you could wrap the SimpleStringEncoder and trim the first and last charact

StreamingFileSink output formatting to CSV

2021-06-03 Thread Robert Cullen
I have a StreamingFileSink that writes to S3: final StreamingFileSink> sink = StreamingFileSink.forRowFormat( new Path("s3://argo-artifacts/files"), new SimpleStringEncoder>("UTF-8")) .withBucketAssigne