With the Kafka Connect S3 sink, I can choose Avro or JSON output format. Is there any chance that Parquet will be supported?
For record at a time processing, Parquet isn't a good fit. But for reading/writing batches of records, which is what the Kafka Connect Sink is writing, Parquet is generally better than Avro. Would attempting writing support for this be wise to try or not?