Hi. I have a streaming job that writes to StreamingFileSink.forRowFormat(...) with an encoder that converts protocol buffers to byte arrays.
How do read this data back in during a batch pipeline (using DataSet)? Do I use env.readFile with a custom DelimitedInputFormat? The streamfile sink documentation <https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/streamfile_sink.html> is a bit vague. These files are used as raw logs. They're processed offline and the whole record is read and used at the same time. Thanks! - Dan <https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/streamfile_sink.html>