Hi Martin,
So sorry about the late response to this email. I was on leave for all of
August and haven't had a chance to get back to this.
I don't think any existing operators are suitable to me that I know of. I'm
using the ContinuousFileReaderOperator to read large files as it was
designed for,
Hi Darin,
Your comment "I think our use case is rather unique and I'm not sure who
else would benefit" makes me think then why we should actually support it
in Flink, given that you're mentioning the use case is rather unique?
Especially since the SourceFunction has many flaws, and has been long
o
I wanted to bump this request from last year. As I understand it the new
FileSource is not suitable for my existing use case.
The TLDR is that we have extensively customized/extended the file splits
and input formats so a single ContinuousFileReaderOperator can handle
non-homogenous files and acts
