Hi Fabian, Thanks for creating and sharing that ticket. I noticed the clause "The FileSource can already read the state of the previous version", a little off-topic from the original topic of this thread but I was wondering if you could elaborate on that. Can the new FileSource interoperate with the old .readFile operator state? Is there a smooth way to upgrade to the new FileSource API from the old one without losing state?
Thanks! On Mon, Jan 10, 2022 at 7:20 AM Fabian Paul <fp...@apache.org> wrote: > Hi Kevin, > > I created a ticket to track the effort [1]. Unfortunately, we are > already in the last few weeks of the release cycle for 1.15 so I > cannot guarantee that someone can implement it until then. > > Best, > Fabian > > [1] https://issues.apache.org/jira/browse/FLINK-25591 > > On Fri, Jan 7, 2022 at 5:07 PM Kevin Lam <kevin....@shopify.com> wrote: > > > > Hi all, > > > > Are there any plans to update StreamExecutionEnvironment.readFiles to > use the new FLIP-27 compatible FileSource? > > > > readFiles supports some features via it's FileInputFormat like > setNestedFileEnumeration and setFilesFilter that we'd be interested in > continuing to use but it seems FileSource doesn't have that. >
