Hi, Totally missed that setFileEnumerator method. That definitely helps, I checked it out and this does what we were looking for.
Thanks FG! On Wed, Feb 2, 2022 at 3:07 AM Francesco Guardiani <france...@ververica.com> wrote: > Hi, > From what I see here > https://nightlies.apache.org/flink/flink-docs-release-1.14/api/java/org/apache/flink/connector/file/src/AbstractFileSource.AbstractFileSourceBuilder.html#setFileEnumerator-org.apache.flink.connector.file.src.enumerate.FileEnumerator.Provider- > the file enumerator can be setup with the FileSourceBuilder: > > fileSourceBuilder.setFileEnumerator(new FileEnumerator.Provider() { > @Override > public FileEnumerator create() { > // Do something > return null; > } > }) > > > Hope it helps, > FG >