Is it possible?

For Dataset I've found [1] :

parameters.setBoolean("recursive.file.enumeration", true);
// pass the configuration to the data sourceDataSet<String> logs =
env.readTextFile("file:///path/with.nested/files")
                          .withParameters(parameters);


But can I achieve something similar with the Table SQL?

I have the following directory structure
/myfiles/20201010/00/00restoffilename1.csv
/myfiles/20201010/00/00restoffilename2.csv
...
/myfiles/20201010/00/00restoffilename3000.csv
/myfiles/20201010/01/01restoffilename1.csv
....
/myfiles/20201010/00/00restoffilename3000.csv

So for each day I have 255  subdirectories from 00 to  FF and each of those
directories can have 1000-3000 files and I would like to load all those
files in one go.

[1]:
https://ci.apache.org/projects/flink/flink-docs-stable/dev/batch/#recursive-traversal-of-the-input-path-directory

-- 
/Rubén

Reply via email to