Bowen Li created FLINK-10168:
--------------------------------
Summary: support filtering files by modified/created time in
StreamExecutionEnvironment.readFile()
Key: FLINK-10168
URL: https://issues.apache.org/jira/browse/FLINK-10168
Project: Flink
Issue Type: Improvement
Components: DataStream API
Affects Versions: 1.6.0
Reporter: Bowen Li
Fix For: 1.7.0
support filtering files by modified/created time in
{{StreamExecutionEnvironment.readFile()}}
for example, in a source dir with lots of file, we only want to read files that
is created or modified after a specific time.
This API can expose a generic filter function of files, and let users define
filtering rules. Currently Flink only supports filtering files by path.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)