Filesystem as a stream source in Table/SQL API

[eef hhj]

Hi,

I'm facing a situation where I want the Flink App to dynamically detect the
change of the Filesystem batch data source. As I tried in the following
example in sql-client.sh, it can query all the records under the folder for
the select.

While I'm adding a new file to the folder, the query does not refresh and
it seems it cannot detect the new file. It can only reflect records in the
new file unless I cancel the current query and do select again. Is it
possible to make the App detect such file changes automatically as the one
in the stream source?

CREATE TABLE fs_table (
  user_id STRING,
  order_amount DOUBLE,
  dt STRING,
  hh STRING,
)  WITH (
  'connector'='filesystem',
  'path'='file:///path/folder/',
  'format'='csv'
);

select * from fs_table;

-- Best wishes
Kai