jinshuangxian created FLINK-27816:
-------------------------------------

             Summary: file source reader has Some requirements
                 Key: FLINK-27816
                 URL: https://issues.apache.org/jira/browse/FLINK-27816
             Project: Flink
          Issue Type: Improvement
    Affects Versions: 1.15.0
            Reporter: jinshuangxian


I use the flink sql file-system connector to consume data, write it to object 
storage, and use the file-system consumption to process the data in the object 
storage. The whole process works fine. I have 2 new requirements:
1. can I specify a timestamp to consume files within a specified time range
2. It is hoped that the data written to the object storage can be ordered in 
the partition (for example, partitioned according to the device id), and the 
file source reader can consume the files in an orderly manner similar to kafka 
when consuming files.
Can some enhancements be made to the file source reader?



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to