Hi Kurt, Are you looking for Hybridsource[1], please see more information in document[1]. Hope it helps.
[1] https://ci.apache.org/projects/flink/flink-docs-master/docs/connectors/datastream/hybridsource/ Best, JING ZHANG Kurtis Walker <kurtis.wal...@sugarcrm.com> 于2021年10月22日周五 上午9:33写道： > I have a case where my Flink job needs to consume multiple sources. I > have a topic in Kafka where the order of consuming is important. Because > the cost of S3 is much less than storage on Kafka, we have a job that sinks > to S3. The topic in Kafka can then retain just 3 days worth of data. My > job needs to first consume everything from the existing S3 file(s) and only > then start consuming from the Kafka topic. When using a union operator in > Flink, the data comes in mixed from both sources. Is there any way that I > can control the ordering so that it first reads S3, then Kafka all in the > same job? > > > > Kurt >
