Re: Queries/Help regarding limitations on File source

2023-04-13 Thread Shammon FY
Hi Kirti For the watermark problem, I think the description in the document mainly refers to the out-of-order data between multiple files. This will result in a large number of late events [1], which will generate a large number of retract events, and late events out of time will be discarded. [1

Queries/Help regarding limitations on File source

2023-04-13 Thread Kirti Dhar Upadhyay K via user
Hi, I am using Data stream file source connector in one of my use case. I was going through the documentation where I found below limitations: https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/filesystem/#current-limitations 1. Watermarking does not work very wel