Hi Darshan, In a distributed scenario, there is no limit in theory, but there are still some real-world conditions that will cause some constraints, such as the size of your individual files, the memory size of your TM configuration, and so on. In addition, your "single" here is logical or physical, I mean, is it physically multiple parallel source sub task instances?
Thanks, vino. Darshan Singh <darshan.m...@gmail.com> 于2018年8月14日周二 上午3:01写道： > Hi Guys, > > Is there a limit on number of files flink dataset can read? My question is > will there be any sort of issues if I have say millions of files to read to > create single dataset. > > Thanks >
