Re: Recommended Download Directory for File Source

2023-09-17 Thread xiangyu feng
Hi Kirti, AFAIK, u should pay attention to how are the filesystems mounted on the pod instead of what should be configured as the tmp directory. In common cases, user may mount a filesystem with a small space(less than 30GB) for system and a filesystem with a large space(more than 200GB) to stor

Recommended Download Directory for File Source

2023-09-15 Thread Kirti Dhar Upadhyay K via user
Hello Guys, I am using Flink File Source with Amazon S3. AFAIK, File source first downloads the file in temporary location and then starts reading the file and emitting the records. By default the download location is /tmp directory. In case of containerized environment, where Pods have limited