Hey! These files are the spilled data from a sort, a hash table, or a cache, when memory runs short.
If you have some very big files and some 0 sized, I would guess you are running a Hash Join, and have heavy skew in the distribution of the keys. Greetings, Stephan On Wed, Oct 21, 2015 at 12:50 PM, Flavio Pompermaier <pomperma...@okkam.it> wrote: > Hi to all, > > what information can I infer from the files contained in the flink-io-xxx > dir? > what does represent each channel file and what does it mean when there are > a lot of 0-size files and some very big files..? > > Best, > Flavio >
