Pushed a fix to the master and will open a PR to programmatically fix this.
On Tue, May 26, 2015 at 4:22 PM, Flavio Pompermaier
wrote:
> Yeap, that definitively solves the problem! Could you make a PR to fix
> that..?
>
> Thank you in advance,
> Flavio
>
> On Tue, May 26, 2015 at 3:20 PM, Maximi
Yeap, that definitively solves the problem! Could you make a PR to fix
that..?
Thank you in advance,
Flavio
On Tue, May 26, 2015 at 3:20 PM, Maximilian Michels wrote:
> Yes, there is a loop to recursively search for files in directory but that
> should be ok. The code fails when adding a new In
Yes, there is a loop to recursively search for files in directory but that
should be ok. The code fails when adding a new InputSplit to an ArrayList.
This is a standard operation.
Oh, I think I found a bug in `addNestedFiles`. It does not pick up the
length of the recursively found files in line 5
I have 10 files..I debugged the code and it seems that there's a loop in
the FileInputFormat when files are nested far away from the root directory
of the scan
On Tue, May 26, 2015 at 2:14 PM, Robert Metzger wrote:
> Hi Flavio,
>
> how many files are in the directory?
> You can count with "find
Hi Flavio,
how many files are in the directory?
You can count with "find /tmp/myDir | wc -l"
Flink running out of memory while creating input splits indicates to me
that there are a lot of files in there.
On Tue, May 26, 2015 at 2:10 PM, Flavio Pompermaier
wrote:
> Hi to all,
>
> I'm trying to
