s or directories
> - Base directory + regex that matches contained file paths
>
>
>
> On Wed, Jul 1, 2015 at 10:13 AM, Flavio Pompermaier
> wrote:
>
>> +1 :)
>>
>> On Wed, Jul 1, 2015 at 10:08 AM, chan fentes
>> wrote:
>>
>>> Thank you a
>> Is there a specific reason why you create 1500 separate sources?
>>
>> Regards,
>> Aljoscha
>>
>> On Tue, 30 Jun 2015 at 17:17 chan fentes wrote:
>>
>>> Hello,
>>>
>>> how many data sources can I use in one Flink plan? Is ther
Hello,
how many data sources can I use in one Flink plan? Is there any limit? I
get an
java.lang.OutOfMemoryException: unable to create native thread
when having approx. 1500 files. What I basically do is the following:
DataSource ->Map -> Map -> GroupBy -> GroupReduce per file
and then
Union -> G