Re: OutOfMemoryException: unable to create native thread

2015-07-17 Thread chan fentes
s or directories > - Base directory + regex that matches contained file paths > > > > On Wed, Jul 1, 2015 at 10:13 AM, Flavio Pompermaier > wrote: > >> +1 :) >> >> On Wed, Jul 1, 2015 at 10:08 AM, chan fentes >> wrote: >> >>> Thank you a

Re: OutOfMemoryException: unable to create native thread

2015-07-01 Thread chan fentes
>> Is there a specific reason why you create 1500 separate sources? >> >> Regards, >> Aljoscha >> >> On Tue, 30 Jun 2015 at 17:17 chan fentes wrote: >> >>> Hello, >>> >>> how many data sources can I use in one Flink plan? Is ther

OutOfMemoryException: unable to create native thread

2015-06-30 Thread chan fentes
Hello, how many data sources can I use in one Flink plan? Is there any limit? I get an java.lang.OutOfMemoryException: unable to create native thread when having approx. 1500 files. What I basically do is the following: DataSource ->Map -> Map -> GroupBy -> GroupReduce per file and then Union -> G