Hi, is this a streaming or batch job? If it is a batch job, are you using either collect() or print() on a DataSet?
Cheers, Aljoscha On Thu, 28 Apr 2016 at 00:52 Ken Krugler <kkrugler_li...@transpac.com> wrote: > Hi all, > > In trying out different settings for performance, I run into a job failure > case that puzzles me. > > I’d done a run with a parallelism of 20 (-p 20 via CLI), and the job ran > successfully, on a cluster with 40 slots. > > I then tried with -p 15, and it failed with: > > NoResourceAvailableException: Not enough free slots available to run the > job. You can decrease the operator parallelism… > > But the change was to reduce parallelism - why would that now cause this > problem? > > Thanks, > > — Ken > > > -------------------------- > Ken Krugler > +1 530-210-6378 > http://www.scaleunlimited.com > custom big data solutions & training > Hadoop, Cascading, Cassandra & Solr > > > >
