Re: java.io.IOException: No space left on device

2015-04-29 Thread selim namsi
hop.oreilly.com/product/0636920033073.do> (O'Reilly) > Typesafe <http://typesafe.com> > @deanwampler <http://twitter.com/deanwampler> > http://polyglotprogramming.com > > On Wed, Apr 29, 2015 at 6:25 AM, selim namsi > wrote: > >> This is the output of d

Re: java.io.IOException: No space left on device

2015-04-29 Thread selim namsi
ition mounted on "/" was growing very fast On Wed, Apr 29, 2015 at 12:19 PM Anshul Singhle wrote: > Do you have multiple disks? Maybe your work directory is not in the right > disk? > > On Wed, Apr 29, 2015 at 4:43 PM, Selim Namsi > wrote: > >> Hi, >> >>

java.io.IOException: No space left on device

2015-04-29 Thread Selim Namsi
Hi, I'm using spark (1.3.1) MLlib to run random forest algorithm on tfidf output,the training data is a file containing 156060 (size 8.1M). The problem is that when trying to presist a partition into memory and there is not enought memory, the partition is persisted on disk and despite Having 229

Re: Multiclass classification using Ml logisticRegression

2015-04-29 Thread selim namsi
lementation; I just added a JIRA for it: > https://issues.apache.org/jira/browse/SPARK-7159 > > You'll need to use the old LogisticRegression API to do multiclass for > now, until that JIRA gets completed. (If you're interested in doing it, > let me know via the JIRA!) > >

Multiclass classification using Ml logisticRegression

2015-04-24 Thread Selim Namsi
Hi, I just started using spark ML pipeline to implement a multiclass classifier using LogisticRegressionWithLBFGS (which accepts as a parameters number of classes), I followed the Pipeline example in ML- guide and I used LogisticRegression class which calls LogisticRegressionWithLBFGS class : va