Re: Problem in running MLlib SVM

if((score >=0 && label == 1) || (score <0 && label == 0)) { return 1; //correct classiciation } else return 0; I suspect score is always between 0 and 1 On Sat, Nov 28, 2015 at 10:39 AM, Tarek Elgamal wrote: > Hi, >

Export BLAS module on Spark MLlib

Hello I'm developing a Spark package that manipulates Vector and Matrix for machine learning. This package uses mllib.linalg.Vector and mllib.linalg.Matrix in order to achieve compatible interface to mllib itself. But mllib.linalg.BLAS module is private inside spark package. We cannot use BLAS

Re: Subtract implementation using broadcast

if i wanted to pimp DataFrame to add subtract and intersect myself with a physical operator, without needing to modify spark directly, is that currently possible/intended? or will i run into the private[spark] issue? On Fri, Nov 27, 2015 at 7:36 PM, Reynold Xin wrote: > We need to first implemen

Re: Problem in running MLlib SVM

According to the documentation , by default, if wTx≥0 then the outcome is positive, and negative otherwise. I suppose that wTx is the "score" in my case. If score is more than 0 and the label is positive, then I return 1 which is correc

Re: Problem in running MLlib SVM

I think this should represent the label of LabledPoint (0 means negative 1 means positive) http://spark.apache.org/docs/latest/mllib-data-types.html#labeled-point The document you mention is for the mathematical formula, not the implementation. On Sun, Nov 29, 2015 at 9:13 AM, Tarek Elgamal wrot