On Wed, Jul 2, 2014 at 11:40 PM, Xiangrui Meng wrote:
> Hi Dmitriy,
>
> It is sweet to have the bindings, but it is very easy to downgrade the
> performance with them. The BLAS/LAPACK APIs have been there for more
> than 20 years and they are still the top choice for high-performance
> linear alg
Hi Dmitriy,
It is sweet to have the bindings, but it is very easy to downgrade the
performance with them. The BLAS/LAPACK APIs have been there for more
than 20 years and they are still the top choice for high-performance
linear algebra. I'm thinking about whether it is possible to make the
evaluat
Hi Thunder,
Please understand that both MLlib and breeze are in active
development. Before v1.0, we used jblas but in the public APIs we only
exposed Array[Double]. In v1.0, we introduced Vector that supports
both dense and sparse data and switched the backend to
breeze/netlib-java (except ALS). W
in my humble opinion Spark should've supported linalg a-la [1] before it
even started dumping methodologies into mllib.
[1] http://mahout.apache.org/users/sparkbindings/home.html
On Wed, Jul 2, 2014 at 2:16 PM, Thunder Stumpges wrote:
> Thanks. I always hate having to do stuff like this. It se
Thanks. I always hate having to do stuff like this. It seems like they went
a bit overboard with all the "private[mllib]" declarations... possibly all
in the name of "thou shalt not change your public API". If you don't make
your public API usable, we end up having to work around it anyway...
Oh w
i did the second option: re-implemented .toBreeze as .breeze using pimp
classes
On Wed, Jul 2, 2014 at 5:00 PM, Thunder Stumpges wrote:
> I am upgrading from Spark 0.9.0 to 1.0 and I had a pretty good amount of
> code working with internals of MLLib. One of the big changes was the move
> from t
I am upgrading from Spark 0.9.0 to 1.0 and I had a pretty good amount of
code working with internals of MLLib. One of the big changes was the move
from the old jblas.Matrix to the Vector/Matrix classes included in MLLib.
However I don't see how we're supposed to use them for ANYTHING other than
a
