Re: Spark on Scala 2.11

2014-05-10 Thread Gary Malouf
Considering the team just bumped to 2.10 in 0.9, I would be surprised if this is a near term priority. On Thu, May 8, 2014 at 9:33 PM, Anand Avati wrote: > Is there an ongoing effort (or intent) to support Spark on Scala 2.11? > Approximate timeline? > > Thanks >

LabeledPoint toString to dump LibSvm if SparseVector

2014-05-10 Thread Debasish Das
Hi, I need to change the toString on LabeledPoint to libsvm format so that I can dump RDD[LabeledPoint] as a format that could be read by sparse glmnet-R and other packages to benchmark mllib classification accuracy... Basically I have to change the toString of LabeledPoint and toString of Sparse

Using spark 1.0.0 assembly in IntelliJ

2014-05-10 Thread Usman Ghani
*(Includes solution)* I was having this weird issue where when I use a Spark 0.9.1 or earlier Jar file in IntelliJ I can see its contents and IntelliJ can work with it. But when I compile version 1.0.0 from source my jar is not being recognized by IntelliJ even though I can build my project using

Spark on Scala 2.11

2014-05-10 Thread Anand Avati
Is there an ongoing effort (or intent) to support Spark on Scala 2.11? Approximate timeline? Thanks