Re: spark_classpath in core/pom.xml and yarn/porm.xml

2014-09-25 Thread Marcelo Vanzin
BTW I removed it from the yarn pom since it was not used (and actually interfered with a test I was writing). I did not touch the core pom, but I wouldn't be surprised if it's not needed there either. On Thu, Sep 25, 2014 at 3:29 PM, Sandy Ryza wrote: > Hi Ye, > > I think git blame shows me beca

Re: spark_classpath in core/pom.xml and yarn/porm.xml

2014-09-25 Thread Sandy Ryza
Hi Ye, I think git blame shows me because I fixed the formatting in core/pom.xml, but I don't actually know the original reason for setting SPARK_CLASSPATH there. Do the tests run OK if you take it out? -Sandy On Thu, Sep 25, 2014 at 1:59 AM, Ye Xianjin wrote: > hi, Sandy Ryza: > I beli

Re: spark_classpath in core/pom.xml and yarn/porm.xml

2014-09-25 Thread Ye Xianjin
hi, Sandy Ryza: I believe It's you originally added the SPARK_CLASSPATH in core/pom.xml in the org.scalatest section. Does this still needed in 1.1? I noticed this setting because when I looked into the unit-tests.log, It shows something below: > 14/09/24 23:57:19.246 WARN SparkConf: >

spark_classpath in core/pom.xml and yarn/porm.xml

2014-09-22 Thread Ye Xianjin
Hi: I notice the scalatest-maven-plugin set SPARK_CLASSPATH environment variable for testing. But in the SparkConf.scala, this is deprecated in Spark 1.0+. So what this variable for? should we just remove this variable? -- Ye Xianjin Sent with Sparrow (http://www.sparrowmailapp.com