Pull requests will be automatically linked to JIRA when submitted

2014-07-19 Thread Patrick Wendell
Just a small note, today I committed a tool that will automatically mirror pull requests to JIRA issues, so contributors will no longer have to manually post a pull request on the JIRA when they make one. It will create a "link" on the JIRA and also make a comment to trigger an e-mail to people wa

Re: Master compilation with sbt

2014-07-19 Thread Chester Chen
Works for me as well: git branch branch-0.9 branch-1.0 * master Chesters-MacBook-Pro:spark chester$ git pull --rebase remote: Counting objects: 578, done. remote: Compressing objects: 100% (369/369), done. remote: Total 578 (delta 122), reused 418 (delta 71) Receiving objects: 100% (5

Re: Master compilation with sbt

2014-07-19 Thread Mark Hamstra
> project mllib . . . > clean . . . > compile . . . >test ...all works fine for me @2a732110d46712c535b75dd4f5a73761b6463aa8 On Sat, Jul 19, 2014 at 11:10 AM, Debasish Das wrote: > I am at the reservoir sampling commit: > > commit 586e716e47305cd7c2c3ff35c0e828b63ef2f6a8 > Author: Reynold Xin

Re: Master compilation with sbt

2014-07-19 Thread Debasish Das
I am at the reservoir sampling commit: commit 586e716e47305cd7c2c3ff35c0e828b63ef2f6a8 Author: Reynold Xin Date: Fri Jul 18 12:41:50 2014 -0700 sbt/sbt -Dhttp.nonProxyHosts=132.197.10.21 > project mllib [info] Set current project to spark-mllib (in build file:/Users/v606014/spark-master/) >

Master compilation with sbt

2014-07-19 Thread Debasish Das
Hi, Is sbt still used for master compilation ? I could compile for 2.3.0-cdh5.0.2 using maven following the instructions from the website: http://spark.apache.org/docs/latest/building-with-maven.html But when I am trying to use sbt for local testing and then I am getting some weird errors...Is s

Re: small (yet major) change going in: broadcasting RDD to reduce task size

2014-07-19 Thread Reynold Xin
Thanks :) FYI the pull request has been merged and will be part of Spark 1.1.0. On Thu, Jul 17, 2014 at 11:09 AM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > On Thu, Jul 17, 2014 at 1:23 AM, Stephen Haberman < > stephen.haber...@gmail.com> wrote: > >> I'd be ecstatic if more major