Re: Support R in Spark

2014-09-19 Thread oppokui
Thanks, Shivaram. Kui > On Sep 19, 2014, at 12:58 AM, Shivaram Venkataraman > wrote: > > As R is single-threaded, SparkR launches one R process per-executor on > the worker side. > > Thanks > Shivaram > > On Thu, Sep 18, 2014 at 7:49 AM, oppokui wrote:

Re: Support R in Spark

2014-09-18 Thread oppokui
Regards. Kui > On Sep 6, 2014, at 5:53 PM, oppokui wrote: > > Cool! It is a very good news. Can’t wait for it. > > Kui > >> On Sep 5, 2014, at 1:58 AM, Shivaram Venkataraman >> wrote: >> >> Thanks Kui. SparkR is a pretty young project, but there are a

Re: Support R in Spark

2014-09-06 Thread oppokui
make use of MLLib's efficient > distributed implementation. This is the same strategy used in Python > as well. > > Also we do hope to merge SparkR with mainline Spark -- we have a few > features to complete before that and plan to shoot for integration by > Spark 1.3. >

Re: Support R in Spark

2014-09-06 Thread oppokui
ll. > > Also we do hope to merge SparkR with mainline Spark -- we have a few > features to complete before that and plan to shoot for integration by > Spark 1.3. > > Thanks > Shivaram > > On Wed, Sep 3, 2014 at 9:24 PM, oppokui wrote: >> Thanks, Shivaram

Re: Support R in Spark

2014-09-03 Thread oppokui
AM, Shivaram Venkataraman > wrote: > > Hi > > Do you have a specific use-case where SparkR doesn't work well ? We'd love to > hear more about use-cases and features that can be improved with SparkR. > > Thanks > Shivaram > > > On Wed, Sep 3, 2014

Support R in Spark

2014-09-03 Thread oppokui
Does spark ML team have plan to support R script natively? There is a SparkR project, but not from spark team. Spark ML used netlib-java to talk with native fortran routines or use NumPy, why not try to use R in some sense. R had lot of useful packages. If spark ML team can include R support, i