Re: Including additional scala libraries in sparkR

2015-07-14 Thread Shivaram Venkataraman
x27;s a bug. > > From: Michal Haris [michal.ha...@visualdna.com] > Sent: Tuesday, July 14, 2015 5:31 PM > To: Sun, Rui > Cc: Michal Haris; user@spark.apache.org > Subject: Re: Including additional scala libraries in sparkR > > Ok thanks. It seems that

RE: Including additional scala libraries in sparkR

2015-07-14 Thread Sun, Rui
ional scala libraries in sparkR Ok thanks. It seems that --jars is not behaving as expected - getting class not found for even the most simple object from my lib. But anyways, I have to do at least a filter transformation before collecting the HBaseRDD into R so will have to go the route of using

Re: Including additional scala libraries in sparkR

2015-07-14 Thread Michal Haris
Ok thanks. It seems that --jars is not behaving as expected - getting class not found for even the most simple object from my lib. But anyways, I have to do at least a filter transformation before collecting the HBaseRDD into R so will have to go the route of using scala spark shell to transform an

RE: Including additional scala libraries in sparkR

2015-07-13 Thread Sun, Rui
Hi, Michal, SparkR comes with a JVM backend that supports Java object instantiation, calling Java instance and static methods from R side. As defined in https://github.com/apache/spark/blob/master/R/pkg/R/backend.R, newJObject() is to create an instance of a Java class; callJMethod() is to call