Re: Using YARN w/o HDFS

2017-06-21 Thread Chen He
chang your fs.defaultFS to point to local file system and have a try On Wed, Jun 21, 2017 at 4:50 PM, Alaa Zubaidi (PDF) wrote: > Hi, > > Can we run Spark on YARN with out installing HDFS? > If yes, where would HADOOP_CONF_DIR point to? > > Regards, > > *This message may contain confidential and

Re: Spark on Raspberry Pi?

2014-09-11 Thread Chen He
Here is the POC of cubieboards hadoop cluster performance and power consumption. I suggest cubietrunk would be a choice since cubieboard2 only has 100Mbps ethernet. http://www.slideshare.net/airbots/hadoop-mapreduce-performance-study-on-arm-cluster On Thu, Sep 11, 2014 at 12:50 PM, Chanwit Kaewk

Fwd: Spark on Raspberry Pi?

2014-09-11 Thread Chen He
Pi's bus speed, memory size and access speed, and processing ability are limited. The only benefit could be the power consumption. On Thu, Sep 11, 2014 at 8:04 AM, Sandeep Singh wrote: > Has anyone tried using Raspberry Pi for Spark? How efficient is it to use > around 10 Pi's for local testing

Re: CUDA in spark, especially in MLlib?

2014-08-27 Thread Chen He
JCUDA can let you do that in Java http://www.jcuda.org On Wed, Aug 27, 2014 at 1:48 AM, Antonio Jesus Navarro < ajnava...@stratio.com> wrote: > Maybe this would interest you: > > CPU and GPU-accelerated Machine Learning Library: > > https://github.com/BIDData/BIDMach > > > 2014-08-27 4:08 GMT+02