Re: Spark 1.1 / cdh4 stuck using old hadoop client?

2014-09-16 Thread Christian Chua
> > and hadoop 2.3 / cdh5 from > http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.3.0-cdh5.0.0.tar.gz > > > > > >> On Mon, Sep 15, 2014 at 6:49 PM, Christian Chua wrote: >> Hi Paul. >> >> I would recommend building your own 1.1.0 distrib

Re: Spark 1.1 / cdh4 stuck using old hadoop client?

2014-09-15 Thread Christian Chua
Hi Paul. I would recommend building your own 1.1.0 distribution. ./make-distribution.sh --name hadoop-personal-build-2.4 --tgz -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests I downloaded the "Pre-build for Hadoop 2.4" binary, and it had this strange behavior where sp