Re: set up spark 1.4.1 as default spark engine in HDP 2.2/2.3

2015-12-08 Thread Saisai Shao
Please make sure the spark shell script you're running is pointed to /bin/spark-shell Just follow the instructions to correctly configure your spark 1.4.1 and execute correct script are enough. On Wed, Dec 9, 2015 at 11:28 AM, Divya Gehlot wrote: > Hi, > As per requirement I need to use Spark 1

set up spark 1.4.1 as default spark engine in HDP 2.2/2.3

2015-12-08 Thread Divya Gehlot
Hi, As per requirement I need to use Spark 1.4.1.But HDP doesnt comes with Spark 1.4.1 version. As instructed in this hortonworks page I am able to set up Spark 1.4 in HDP ,but when I run the spark shell It sho