Re: Spark CDH5 packages

2014-12-12 Thread Jing Dong
Hi Sowen, Thanks for the tip. When will CDH 5.3 be released? Some sort of timeline would be helpful. Thanks, Jing > On 12 Dec 2014, at 12:34, Sean Owen wrote: > > No, CDH 5.2 includes Spark 1.1 actually, which is the latest released > minor version; 5.3 will include 1.2, which not released yet

Re: Spark CDH5 packages

2014-12-12 Thread Sean Owen
No, CDH 5.2 includes Spark 1.1 actually, which is the latest released minor version; 5.3 will include 1.2, which not released yet. You can make a build of just about any version of Spark for CDH5, and manually install it yourself, sure, but easier would be to just update CDH. The instructions are

Spark CDH5 packages

2014-12-12 Thread Jing Dong
Hi, I'm new to this list, so please excuse if I'm asking simple questions. We are experimenting spark deployment on existing CDH clusters. However the spark package come with CDH are very out of date (v1.0.0). Has anyone had experience with custom Spark upgrade for CDH5? Any installat