yes, only for engine, but maybe newer version has more optimization from tungsten project? at least since spark 1.6?
> ---------- Forwarded message ---------- > From: Mich Talebzadeh <[email protected]> > Date: 27 May 2016 at 17:09 > Subject: Re: Pros and Cons > To: Teng Qiu <[email protected]> > Cc: Ted Yu <[email protected]>, Koert Kuipers <[email protected]>, Jörn > Franke <[email protected]>, user <[email protected]>, Aakash Basu > <[email protected]>, Reynold Xin <[email protected]> > > > not worth spending time really. > > The only version that works is Spark 1.3.1 with Hive 2 > To be perfectly honest deploying Spark as Hive engine only requires certain > Spark capabilities that I think 1.3.1 is OK with it. Remember we are talking > about engine not HQL etc. That is all provided by Hive itself. > > To me a gain in performance at least 2 compared to MR is perfectly > acceptable. > > > Dr Mich Talebzadeh > > > > LinkedIn > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > > > http://talebzadehmich.wordpress.com > > > > > On 27 May 2016 at 16:58, Teng Qiu <[email protected]> wrote: >> >> tried spark 2.0.0 preview, but no assembly jar there... then just gave >> up... :p >> --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
