Re: Using Spark on Hive with Hive also using Spark as its execution engine

2016-05-29 Thread Mich Talebzadeh
thanks I think the problem is that the TEZ user group is exceptionally quiet. Just sent an email to Hive user group to see anyone has managed to built a vendor independent version. Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <

Anyone successfully deployed Hive on TEZ engine?

2016-05-29 Thread Mich Talebzadeh
Please bear in mind that I am talking about your own build not anything comes as part of Vendor's package. If so kindly specify both Hive and TEZ versions. Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Using Spark on Hive with Hive also using Spark as its execution engine

2016-05-29 Thread Jörn Franke
Well I think it is different from MR. It has some optimizations which you do not find in MR. Especially the LLAP option in Hive2 makes it interesting. I think hive 1.2 works with 0.7 and 2.0 with 0.8 . At least for 1.2 it is integrated in the Hortonworks distribution. > On 29 May 2016, at 21

Re: Using Spark on Hive with Hive also using Spark as its execution engine

2016-05-29 Thread Mich Talebzadeh
Hi Jorn, I started building apache-tez-0.8.2 but got few errors. Couple of guys from TEZ user group kindly gave a hand but I could not go very far (or may be I did not make enough efforts) making it work. That TEZ user group is very quiet as well. My understanding is TEZ is MR with DAG but of co

Re: Using Spark on Hive with Hive also using Spark as its execution engine

2016-05-29 Thread Jörn Franke
Very interesting do you plan also a test with TEZ? > On 29 May 2016, at 13:40, Mich Talebzadeh wrote: > > Hi, > > I did another study of Hive using Spark engine compared to Hive with MR. > > Basically took the original table imported using Sqoop and created and > populated a new ORC table par

Re: Test

2016-05-29 Thread Igor Kravzov
thanks guys. On Sun, May 29, 2016 at 2:31 PM, Markovitz, Dudu wrote: > Hi J > > > > *From:* Igor Kravzov [mailto:igork.ine...@gmail.com] > *Sent:* Sunday, May 29, 2016 8:02 PM > *To:* user@hive.apache.org > *Subject:* Test > > > > Please someone reply. Not sure if subscribed properly >

RE: Test

2016-05-29 Thread Markovitz, Dudu
Hi ☺ From: Igor Kravzov [mailto:igork.ine...@gmail.com] Sent: Sunday, May 29, 2016 8:02 PM To: user@hive.apache.org Subject: Test Please someone reply. Not sure if subscribed properly

Re: Test

2016-05-29 Thread Mich Talebzadeh
yep Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 29 May 2016 at 18:01, Igor Kravzov wrote: > Plea

Test

2016-05-29 Thread Igor Kravzov
Please someone reply. Not sure if subscribed properly