Re: hive on spark - version question

yeah but... is the glass half-full or half-empty? sure this might suck but keep your head high, bro! Lots of it (hive) does work. :) On Fri, Mar 17, 2017 at 2:25 PM, hernan saab wrote: > Stephan, > > Thanks for the response. > > The one thing that I don't appreciate from those who promote and

Yarn Queue Capacity Schedule

Hi, We have configured our Capacity Scheduler Queues has per link. We have two Queues Q1 and Q2 each with 50% of cluster resources. We submit quer

Re: hive on spark - version question

Stephan, Thanks for the response. The one thing that I don't appreciate from those who promote and DOCUMENT spark on hive is that, seemingly, there is absolutely no evidence seen that says that hive on spark WORKS. As a matter of fact, after a lot of pain, I noticed it is not supported by just a

Re: hive on spark - version question

thanks for the comments and for sure all relevant. And yeah I feel the pain just like the next guy but that's the part of the opensource "life style" you subscribe to when using it. The upside payoff has gotta be worth the downside risk - or else forget about it right? Here in the Hive world in my

Re: hive on spark - version question

On Fri, Mar 17, 2017 at 2:56 PM, hernan saab wrote: > I have been in a similar world of pain. Basically, I tried to use an > external Hive to have user access controls with a spark engine. > At the end, I realized that it was a better idea to use apache tez instead > of a spark engine for my part

Re: hive on spark - version question

I have been in a similar world of pain. Basically, I tried to use an external Hive to have user access controls with a spark engine.At the end, I realized that it was a better idea to use apache tez instead of a spark engine for my particular case. But the journey is what I want to share with yo

Re: hive on spark - version question

:( gettin' no love on this one. any SME's know if Spark 2.1.0 will work with Hive 2.1.0 ? That JavaSparkListener class looks like a deal breaker to me, alas. thanks in advance. Cheers, Stephen. On Mon, Mar 13, 2017 at 10:32 PM, Stephen Sprague wrote: > hi guys, > wondering where we stand w

Re: Hive on Tez: Tez taking nX more containers than Mapreduce for union all

> We are using a query with union all and groupby and same table is read > multiple times in the union all subquery. … > When run with Mapreduce, the job is run in one stage consuming n mappers and > m reducers and all union all scans are done with the same job. The logical plans are identical