Re: Hive 2.2

2017-06-06 Thread vergil
Hi,You can build distribution from source code,github URL:https://github.com/apache/hive/releases.And you can follow the guide https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-BuildingHivefromSource. But,I found it that Hive2.2 2.3 version do not support Spark2.0 whe

Hive 2.2

2017-06-06 Thread Boris Lublinsky
Hi, Documentation for Hive on Spark https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started refers to Hive 2.2 for Spark 2.0 and above support. Where can I find distribution for Hive 2.2.

Re: How to setup the max memory for my big Hive SQL which is on MapReduce of Yarn

2017-06-06 Thread Stephen Sprague
have you researched the yarn schedulers? namely the capacity and fair schedulers? those are the places where resource limits can be easily defined. On Mon, Jun 5, 2017 at 9:25 PM, Chang.Wu <583424...@qq.com> wrote: > My Hive engine is MapReduce and Yarn. What my urgent need is to limit the > mem

Re: FYI: Backports of Hive UDFs

2017-06-06 Thread Edward Capriolo
I dont care about 'security issues' over the ability to work quickly. One popular compute system let you define mappers in scala in a shell for example. On Monday, June 5, 2017, Makoto Yui wrote: > Alan, > > Putting Hive backported UDFs to Hive branch-1 will cause dependencies > to the specific