[ 
https://issues.apache.org/jira/browse/HIVE-24473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254875#comment-17254875
 ] 

Istvan Toth commented on HIVE-24473:
------------------------------------

After trying out a lot of versions, it seems that every GA Hbase 2.x official 
maven artifact is affected by HBASE-22394 .

The next best thing to is making Hive buildable with GA HBase built with Hadoop 
3.

So the procedure is:
1. rebuild and install the chosen HBase 2.x version from source with HBase with 
Hadoop 3: 

{noformat}
cd hbase-2.x.y
mvn clean install -Dhadoop.profile=3.0
{noformat}

2. rebuild Hive with the HBase artifacts built above

{noformat}
cd hive
mvn clean install -Dhbase.version=2.x.y
{noformat}

However, this doesn't work now because 

1.) 
Hive has an undeclared dependency on collections4, which is pulled in 
transitively via Hbase 2.0.0-alpha4

2.)
Hbase 2.x has split some code into the new hbase-zookeeper artifact, which 
needs to be added as a dependency

My patch 

adds the collections4 dependency explcitily (it seems to be accidental, and it 
should probably be just replaced with vanilla collections, but I didn't want 
touch other modules' code)

adds a new *customhbase* profile, which is activated by specifying 
hbase.version property, and automagically adds the necessary hbase-zookeeper 
dependency for GA versions


> Make Hive buildable with HBase 2.x GA versions
> ----------------------------------------------
>
>                 Key: HIVE-24473
>                 URL: https://issues.apache.org/jira/browse/HIVE-24473
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 4.0.0
>            Reporter: Istvan Toth
>            Assignee: Istvan Toth
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Hive currently builds with a 2.0.0 pre-release.
> Update HBase to more recent version.
> -We cannot use anything later than 2.2.4 because of HBASE-22394-
> -So the options are 2.1.10 and 2.2.4-
> -I suggest 2.1.10 because it's a chronologically later release, and it 
> maximises compatibility with HBase server deployments.-
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to