[
https://issues.apache.org/jira/browse/HIVE-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171844#comment-14171844
]
Rui Li commented on HIVE-7467:
------------------------------
[~jxiang] - thanks for the update!
I know there's workarounds to this issue. The JIRA here is mainly to make sure
if there's anything else we should do. If you think we're good with the
workarounds, please feel free to resolve this issue :-)
> When querying HBase table, task fails with exception:
> java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString
> -------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-7467
> URL: https://issues.apache.org/jira/browse/HIVE-7467
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Environment: Spark-1.0.0, HBase-0.98.2
> Reporter: Rui Li
> Assignee: Jimmy Xiang
>
> When I run select count( * ) on an HBase table, spark task fails with:
> {quote}
> java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString
> at
> org.apache.hadoop.hbase.protobuf.RequestConverter.buildRegionSpecifier(RequestConverter.java:910)
> at
> org.apache.hadoop.hbase.protobuf.RequestConverter.buildGetRowOrBeforeRequest(RequestConverter.java:131)
> at
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRowOrBefore(ProtobufUtil.java:1403)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1181)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1059)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1016)
> at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:326)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:192)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:165)
> at
> org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getRecordReader(HiveHBaseTableInputFormat.java:93)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:241)
> at org.apache.spark.rdd.HadoopRDD$$anon$1.<init>(HadoopRDD.scala:193)
> at org.apache.spark.rdd.HadoopRDD.compute(HadoopRDD.scala:184)
> at org.apache.spark.rdd.HadoopRDD.compute(HadoopRDD.scala:93)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:262)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:229)
> at
> org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:262)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:229)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:158)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
> at org.apache.spark.scheduler.Task.run(Task.scala:51)
> {quote}
> NO PRECOMMIT TESTS. This is for spark branch only.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
