[
https://issues.apache.org/jira/browse/HIVE-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535781#comment-13535781
]
Namit Jain commented on HIVE-3821:
----------------------------------
RCfile writer only works with BytesRefArrayWritable, ideally it should work
with all Writables.
But, it might be simpler to change LazyBinarySerDe to use BytesRefArrayWritable
instead of BytesWritable,
which is being used currently.
> RCFile does not work with lazyBinarySerDe
> -----------------------------------------
>
> Key: HIVE-3821
> URL: https://issues.apache.org/jira/browse/HIVE-3821
> Project: Hive
> Issue Type: Improvement
> Components: Serializers/Deserializers
> Reporter: Namit Jain
> Assignee: Namit Jain
>
> create table tst(key string, value string) row format serde
> 'org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe' stored as rcfile;
> insert overwrite table tst select * from src;
> gets an error:
> Caused by: java.lang.UnsupportedOperationException: Currently the writer can
> only accept BytesRefArrayWritable
> at org.apache.hadoop.hive.ql.io.RCFile$Writer.append(RCFile.java:882)
> at
> org.apache.hadoop.hive.ql.io.RCFileOutputFormat$2.write(RCFileOutputFormat.java:140)
> at
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:637)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
> at
> org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
> at
> org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
> at
> org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:547)
> ... 5 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
