[ 
https://issues.apache.org/jira/browse/HIVE-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-12584:
-----------------------------------------
    Attachment: HIVE-12584.1.patch

[~mmccline] Can you please take a look at this patch? The code change is 
trimming partition value if column type is char. Other changes are all tests.

> Vectorized join with partition column of type char does not trim spaces 
> ------------------------------------------------------------------------
>
>                 Key: HIVE-12584
>                 URL: https://issues.apache.org/jira/browse/HIVE-12584
>             Project: Hive
>          Issue Type: Bug
>          Components: Vectorization
>    Affects Versions: 1.3.0, 2.0.0, 2.1.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Critical
>         Attachments: HIVE-12584.1.patch
>
>
> When a table is partitioned on a column of type char and if join is performed 
> on partitioned column then following exception gets thrown from hashtable 
> loader
> {code}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
> org.apache.hadoop.hive.ql.metadata.HiveException: 
> org.apache.hadoop.hive.serde2.SerDeException: Unexpected tag: 52 reserialized 
> to 5
>       at 
> org.apache.hadoop.hive.ql.exec.tez.ObjectCache.retrieve(ObjectCache.java:82)
>       at 
> org.apache.hadoop.hive.ql.exec.tez.ObjectCache$1.call(ObjectCache.java:92)
>       ... 4 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
> org.apache.hadoop.hive.serde2.SerDeException: Unexpected tag: 52 reserialized 
> to 5
>       at 
> org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:216)
>       at 
> org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:293)
>       at 
> org.apache.hadoop.hive.ql.exec.MapJoinOperator$1.call(MapJoinOperator.java:174)
>       at 
> org.apache.hadoop.hive.ql.exec.MapJoinOperator$1.call(MapJoinOperator.java:170)
>       at 
> org.apache.hadoop.hive.ql.exec.tez.ObjectCache.retrieve(ObjectCache.java:75)
>       ... 5 more
> Caused by: org.apache.hadoop.hive.serde2.SerDeException: Unexpected tag: 52 
> reserialized to 5
>       at 
> org.apache.hadoop.hive.ql.exec.persistence.MapJoinBytesTableContainer$LazyBinaryKvWriter.sanityCheckKeyForTag(MapJoinBytesTableContainer.java:276)
>       at 
> org.apache.hadoop.hive.ql.exec.persistence.MapJoinBytesTableContainer$LazyBinaryKvWriter.getHashFromKey(MapJoinBytesTableContainer.java:247)
>       at 
> org.apache.hadoop.hive.ql.exec.persistence.HybridHashTableContainer.internalPutRow(HybridHashTableContainer.java:451)
>       at 
> org.apache.hadoop.hive.ql.exec.persistence.HybridHashTableContainer.putRow(HybridHashTableContainer.java:444)
>       at 
> org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:210)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to