Rajkumar Singh created HIVE-24523:
-------------------------------------
Summary: Vectorized read path for LazySimpleSerde does not honor
the SERDEPROPERTIES for timestamp
Key: HIVE-24523
URL: https://issues.apache.org/jira/browse/HIVE-24523
Project: Hive
Issue Type: Bug
Components: Vectorization
Affects Versions: 3.2.0
Reporter: Rajkumar Singh
Steps to repro:
{code:java}
create external table tstable(date_created timestamp) ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' WITH SERDEPROPERTIES (
'timestamp.formats'='yyyyMMddHHmmss') stored as textfile;
cat sampledata
20201205000017
hdfs dfs -put sampledata /warehouse/tablespace/external/hive/tstable
{code}
disable fetch task conversion and run select * from tstable which produce no
results, disabling the set hive.vectorized.use.vector.serde.deserialize=false;
return the expected output.
while parsing the string to timestamp
https://github.com/apache/hive/blob/master/serde/src/java/org/apache/hadoop/hive/serde2/lazy/fast/LazySimpleDeserializeRead.java#L812
does not set the DateTimeFormatter which results IllegalArgumentException
while parsing the timestamp through TimestampUtils.stringToTimestamp(strValue)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
