[
https://issues.apache.org/jira/browse/HIVE-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14158087#comment-14158087
]
Mickael Lacour commented on HIVE-6994:
--------------------------------------
I'm working on this one. We have 3 different data that can throw exception (for
different reason) :
* array with first value null (NullPointerException) : fixed
* array with all empty fields (ParquetEncodingException "empty fields are
illegal, the field should be ommited completely instead") : Still in progress,
talking with the parquet team about it
* array with few empty fields (no exception, just missing data) : related to
the previous one.
Keep you posted
> parquet-hive createArray strips null elements
> ---------------------------------------------
>
> Key: HIVE-6994
> URL: https://issues.apache.org/jira/browse/HIVE-6994
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.13.0, 0.14.0
> Reporter: Justin Coffey
> Assignee: Justin Coffey
> Fix For: 0.14.0
>
> Attachments: HIVE-6994-1.patch, HIVE-6994.2.patch, HIVE-6994.3.patch,
> HIVE-6994.3.patch, HIVE-6994.patch
>
>
> The createArray method in ParquetHiveSerDe strips null values from resultant
> ArrayWritables.
> tracked here as well: https://github.com/Parquet/parquet-mr/issues/377
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
