[ 
https://issues.apache.org/jira/browse/HIVE-19306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463200#comment-16463200
 ] 

Teddy Choi commented on HIVE-19306:
-----------------------------------

[~mmccline], [~ewohlstadter]. [^HIVE-19306.3.patch] fixed null handling. 
ArrowColumnarBatchSerDe#writeNull is the strangest part. Because Apache Arrow's 
UnionListWriter should implement AbstractFieldWriter#writeNull properly and 
FieldWriter should have a super method of AbstractFieldWriter#writeNull to 
expose it. I used reflection and concrete class check to handle it. I'll fix 
FieldWriter interface in Apache Arrow.

> Arrow batch serializer
> ----------------------
>
>                 Key: HIVE-19306
>                 URL: https://issues.apache.org/jira/browse/HIVE-19306
>             Project: Hive
>          Issue Type: Task
>          Components: Serializers/Deserializers
>            Reporter: Eric Wohlstadter
>            Assignee: Teddy Choi
>            Priority: Major
>         Attachments: HIVE-19306.2.patch
>
>
> Leverage the ThriftJDBCBinarySerDe code path that already exists in 
> SemanticAnalyzer/FileSinkOperator to create a serializer that batches rows 
> into Arrow vector batches.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to