[ 
https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005466#comment-16005466
 ] 

Sergey Shelukhin commented on HIVE-16637:
-----------------------------------------

Hmm... point of using mark doesn't seem to be to check if stream has data. The 
hacky part is testing the end of the message by trying to read beyond it, just 
in a different manner, if I'm reading this right.
What about the suggestion above, where the stream would know for sure when it 
hits end of the chunks.

> Improve end-of-data checking for LLAP input format
> --------------------------------------------------
>
>                 Key: HIVE-16637
>                 URL: https://issues.apache.org/jira/browse/HIVE-16637
>             Project: Hive
>          Issue Type: Bug
>          Components: llap
>            Reporter: Jason Dere
>            Assignee: Jason Dere
>         Attachments: HIVE-16637.1.patch
>
>
> The existing end of stream checking in the record reader is too forgiving of 
> errors and does not recognize situations where the server connection has 
> closed abruptly like HIVE-14093.
> Try to add a way to indicate that we have truly hit the end of the stream.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to