[ 
https://issues.apache.org/jira/browse/HIVE-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003748#comment-16003748
 ] 

Sergey Shelukhin commented on HIVE-16582:
-----------------------------------------

"// guard against poor configuration of noconditional task size. We let hash 
table grow till 2/3'rd memory" etc. code is duplicated.
Also 2/3 could be configurable.
Otherwise looks good.

This doesn't account for the number of fragments actually running, does it?

> HashTableLoader should log info about the input, rows, size etc.
> ----------------------------------------------------------------
>
>                 Key: HIVE-16582
>                 URL: https://issues.apache.org/jira/browse/HIVE-16582
>             Project: Hive
>          Issue Type: Improvement
>    Affects Versions: 3.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Minor
>         Attachments: HIVE-16582.1.patch, HIVE-16582.2.patch, 
> HIVE-16582.3.patch, HIVE-16582.4.patch
>
>
> Will be useful to log the following info during hash table loading
> - input name
> - number of rows 
> - estimated data size (LLAP tracks this)
> - object cache key



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to