[
https://issues.apache.org/jira/browse/HIVE-25362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Panagiotis Garefalakis updated HIVE-25362:
------------------------------------------
Description:
HIVE-24914 introduced a short-circuit optimization when all nodes are busy
returning DELAYED_RESOURCES and reseting locality delay for a given tasks.
However, this may prevent tasks from adjusting their locality delay and being
added to the DelayQueue leading sometimes to missed locality chances when all
LLap resources are fully utilized.
To address the issue we should handle the two cases separately.
was:
HIVE-24914 introduced a short-circuit optimization when all nodes are busy
returning DELAYED_RESOURCES and reseting locality delay for a given tasks.
However, this may prevent tasks from being added to the DelayQueue leading to
worse locality when all LLap resources are fully utilized.
To address the issue we should handle the two cases separately.
> LLAP: ensure tasks with locality have a chance to adjust delay
> --------------------------------------------------------------
>
> Key: HIVE-25362
> URL: https://issues.apache.org/jira/browse/HIVE-25362
> Project: Hive
> Issue Type: Sub-task
> Reporter: Panagiotis Garefalakis
> Assignee: Panagiotis Garefalakis
> Priority: Major
>
> HIVE-24914 introduced a short-circuit optimization when all nodes are busy
> returning DELAYED_RESOURCES and reseting locality delay for a given tasks.
> However, this may prevent tasks from adjusting their locality delay and being
> added to the DelayQueue leading sometimes to missed locality chances when all
> LLap resources are fully utilized.
> To address the issue we should handle the two cases separately.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
