[
https://issues.apache.org/jira/browse/HIVE-25362?focusedWorklogId=639736&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-639736
]
ASF GitHub Bot logged work on HIVE-25362:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 19/Aug/21 08:03
Start Date: 19/Aug/21 08:03
Worklog Time Spent: 10m
Work Description: abstractdog commented on a change in pull request #2513:
URL: https://github.com/apache/hive/pull/2513#discussion_r691880413
##########
File path:
llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskSchedulerService.java
##########
@@ -1845,7 +1845,11 @@ private static boolean
removeFromRunningTaskMap(TreeMap<Integer, TreeSet<TaskInf
*/
private boolean shouldCycle(Map<String, List<NodeInfo>> availableHostMap) {
// short-circuit on resource availability
- if (availableHostMap.values().stream().mapToInt(List::size).sum() > 0)
return true;
+ int nodeCnt = 0;
Review comment:
why did you change this one?
I guess the stream oneliner does the same, am I missing something?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 639736)
Time Spent: 50m (was: 40m)
> LLAP: ensure tasks with locality have a chance to adjust delay
> --------------------------------------------------------------
>
> Key: HIVE-25362
> URL: https://issues.apache.org/jira/browse/HIVE-25362
> Project: Hive
> Issue Type: Sub-task
> Components: llap
> Reporter: Panagiotis Garefalakis
> Assignee: Panagiotis Garefalakis
> Priority: Major
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> HIVE-24914 introduced a short-circuit optimization when all nodes are busy
> returning DELAYED_RESOURCES and reseting locality delay for a given tasks.
> However, this may prevent tasks from adjusting their locality delay and being
> added to the DelayQueue leading sometimes to missed locality chances when all
> LLap resources are fully utilized.
> To address the issue we should handle the two cases separately.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
