kfaraz commented on code in PR #19562:
URL: https://github.com/apache/druid/pull/19562#discussion_r3468021797
##########
indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/autoscaler/WeightedCostFunction.java:
##########
@@ -42,6 +42,12 @@ public class WeightedCostFunction
*/
static final double LAG_AMPLIFICATION_MULTIPLIER = 0.4;
+ /**
+ * Exponent (< 1) for sublinear busy redistribution in the idle
projection: busy grows as
+ * {@code (currentTaskCount / proposedTaskCount)^EXPONENT}, not linearly.
Calibrated as log2(1.25) ~= 0.32.
+ */
+ static final double IDLE_SUBLINEARITY_EXPONENT = 0.32;
Review Comment:
For the alternative, I meant something along these lines
```
current workload
= total records per second
= current processing rate * current task count * idle ratio
assumptions:
target workload = current workload
predicted processing rate = current processing rate
predicted idle ratio
= target workload / (target task count * predicted processing rate)
= current workload / (target task count * current processing rate)
```
Let me know if that makes sense.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
