nzw921rx commented on PR #12418: URL: https://github.com/apache/seatunnel/pull/12418#issuecomment-5926029090
Hi @Vivek1106-04, following up after the merge, I ran the benchmark on Linux: https://github.com/apache/seatunnel/actions/runs/36820452487. The run already uses three 10-second warmup iterations, but some measurements still trend downward. For example, with one pipeline on JDK 8, the first fork’s measurement scores are 161.505, 163.602, 143.061, 142.223 and 131.410 μs/op. Could you please investigate whether warmup is sufficient and what causes this trend? Please also run the complete benchmark sweep locally, including all parameter combinations and forks, and share the commands, environment details and full per-iteration results. As a follow-up, we should also consider a fixed-checkpoint-interval scenario and longer measurement runs to evaluate increasing scheduling load and obtain enough samples for tail percentiles. This would help strengthen the baseline for evaluating the shared scheduler. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
