gianm opened a new pull request, #19219: URL: https://github.com/apache/druid/pull/19219
In MEMORY output mode when workers sort locally, the controller knows to start the next stage when all workers have finished reading their input. Typically the controller learns this because workers send the DoneReadingInput message when they transition from READING_INPUT to PRESHUFFLE_WRITING_OUTPUT. However, when a worker finishes reading input very quickly and is also able to fully buffer its output, it transitions directly from READING_INPUT to RESULTS_COMPLETE. This causes the query to become stuck. This patch fixes it at the controller, by additionally checking if all workers are done reading input when receiving a ResultsComplete message. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
