kfaraz commented on PR #19157: URL: https://github.com/apache/druid/pull/19157#issuecomment-4065594110
> actually it's not due to intermediatePersistPeriod, i'm not sure why but i think supervisor is shutting down tasks constantly, probably due to No task in pending completion taskGroup[0] succeeded before completion timeout elapsed, and completion timeout is set to 5s in tests. If that is the case, you could try increasing the `completionTimeout` and the `taskDuration` (I think the test currently uses 500ms). But that probably still doesn't guarantee that you would end up with the correct number of segments. You could either just use batch append instead of a Kafka supervisor. OR Relax the assertions on the segment count and just verify that a minor compaction has actually occurred. FYI, https://github.com/apache/druid/pull/19151 updates the `KafkaClusterMetricsTest` to run Kafka supervisor with minor compaction. So, I think we may skip trying to use Kafka supervisor in the `CompactionSupervisorTest` for the time being. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
