cecemei commented on code in PR #19252: URL: https://github.com/apache/druid/pull/19252#discussion_r3061421835
########## docs/data-management/automatic-compaction.md: ########## @@ -83,9 +80,135 @@ maximize performance and minimize disk usage of the `compact` tasks launched by For more details on each of the specs in an auto-compaction configuration, see [Automatic compaction dynamic configuration](../configuration/index.md#automatic-compaction-dynamic-configuration). +## Auto-compaction using compaction supervisors + +:::info +For advanced time-based data lifecycle management — such as coarsening segment granularity, deleting old rows, or changing compression as data ages — see [Cascading reindexing](cascading-reindexing.md). +::: + +The recommended way to run automatic compaction is using compaction supervisors on the Overlord. Compaction supervisors provide the following benefits: + +* Can use the supervisor framework to get information about the auto-compaction, such as status or state +* More easily suspend or resume compaction for a datasource +* Can use either the native compaction engine or the [MSQ task engine](#use-msq-for-auto-compaction) +* More reactive and submits tasks as soon as a compaction slot is available +* Tracked compaction task status to avoid re-compacting an interval repeatedly +* Uses new Indexing State Fingerprinting mechanisms to store less data per segment in metadata storage Review Comment: updated wording and also mentioned minor compaction is supported here -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
