yihua opened a new pull request #4974:
URL: https://github.com/apache/hudi/pull/4974
## What is the purpose of the pull request
For Hudi MOR table, the scheduling of compaction is triggered under certain
conditions, configured by `hoodie.compact.inline.trigger.strategy`. The
default triggering condition is the number of delta commits, with the config of
`hoodie.compact.inline.max.delta.commits`. If this setting is larger than the
archival config of `hoodie.keep.max.commits`, there is not enough delta commits
in the active timeline and the compaction will never happen.
To guard around such configs, for MOR table with triggering strategy of
`NUM_COMMITS` (trigger compaction when reach N delta commits) and
`NUM_AND_TIME` (trigger compaction when both NUM_COMMITS and TIME_ELAPSED are
satisfied), the archival always makes sure that there are enough delta commits
in the active timeline to trigger compaction scheduling, besides other
conditions.
## Brief change log
-
## Verify this pull request
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
