[
https://issues.apache.org/jira/browse/HUDI-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
董可伦 updated HUDI-3954:
----------------------
Description:
Don't keep the last commit before the earliest commit to retain
According to the document of {{{}hoodie.cleaner.commits.retained{}}}:
Number of commits to retain, without cleaning. This will be retained for
num_of_commits * time_between_commits (scheduled). This also directly
translates into how much data retention the table supports for incremental
queries.
We only need to keep the number of commit configured through parameters
{{{}hoodie.cleaner.commits.retained{}}}.
And the commit retained by clean is completed.This ensures that “This will be
retained for num_of_commits * time_between_commits” in the document.
So we don't need to keep the last commit before the earliest commit to
retain,If we want to keep more versions, we can increase the parameters
{{hoodie.cleaner.commits.retained}}
was:
Don't keep the last commit before the earliest commit to retain
{quote}According to the document of {{{}hoodie.cleaner.commits.retained{}}}:
{quote}
Number of commits to retain, without cleaning. This will be retained for
num_of_commits * time_between_commits (scheduled). This also directly
translates into how much data retention the table supports for incremental
queries.
We only need to keep the number of commit configured through parameters
{{{}hoodie.cleaner.commits.retained{}}}.
And the commit retained by clean is completed.This ensures that “This will be
retained for num_of_commits * time_between_commits” in the document.
So we don't need to keep the last commit before the earliest commit to
retain,If we want to keep more versions, we can increase the parameters
{{hoodie.cleaner.commits.retained}}
> Don't keep the last commit before the earliest commit to retain
> ---------------------------------------------------------------
>
> Key: HUDI-3954
> URL: https://issues.apache.org/jira/browse/HUDI-3954
> Project: Apache Hudi
> Issue Type: Improvement
> Components: cleaning
> Reporter: 董可伦
> Assignee: 董可伦
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.12.0
>
>
> Don't keep the last commit before the earliest commit to retain
> According to the document of {{{}hoodie.cleaner.commits.retained{}}}:
> Number of commits to retain, without cleaning. This will be retained for
> num_of_commits * time_between_commits (scheduled). This also directly
> translates into how much data retention the table supports for incremental
> queries.
>
> We only need to keep the number of commit configured through parameters
> {{{}hoodie.cleaner.commits.retained{}}}.
> And the commit retained by clean is completed.This ensures that “This will be
> retained for num_of_commits * time_between_commits” in the document.
> So we don't need to keep the last commit before the earliest commit to
> retain,If we want to keep more versions, we can increase the parameters
> {{hoodie.cleaner.commits.retained}}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
