[
https://issues.apache.org/jira/browse/HIVE-27598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Taraka Rama Rao Lethavadla updated HIVE-27598:
----------------------------------------------
Description:
*current implementation:* the below command will throw error
{noformat}
alter table PARTITIONED_T compact 'minor';{noformat}
for a partitioned table
{code:java}
You must specify a partition to compact for partitioned tables{code}
{*}Problem{*}: One of the problem could be ,let's say a table contains 1000s of
partitions and for some issue like files permission automatic compaction will
mark all or few partitions as failed and never pick for compaction.
After we see performance getting degraded, we find out that there is a problem
in compaction due to some issue.
Now to solve it, we have two approaches, adjust failure thresholds and restart
HMS to pick the changes which is not going to work for someone who cannot
restart HMS
And the second approach is to execute alter table mentioning each partition
{*}Solution{*}:
In this Jira we are planning to allow alter table command for a partitioned
table without specifying any partition name.
Proposed solution is to list all the partitions and find partitions that are
eligible to get compacted and put an entry for it in compaction queue
was:
*current implementation:* the below command will throw error
{noformat}
alter table PARTITIONED_T compact 'minor';{noformat}
for a partitioned
{code:java}
You must specify a partition to compact for partitioned tables{code}
{*}Problem{*}: One of the problem could be ,let's say a table contains 1000s of
partitions and for some issue like files permission automatic compaction will
mark all or few partitions as failed and never pick for compaction.
After we see performance getting degraded, we find out that there is a problem
in compaction due to some issue.
Now to solve it, we have two approaches, adjust failure thresholds and restart
HMS to pick the changes which is not going to work for someone who cannot
restart HMS
And the second approach is to execute alter table mentioning each partition
{*}Solution{*}:
In this Jira we are planning to allow alter table command for a partitioned
table without specifying any partition name.
Proposed solution is to list all the partitions and find partitions that are
eligible to get compacted and put an entry for it in compaction queue
> Enhance alter table compact to work for partitioned tables without specifying
> any partition
> -------------------------------------------------------------------------------------------
>
> Key: HIVE-27598
> URL: https://issues.apache.org/jira/browse/HIVE-27598
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Reporter: Taraka Rama Rao Lethavadla
> Assignee: Taraka Rama Rao Lethavadla
> Priority: Major
> Labels: pull-request-available
>
> *current implementation:* the below command will throw error
>
> {noformat}
> alter table PARTITIONED_T compact 'minor';{noformat}
> for a partitioned table
> {code:java}
> You must specify a partition to compact for partitioned tables{code}
> {*}Problem{*}: One of the problem could be ,let's say a table contains 1000s
> of partitions and for some issue like files permission automatic compaction
> will mark all or few partitions as failed and never pick for compaction.
> After we see performance getting degraded, we find out that there is a
> problem in compaction due to some issue.
> Now to solve it, we have two approaches, adjust failure thresholds and
> restart HMS to pick the changes which is not going to work for someone who
> cannot restart HMS
> And the second approach is to execute alter table mentioning each partition
> {*}Solution{*}:
> In this Jira we are planning to allow alter table command for a partitioned
> table without specifying any partition name.
> Proposed solution is to list all the partitions and find partitions that are
> eligible to get compacted and put an entry for it in compaction queue
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
