[
https://issues.apache.org/jira/browse/HIVE-25520?focusedWorklogId=652885&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-652885
]
ASF GitHub Bot logged work on HIVE-25520:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 20/Sep/21 11:24
Start Date: 20/Sep/21 11:24
Worklog Time Spent: 10m
Work Description: pgaref commented on a change in pull request #2640:
URL: https://github.com/apache/hive/pull/2640#discussion_r712075900
##########
File path:
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/concatenate/AlterTableConcatenateAnalyzer.java
##########
@@ -73,13 +73,19 @@ protected void analyzeCommand(TableName tableName,
Map<String, String> partition
if (AcidUtils.isTransactionalTable(table)) {
compactAcidTable(tableName, partitionSpec);
} else {
+
Review comment:
Unrelated change -- please remove
##########
File path:
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/concatenate/AlterTableConcatenateAnalyzer.java
##########
@@ -73,13 +73,19 @@ protected void analyzeCommand(TableName tableName,
Map<String, String> partition
if (AcidUtils.isTransactionalTable(table)) {
compactAcidTable(tableName, partitionSpec);
} else {
+
// non-native and non-managed tables are not supported as MoveTask
requires filenames to be in specific format,
// violating which can cause data loss
if (table.isNonNative()) {
throw new
SemanticException(ErrorMsg.CONCATENATE_UNSUPPORTED_TABLE_NON_NATIVE.getMsg());
}
+
if (table.getTableType() != TableType.MANAGED_TABLE) {
- throw new
SemanticException(ErrorMsg.CONCATENATE_UNSUPPORTED_TABLE_NOT_MANAGED.getMsg());
+ // Enable concatenate for external tables if config is set.
+ if (!conf.getBoolVar(ConfVars.ENABLE_CONCATENATE_FOR_EXTERNAL_TABLES)
Review comment:
We need a q.test demonstrating the expected behaviour here
##########
File path: common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
##########
@@ -3254,6 +3254,8 @@ private static void populateLlapDaemonVarsSet(Set<String>
llapDaemonVarsSetLocal
TRANSACTIONAL_CONCATENATE_NOBLOCK("hive.transactional.concatenate.noblock",
false,
"Will cause 'alter table T concatenate' to be non-blocking"),
+
ENABLE_CONCATENATE_FOR_EXTERNAL_TABLES("hive.concatenate.enable-external-tables",
false,
Review comment:
Avoid using hyphen for HiveConf options: something like
hive.external.concatenate would do.
Same for option: EXTERNAL_CONCATENATE is enough
##########
File path: common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
##########
@@ -3254,6 +3254,8 @@ private static void populateLlapDaemonVarsSet(Set<String>
llapDaemonVarsSetLocal
TRANSACTIONAL_CONCATENATE_NOBLOCK("hive.transactional.concatenate.noblock",
false,
"Will cause 'alter table T concatenate' to be non-blocking"),
+
ENABLE_CONCATENATE_FOR_EXTERNAL_TABLES("hive.concatenate.enable-external-tables",
false,
+ "Enable concatenate for external tables"),
Review comment:
What is the expected behaviour of this one? Add some description
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 652885)
Remaining Estimate: 0h
Time Spent: 10m
> Enable concatenate for external table.
> --------------------------------------
>
> Key: HIVE-25520
> URL: https://issues.apache.org/jira/browse/HIVE-25520
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
> Reporter: Harish JP
> Assignee: Harish JP
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Concatenate for external tables are disabled, enable this under a flag.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
