[
https://issues.apache.org/jira/browse/HIVE-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139931#comment-14139931
]
Xuefu Zhang commented on HIVE-8043:
-----------------------------------
[~lirui] Thanks for providing further details. I guess "alter table ...
concatenate" is a very old feature with some new element, which seems
incomplete in many sense. Lacking documentation is understandable, thus. I'm
not sure of its adoption. Please feel free to create JIRAs on those issues.
Awesome research!
> Support merging small files [Spark Branch]
> ------------------------------------------
>
> Key: HIVE-8043
> URL: https://issues.apache.org/jira/browse/HIVE-8043
> Project: Hive
> Issue Type: Task
> Components: Spark
> Reporter: Xuefu Zhang
> Assignee: Rui Li
> Labels: Spark-M1
> Attachments: HIVE-8043.1-spark.patch, HIVE-8043.2-spark.patch
>
>
> Hive currently supports merging small files with MR as the execution engine.
> There are options available for this, such as
> {code}
> hive.merge.mapfiles
> hive.merge.mapredfiles
> {code}
> Hive.merge.sparkfiles is already introduced in HIVE-7810. To make it work, we
> might need a little more research and design on this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
