[ 
https://issues.apache.org/jira/browse/HIVE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080267#comment-14080267
 ] 

Lefty Leverenz commented on HIVE-7509:
--------------------------------------

Configuration parameter *hive.merge.orcfile.stripe.level* needs to be added to 
the wiki by the time 0.14.0 is released, but 
*hive.merge.input.format.stripe.level* is internal only so it doesn't belong in 
the wiki.

Besides adding *hive.merge.orcfile.stripe.level* to the Configuration 
Properties doc, a new section could be added to the ORC Files doc listing all 
the ORC configs or pointing to an ORC section in Configuration Properties 
(which hasn't been created yet).

* [Configuration Properties -- ORC parameters | 
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.orc.splits.include.file.footer]
* [ORC Files | 
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC]

> Fast stripe level merging for ORC
> ---------------------------------
>
>                 Key: HIVE-7509
>                 URL: https://issues.apache.org/jira/browse/HIVE-7509
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: TODOC14, orcfile
>             Fix For: 0.14.0
>
>         Attachments: HIVE-7509.1.patch, HIVE-7509.2.patch, HIVE-7509.3.patch, 
> HIVE-7509.4.patch, HIVE-7509.5.patch
>
>
> Similar to HIVE-1950, add support for fast stripe level merging of ORC files 
> through CONCATENATE command and conditional merge task. This fast merging is 
> ideal for merging many small ORC files to a larger file without decompressing 
> and decoding the data of small orc files.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to