[ 
https://issues.apache.org/jira/browse/HIVE-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13766034#comment-13766034
 ] 

Hudson commented on HIVE-5102:
------------------------------

FAILURE: Integrated in Hive-trunk-h0.21 #2327 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2327/])
HIVE-5102 : ORC getSplits should create splits based the stripes (Owen Omalley 
via Ashutosh Chauhan) (hashutosh: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1522541)
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/ReaderImpl.java
* 
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/StripeInformation.java
* 
/hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcFile.java
* 
/hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
* 
/hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
* 
/hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
* 
/hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java

                
> ORC getSplits should create splits based the stripes 
> -----------------------------------------------------
>
>                 Key: HIVE-5102
>                 URL: https://issues.apache.org/jira/browse/HIVE-5102
>             Project: Hive
>          Issue Type: Bug
>          Components: File Formats
>    Affects Versions: 0.11.0, 0.12.0
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: HIVE-5102.D12579.1.patch, HIVE-5102.D12579.2.patch, 
> HIVE-5102.D12849.1.patch, HIVE-5102.D12849.2.patch
>
>
> Currently ORC inherits getSplits from FileFormat, which basically makes a 
> split per an HDFS block. This can create too little parallelism and would be 
> better done by having getSplits look at the file footer and create splits 
> based on the stripes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to