[
https://issues.apache.org/jira/browse/HIVE-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15125875#comment-15125875
]
yangfang commented on HIVE-12877:
---------------------------------
I have add .q test in index_query_compressed_file_failure.q,
19-index_compressed_file.gz is my compressed file which used for test.
> Hive use index for queries will lose some data if the Query file is
> compressed.
> -------------------------------------------------------------------------------
>
> Key: HIVE-12877
> URL: https://issues.apache.org/jira/browse/HIVE-12877
> Project: Hive
> Issue Type: Bug
> Components: Indexing
> Affects Versions: 1.2.1
> Environment: This problem exists in all Hive versions.no matter what
> platform
> Reporter: yangfang
> Attachments: 19-index_compressed_file.gz, HIVE-12877.1.patch,
> HIVE-12877.patch, index_query_compressed_file_failure.q
>
>
> Hive created the index using the extracted file length when the file is the
> compressed,
> but when to divide the data into pieces in MapReduce,Hive use the file length
> to compare with the extracted file length,if
> If it found that these two lengths are not matched, It filters out the
> file.So the query will lose some data.
> I modified the source code and make hive index can be used when the files is
> compressed,please test it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
