Chris McConnell created HIVE-3540: ------------------------------------- Summary: Non-local Hive query with custom InputFormat via CombineFileInputFormat fails with zipped data Key: HIVE-3540 URL: https://issues.apache.org/jira/browse/HIVE-3540 Project: Hive Issue Type: Bug Components: CLI, Query Processor Affects Versions: 0.8.1 Reporter: Chris McConnell Priority: Minor
When accessing a table with zipped data using a custom InputFormat which extends CombineFileInputFormat, any non-local Hive execution will pick up the default org.apache.hadoop.hive.ql.io.CombineHiveInputFormat. Issue spawns from the fact that (by default) InputFormat cannot handle concatenated zip files. To reproduce: Create data that is text based, zip it Create table with a custom input that extends CombineFileInputFormat Execute query that is not local (select * from <table> limit 1;) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira