[ 
https://issues.apache.org/jira/browse/HIVE-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219958#comment-14219958
 ] 

Sushanth Sowmyan commented on HIVE-8910:
----------------------------------------

Per the qa test fails, looks like there is still an order of instantiation or 
copying job properties to conf issue to solve : 

{noformat}
Begin query: hbase_binary_external_table_queries.q
java.lang.IllegalArgumentException: Must specify table name
        at 
org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:188)
        at 
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:73)
        at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
        at 
org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveOutputFormat(HiveFileFormatUtils.java:272)
        at 
org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveOutputFormat(HiveFileFormatUtils.java:267)
        at 
org.apache.hadoop.hive.ql.exec.Utilities.createDummyFileForEmptyPartition(Utilities.java:3354)
        at 
org.apache.hadoop.hive.ql.exec.Utilities.getInputPaths(Utilities.java:3285)
        at 
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:371)
        at 
org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137)
        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
        at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1644)
        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1404)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1217)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1044)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1034)
        at 
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:199)
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:151)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:362)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:297)
        at org.apache.hadoop.hive.ql.QTestUtil.executeClient(QTestUtil.java:849)
        at 
org.apache.hadoop.hive.cli.TestHBaseCliDriver.runTest(TestHBaseCliDriver.java:112)
{noformat}

This can happen when we instantiate an OutputFormat associated with a storage 
driver without doing the set up for it first, via 
StorageHandler.configureOutputJobProperties or 
StorageHandler.configureInputJobProperties, and setting those job properties in 
the conf provided to the outputformat.

> Refactoring of PassThroughOutputFormat 
> ---------------------------------------
>
>                 Key: HIVE-8910
>                 URL: https://issues.apache.org/jira/browse/HIVE-8910
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>         Attachments: HIVE-8910.1.patch.txt, HIVE-8910.2.patch.txt
>
>
> It's overly complicated just for doing simple wrapping of output format. 
> Before things get more worse, we should refactor this codes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to