[
https://issues.apache.org/jira/browse/HIVE-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176551#comment-13176551
]
Chinna Rao Lalam commented on HIVE-2683:
----------------------------------------
Pls check this issue HIVE-1996 it resolves this issue.
> load data twice from the same hdfs file without overwrite fails with return
> code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
> --------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-2683
> URL: https://issues.apache.org/jira/browse/HIVE-2683
> Project: Hive
> Issue Type: Bug
> Components: SQL
> Affects Versions: 0.7.1
> Environment: Cloudera VM for Linux Red Hat
> Reporter: Bobo Vava
>
> I try to load data into a hive table twice from the same hdfs file without
> overwrite option.
> I would expect second load to append to existing data or at least replace it.
> I get the following error message instead.
> Note that, during the operation Hive is renaming the source file to
> <original_name>_copy_<nbr>, which
> makes us believe it is trying to avoid erasing the existing file while moving
> and both files (original and renamed) would be made available to Hive. But
> this is not the case.
> Example of code end error stack :
> load data inpath 'hdfs://0.0.0.0/user/qafiles/SRC_FILE_EMP.dat'
> into table EMP_DELIMITED_FILE_TRUNC_TBL
> -------------------
> Query returned non-zero code: 9, cause: FAILED: Execution Error, return code
> 1 from org.apache.hadoop.hive.ql.exec.MoveTask
> river returned: 9. Errors: Hive history
> file=/tmp/hue/hive_job_log_hue_201112132213_439347746.txt
> Loading data to table default.emp_delimited_file_trunc_tbl
> Failed with exception null
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask
> Failed with exception null
> 11/12/13 22:13:55 ERROR exec.MoveTask: Failed with exception null
> java.lang.NullPointerException
> at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:1738)
> at org.apache.hadoop.hive.ql.metadata.Table.copyFiles(Table.java:542)
> at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:1189)
> at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:197)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState.execute(BeeswaxServiceImpl.java:306)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:510)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:499)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:337)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java
> :1110)
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1.run(BeeswaxService
> Impl.java:499)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java
> :886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908
> )
> at java.lang.Thread.run(Thread.java:619)
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask
> 11/12/13 22:13:55 ERROR ql.Driver: FAILED: Execution Error, return code 1
> from org.apache.hadoop.hive.ql.exec.MoveTask
> 11/12/13 22:13:55 ERROR beeswax.BeeswaxServiceImpl: Exception while
> processing query
> BeeswaxException(message:Driver returned: 9. Errors: Hive history
> file=/tmp/hue/hive_job_log_hue_201112132213_439347746.txt
> Loading data to table default.emp_delimited_file_trunc_tbl
> Failed with exception null
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask
> , log_context:8e8ea906-9b5a-4bfe-9946-515249cc523f,
> handle:QueryHandle(id:8e8ea906-9b5a-4bfe-9946-515249cc523f,
> log_context:8e8ea906-9b5a-4bfe-9946-515249cc523f))
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState.execute(BeeswaxServiceImpl.java:313)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:510)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:499)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:337)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java
> :1110)
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1.run(BeeswaxServiceImpl.java:499)
>
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java
> :886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908
> )
> at java.lang.Thread.run(Thread.java:619)
> 11/12/13 22:13:58 ERROR beeswax.BeeswaxServiceImpl: Caught BeeswaxException
> BeeswaxException(message:Driver returned: 9. Errors: Hive history
> file=/tmp/hue/hive_job_log_hue_201112132213_439347746.txt
> Loading data to table default.emp_delimited_file_trunc_tbl
> Failed with exception null
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask
> , log_context:8e8ea906-9b5a-4bfe-9946-515249cc523f,
> handle:QueryHandle(id:8e8ea906-9b5a-4bfe-9946-515249cc523f,
> log_context:8e8ea906-9b5a-4bfe-9946-515249cc523f))
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState.execute(BeeswaxServiceImpl.java:313)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:510)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:499)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:337)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1110)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1.run(BeeswaxServiceImpl.java:499)
>
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908
> )
> at java.lang.Thread.run(Thread.java:619)
> 11/12/13 22:30:51 ERROR beeswax.BeeswaxServiceImpl: Caught BeeswaxException
> BeeswaxException(message:Driver returned: 9. Errors: Hive history
> file=/tmp/hue/hive_job_log_hue_201112132213_439347746.txt
> Loading data to table default.emp_delimited_file_trunc_tbl
> Failed with exception null
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MoveTask
> , log_context:8e8ea906-9b5a-4bfe-9946-515249cc523f,
> handle:QueryHandle(id:8e8ea906-9b5a-4bfe-9946-515249cc523f,
> log_context:8e8ea906-9b5a-4bfe-9946-515249cc523f))
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState.execute(BeeswaxServiceImpl.java:313)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:510)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1$1.run(BeeswaxServiceImpl.java:499)
>
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:337)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1110)
>
> at
> com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState$1.run(BeeswaxServiceImpl.java:499)
>
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>
> at java.lang.Thread.run(Thread.java:619)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
