Pengcheng Xiong created HIVE-10677:
--------------------------------------

             Summary: hive.exec.parallel=true has problem when it is used for 
analyze table column stats
                 Key: HIVE-10677
                 URL: https://issues.apache.org/jira/browse/HIVE-10677
             Project: Hive
          Issue Type: Bug
            Reporter: Pengcheng Xiong


To reproduce it, in q tests.
{code}
hive> set hive.exec.parallel;
hive.exec.parallel=true
hive> analyze table src compute statistics for columns;
FAILED: Execution Error, return code 1 from 
org.apache.hadoop.hive.ql.exec.ColumnStatsTask
java.lang.RuntimeException: Error caching map.xml: java.io.IOException: 
java.lang.InterruptedException
        at 
org.apache.hadoop.hive.ql.exec.Utilities.setBaseWork(Utilities.java:747)
        at 
org.apache.hadoop.hive.ql.exec.Utilities.setMapWork(Utilities.java:682)
        at 
org.apache.hadoop.hive.ql.exec.Utilities.setMapRedWork(Utilities.java:674)
        at 
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:375)
        at 
org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137)
        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
        at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88)
        at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:75)
Caused by: java.io.IOException: java.lang.InterruptedException
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:541)
        at org.apache.hadoop.util.Shell.run(Shell.java:455)
        at 
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
        at org.apache.hadoop.util.Shell.execCommand(Shell.java:791)
        at org.apache.hadoop.util.Shell.execCommand(Shell.java:774)
        at 
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:646)
        at 
org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:472)
        at 
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:460)
        at 
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:426)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:906)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:887)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:784)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:773)
        at 
org.apache.hadoop.hive.ql.exec.Utilities.setBaseWork(Utilities.java:715)
        ... 7 more
hive> Job Submission failed with exception 'java.lang.RuntimeException(Error 
caching map.xml: java.io.IOException: java.lang.InterruptedException)'
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to