Wei Zheng created HIVE-11038:
--------------------------------
Summary: MiniTezCli tests are hanging
Key: HIVE-11038
URL: https://issues.apache.org/jira/browse/HIVE-11038
Project: Hive
Issue Type: Bug
Components: Hive, Tez
Affects Versions: 2.0.0
Reporter: Wei Zheng
Priority: Blocker
Whenever running a MiniTezCli test, it just hangs.
Here's the maven command to run a test:
{code}
$ mvn test -Phadoop-2 -Dtest=TestMiniTezCliDriver
-Dqfile=dynamic_partition_pruning.q
{code}
Here's the tail of org.apache.hadoop.hive.cli.TestMiniTezCliDriver-output.txt:
{code}
Status: Running (Executing on YARN cluster with App id
application_1434574617753_0001)
Map 1: -/- Reducer 2: 0/1
Map 1: 1/1 Reducer 2: 1/1
POSTHOOK: query: analyze table lineitem compute statistics for columns
POSTHOOK: type: QUERY
POSTHOOK: Input: default@lineitem
POSTHOOK: Output:
file:/Users/wzheng/bf/hive/itests/qtest/target/tmp/localscratchdir/c684ea6a-11b1-4253-a529-c3778695b72a/hive_2015-06-17_13-57-19_047_1275844087077606719-1/-mr-10000
OK
Time taken: 0.387 seconds
Begin query: dynamic_partition_pruning.q
ivysettings.xml file not found in HIVE_HOME or
HIVE_CONF_DIR,/Users/wzheng/bf/hive/conf/ivysettings.xml will be used
{code}
And here's the jstack output (partial):
{code}
"main" #1 prio=5 os_prio=31 tid=0x00007fc75e805800 nid=0x1303 waiting on
condition [0x0000000101d84000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.hive.ql.exec.tez.TezJobMonitor.monitorExecution(TezJobMonitor.java:378)
at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:168)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1657)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1416)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1197)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1061)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1051)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:311)
at
org.apache.hadoop.hive.ql.QTestUtil.executeClientInternal(QTestUtil.java:1033)
at
org.apache.hadoop.hive.ql.QTestUtil.executeClient(QTestUtil.java:1007)
at
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.runTest(TestMiniTezCliDriver.java:146)
at
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynamic_partition_pruning(TestMiniTezCliDriver.java:130)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at junit.framework.TestCase.runTest(TestCase.java:176)
at junit.framework.TestCase.runBare(TestCase.java:141)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:129)
at junit.framework.TestSuite.runTest(TestSuite.java:255)
at junit.framework.TestSuite.run(TestSuite.java:250)
at
org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
"VM Thread" os_prio=31 tid=0x00007fc75e830800 nid=0x3103 runnable
"GC task thread#0 (ParallelGC)" os_prio=31 tid=0x00007fc75e811800 nid=0x2103
runnable
"GC task thread#1 (ParallelGC)" os_prio=31 tid=0x00007fc75f000000 nid=0x2303
runnable
"GC task thread#2 (ParallelGC)" os_prio=31 tid=0x00007fc75f001000 nid=0x2503
runnable
"GC task thread#3 (ParallelGC)" os_prio=31 tid=0x00007fc75f800000 nid=0x2703
runnable
"GC task thread#4 (ParallelGC)" os_prio=31 tid=0x00007fc75f801000 nid=0x2903
runnable
"GC task thread#5 (ParallelGC)" os_prio=31 tid=0x00007fc75f801800 nid=0x2b03
runnable
"GC task thread#6 (ParallelGC)" os_prio=31 tid=0x00007fc75f802000 nid=0x2d03
runnable
"GC task thread#7 (ParallelGC)" os_prio=31 tid=0x00007fc75f802800 nid=0x2f03
runnable
"VM Periodic Task Thread" os_prio=31 tid=0x00007fc75c00c800 nid=0x5303 waiting
on condition
JNI global references: 293
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
