Updated ========== If there are *TWO columns* in table *src*, which are key and value:
SELECT TRANSFORM(*key, value*) USING 'head -n 1' as a,b,c,d FROM src; // * PASS* SELECT TRANSFORM(*key, value, key, value*) USING 'head -n 1' as a,b,c,d FROM src; //* FAILED* 2012/1/17 Bing Li <smallpu...@gmail.com> > Hi, Devs > When I ran UT of *hive-0.8.0*, script_pipe.q failed as: > > [junit] Running org.apache.hadoop.hive.cli.TestCliDriver > [junit] Begin query: *script_pipe.q* > [junit] *java.io.IOException: No such file or directory* > [junit] at java.io.FileOutputStream.writeBytes(Native Method) > [junit] at > java.io.FileOutputStream.write(FileOutputStream.java:293) > [junit] at > java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:76) > [junit] at > java.io.BufferedOutputStream.flush(BufferedOutputStream.java:134) > [junit] at > java.io.BufferedOutputStream.flush(BufferedOutputStream.java:135) > [junit] at > java.io.DataOutputStream.flush(DataOutputStream.java:117) > [junit] * at > org.apache.hadoop.hive.ql.exec.TextRecordWriter.close(TextRecordWriter.java:48) > * > [junit] * at > org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:365) > * > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303) > [junit] at > org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473) > [junit] at > org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > [junit] at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) > [junit]* org.apache.hadoop.hive.ql.metadata.HiveException: Hit error > while closing ..* > [junit] at > org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303) > [junit] at > org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473) > [junit] at > org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > [junit] at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) > [junit] org.apache.hadoop.hive.ql.metadata.HiveException: Hit error > while closing .. > [junit] at > org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303) > [junit] at > org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473) > [junit] at > org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > [junit] at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) > [junit] org.apache.hadoop.hive.ql.metadata.HiveException: Hit error > while closing .. > [junit] at > org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:303) > [junit] at > org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473) > [junit] at > org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > [junit] at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216) > [junit] Ended Job = job_local_0001 with errors > [junit] Error during job, obtaining debugging information... > [junit] Exception: Client Execution failed with error code = 9 > [junit] See build/ql/tmp/hive.log, or try "ant test ... > -Dtest.silent=false" to get more logs. > [junit] junit.framework.AssertionFailedError: Client Execution failed > with error code = 9 > [junit] See build/ql/tmp/hive.log, or try "ant test ... > -Dtest.silent=false" to get more logs. > [junit] at junit.framework.Assert.fail(Assert.java:50) > [junit] at > org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_pipe(TestCliDriver.java:109) > [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > [junit] at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60) > [junit] at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37) > [junit] at java.lang.reflect.Method.invoke(Method.java:611) > [junit] at junit.framework.TestCase.runTest(TestCase.java:168) > [junit] at junit.framework.TestCase.runBare(TestCase.java:134) > [junit] at > junit.framework.TestResult$1.protect(TestResult.java:110) > [junit] at > junit.framework.TestResult.runProtected(TestResult.java:128) > [junit] at junit.framework.TestResult.run(TestResult.java:113) > [junit] at junit.framework.TestCase.run(TestCase.java:124) > [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243) > [junit] at junit.framework.TestSuite.run(TestSuite.java:238) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) > [junit] Cleaning up TestCliDriver > [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 13.701 sec > [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED > [for] /home/libing/Round-6/ibm-hive-0.8.0/ql/build.xml: The > following error occurred while executing this line: > [for] /home/libing/Round-6/ibm-hive-0.8.0/build.xml:317: The > following error occurred while executing this line: > [for] /home/libing/Round-6/ibm-hive-0.8.0/build-common.xml:406: > Tests failed! > > In *script_pipe.q.out*, > > PREHOOK: query: SELECT TRANSFORM(*) USING 'true' AS a, b, c FROM (SELECT * > FROM src LIMIT 1) tmp > PREHOOK: type: QUERY > PREHOOK: Input: default@src > PREHOOK: Output: > file:/tmp/libing/hive_2012-01-17_04-13-08_823_8673422141513900730/-mr-10000 > Execution failed with exit status: 2 > Obtaining error information > > Task failed! > Task ID: > Stage-1 > > Logs: > > /home/libing/workspace-RTC/ibm-hive-0.8.0/build/ql/tmp//hive.log > FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.MapRedTask > > > *Do you have some ideas on this? * > > > Thanks > -- Bing >
