We don't change anything in hive configuration. And several days ago all was working fine. Today this strange exception has appeared. How we can find root of the problem and solve it?
Pavel 2012/7/17 kulkarni.swar...@gmail.com <kulkarni.swar...@gmail.com> > "select *" queries don't really run a M/R job. Rather directly hit HDFS to > grab the results. While "select count(*)" run mappers/reducers to perform > the count on the data. The former running and the latter not suspects > something might be wrong with your hadoop installation. Looking at the > stacktrace, it even seems like the user executing this query might not have > proper access. > > Are you able to run simple M/R jobs with the installation? You might also > want to check on permissions. > > On Tue, Jul 17, 2012 at 9:24 AM, Павел Мезенцев <pa...@mezentsev.org>wrote: > >> Hello all! >> >> We have a trouble with hive. >> My colleague created table "as_test" in hive >> create external table as_test (line STRING) location '/logs/2012-07-16' >> >> Query >> select * from as_test limit 10; >> compliting successfully >> >> but query >> select count (1) from as_test limit 10; >> raise org.apache.hadoop.ipc.RemoteException. >> How we can fix it? >> >> Best regards, >> Pavel >> >> P.S. full stack trace: >> >> org.apache.hadoop.ipc.RemoteException: IPC server unable to read call >> parameters : readObject can't find class >> org.apache.hadoop.fs.permission.FsPermission$2 >> >> at org.apache.hadoop.ipc.Client.call(Client.java:1107) >> >> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226) >> >> at $Proxy4.setPermission(Unknown Source) >> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. >> java:39) >> >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> >> at java.lang.reflect.Method.invoke(Method.java:597) >> >> at >> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82) >> >> at >> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59) >> >> at $Proxy4.setPermission(Unknown Source) >> >> at >> org.apache.hadoop.hdfs.DFSClient.setPermission(DFSClient.java:855) >> >> at >> org.apache.hadoop.hdfs.DistributedFileSystem.setPermission(DistributedFileSystem.java:560) >> >> at >> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:123) >> >> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:839) >> >> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833) >> >> at java.security.AccessController.doPrivileged(Native Method) >> >> at javax.security.auth.Subject.doAs(Subject.java:396) >> >> at >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) >> >> at >> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833) >> >> at >> org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:807) >> >> at >> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:657) >> >> at >> org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123) >> >> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130) >> >> at >> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57) >> >> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063) >> >> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900) >> >> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748) >> >> at >> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164) >> >> at >> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241) >> >> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456) >> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >> >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> >> at java.lang.reflect.Method.invoke(Method.java:597) >> >> at org.apache.hadoop.util.RunJar.main(RunJar.java:186) >> >> Job Submission failed with exception >> 'org.apache.hadoop.ipc.RemoteException(IPC server unable to read call >> parameters: readObject can't find class >> org.apache.hadoop.fs.permission.FsPermission$2)' >> >> FAILED: Execution Error, return code 1 from >> org.apache.hadoop.hive.ql.exec.MapRedTask >> >> > > > -- > Swarnim >
