After upgrading from Hadoop 0.20.1 to Hadoop 0.20.2, our problem has gone
away. My recommendation: If you are using Hive 0.6.0, upgrade to Hadoop
0.20.2.
On Wed, Dec 8, 2010 at 8:27 AM, Ryan LeCompte wrote:
> Yes, I also find it very strange.
>
> Unfortunately, it's not an ideal workaround since
Yes, I also find it very strange.
Unfortunately, it's not an ideal workaround since having
hive.merge.mapfiles=false means that we have a lot of blocks being utilized
that only have a small amount of data in them (much less than the
configured HDFS block size).
Can you think of any other workaro
Ryan, I wonder why setting 'hive.merge.mapfiles=false' could solve the issue.
The issue seems to be a metastore related (drop table could not find
default.test_table). This is probably due to the database support newly
introduced in 0.6 (see JIRA HIVE-675).
On Dec 7, 2010, at 10:21 AM, Ryan LeC
Sorry for all of the messages! Stupid gmail client.
It turns out that I was able to resolve the failures by setting
"hive.merge.mapfiles=false" (by default it is true).
I think this is because I'm running Hadoop version 0.20.1, r810220.
This thread is what lead me to try this:
http://www.mail-ar
Digging even further, here's what I see:
NOTE: We have a table in Hive called "test_table" but this seems to look for
"default.test_table" ? )
2010-12-07 00:52:24,600 ERROR metadata.Hive (Hive.java:getTable(357)) -
NoSuchObjectException(message:default.test_table table not found)
at
org.a
Digging even further, here's what I see:
NOTE: We have a table in Hive called "test_table" but this seems to look for
"default.test_table" ? )
2010-12-07 00:52:24,600 ERROR metadata.Hive (Hive.java:getTable(357)) -
NoSuchObjectException(message:default.test_table table not found)
at
org.a
Digging even further, here's what I see:
NOTE: We have a table in Hive called "test_table" but this seems to look for
"default.test_table" ? )
2010-12-07 00:52:24,600 ERROR metadata.Hive (Hive.java:getTable(357)) -
NoSuchObjectException(message:default.test_table table not found)
at
org.a
I just put the Hive log4j config file on DEBUG, and here is the error that
I'm seeing:
2010-12-07 12:16:50,281 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
2010-12-07
Hello all,
This morning we upgraded our cluster to use Hive 0.6.0 from Hive 0.5.0. I
ran the Derby DB migration script before upgrading.
All of our queries are running fine, however our INSERT OVERWRITE queries
are failing immediately. I am not sure what the problem is.
When we submit an INSERT
