conversion of left outer join to mapjoin

2011-07-22 Thread Koert Kuipers
hello, we have 2 tables x and y. table x is 11GB on disk and has 23M rows. table y is 3GB on disk and has 28M rows. Both tables are stored as LZO compressed sequencefiles without bucketing. a normal join of x an y gets executed as a map-reduce-join in hive and works very well. an outer join also g

Re: jets3t 0.7.4

2011-07-22 Thread Wouter de Bie
And setting httpclient.max-connections=100 doesn't seem to be picked up. --Wouter de Bie Developer Business Intelligence, Spotify wou...@spotify.com (mailto:wou...@spotify.com) +46 72 018 0777 On Friday, July 22, 2011 at 4:54 PM, Wouter de Bie wrote: > Hi, > > When I use 0.6.1, hive gets stuck

java.lang.IllegalStateException when getTable

2011-07-22 Thread Hello World
when I run hive sql "select * from user_info" with hive-jdbc(HiveServer) ,exception occur below. but I run the command "desc user_info" with cli,it's ok,no exception happen if I restart the HiveServer, it gets well this exception often occur after hiveServer run days. is this a bug of datanucleus?

Re: jets3t 0.7.4

2011-07-22 Thread Wouter de Bie
Hi, When I use 0.6.1, hive gets stuck at the following point after about 6 "select * from table limit 10": 2011-07-22 14:50:44,153 DEBUG httpclient.HttpClient (HttpClient.java:executeMethod(322)) - enter HttpClient.executeMethod(HttpMethod) 2011-07-22 14:50:44,153 DEBUG httpclient.HttpClient

Re: jets3t 0.7.4

2011-07-22 Thread Florin Diaconeasa
Hi, First of all i think jets3t is called by hadoop and not by hive. Hive, from my knowledge, doesn't know about the storage system and i see that the jets3t jar is actually inside the lib directory of hadoop. Apparently there is a way to configure jets3t: http://www.jets3t.org/toolkit/configurat