RE:

2012-01-10 Thread Lu, Wei
BTW, I am using hive 0.7 From: Lu, Wei Sent: Wednesday, January 11, 2012 3:13 PM To: 'user@hive.apache.org' Subject: Hi, I am using ThriftHive.Client to access a pretty large table. SQL Statement: selecta11.asin asin, max(a11.title) title, a11.salesrank sa

[no subject]

2012-01-10 Thread Lu, Wei
Hi, I am using ThriftHive.Client to access a pretty large table. SQL Statement: selecta11.asin asin, max(a11.title) title, a11.salesrank salesrank, a11.category category, avg(a11.avg_rating) WJXBFS1, sum(a11.

Support for Hadoop 1.0.0

2012-01-10 Thread Graeme Wallace
Hi All, How can i get a version of Hive that runs on Hadoop 1.0.0 ? Tried looking around for a nightly build release but doesnt seem to be one. Running 0.8 on top of 1.0 complains about null classes in some shim stuff. regards, -- Graeme Wallace CTO FareCompare.com

Re: How to calculate count of quarter wise record in Hive?

2012-01-10 Thread Aniket Mokashi
I discussed this offline. The problem was -- https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-GROUPingandSORTingonf%28column%29 Thanks, Aniket On Tue, Jan 10, 2012 at 5:06 AM, Tucker, Matt wrote: > What does your table definition look like? You should be able

Re: nested JSON structures

2012-01-10 Thread Jason Rutherglen
Roberto, Do you have an example of using your project with HBase? Thanks! On Fri, Dec 9, 2011 at 9:29 AM, Roberto Congiu wrote: > I wrote a SerDe that can handle nested structures. > > https://github.com/rcongiu > > Roberto > > > On Fri, Dec 9, 2011 at 7:42 AM, Ibrahim Acet wrote: >> >> Hi, >>

RE: inconsistent results when doing a select over a join

2012-01-10 Thread David Ginzburg
Adding more input The input size of the query was about 353Gb resulted in 638 reducers on a 70 node cluster with Reduce Task Capacity of 286. > Date: Tue, 10 Jan 2012 17:19:59 +0200 > From: guy.doulb...@conduit.com > To: user@hive.apache.org > CC: edlinuxg...@gmail.com > Subject: Re: incons

Re: inconsistent results when doing a select over a join

2012-01-10 Thread Guy Doulberg
Hi guys, I spent the day today investigating this issue, it seems like the differences occur when there are many killed tasks. We are using the fair scheduler, I ran the queries on large data and with low priority which caused the tasks of this job to be preempt(killed) many times. After I

RE: Error in running Hive with Postgresql as metastore DB

2012-01-10 Thread Saurabh Bajaj
Hi Guys, I have found the issue. I did not exit Hive using quit; but instead using the Ctrl Z. As a result, background processed for Hive were running and causing trouble in the query execution. I killed the running Hive processes and was able to run Hive with derby as well as MySQL as metastor

Re: How to calculate count of quarter wise record in Hive?

2012-01-10 Thread Tucker, Matt
What does your table definition look like? You should be able to replace 'quarter' with the real column name, and then try executing the query. On Jan 10, 2012, at 2:01 AM, "Bhavesh Shah" mailto:bhavesh25s...@gmail.com>> wrote: Thanks Aniket for the reply. But when I try this I got the error

setOutputFormatClass

2012-01-10 Thread hadoop hive
hey all, is *setOutputFormatClass *works in Java New Api ???, please tell me if u have any idea. regards ABC

RE: Problem with Hive->Hadoop

2012-01-10 Thread Ian.Meyers
After downgrading the hive references to Hadoop 0.20.2 rather than 0.20.203.0, I was unable to run any Hive queries. I'm still unable to use any aggregate functions whatever from Hive. Very strange behaviour. Again, the error message is as follows: java.io.IOException: Call to ***/***:50030 fai

Re: inconsistent results when doing a select over a join

2012-01-10 Thread Guy Doulberg
Hi, Sorry for the late answer, I ran the query on small data, but couldn't reproduce, I can reproduce it at the moment on data that takes about 1.5 hour to process, I am trying to narrow the amount of data as much as I can, and still reproduce it... But I think it is clear to me, that the sca

Error in running Hive with Postgresql as metastore DB

2012-01-10 Thread Saurabh Bajaj
Hi Everyone, I am getting an error while installing and running hive using postgresql db as a metastore DB. The error is as follows which occurs while running any query in Hive from the terminal FAILED: Error in metadata: javax.jdo.JDOFatalInternalException: Error creating transactional conne