RE: Lag function in Hive

2012-04-11 Thread Butani, Harish
Hi Ashutosh, Thanks for taking a look. Yes definitely open to contributing back to Hive. Had a conversation with Carl Steinbach last week about this. Will send you a follow up message. Regards, Harish From: Ashutosh Chauhan [mailto:hashut...@apache.org] Sent: Wednesday, April 11, 2012 7:55 AM To

Re: Graph/Plotting in Hive/Hadoop

2012-04-11 Thread Edward Capriolo
The historgram UDF can be used to create data from GNU-plot. Here is something I do: Hive's default output is tab delimited. There are javascript graphing libraries like amcharts. I produce tab files and let simple HTML pages be the front end for AM charts. This allows me to create raw data with

Re: RE: Re: cannot start the thrift server

2012-04-11 Thread shashwat shriparv
Hey check this and according to your version download the jdbc jars and follow the steps it will help for sure, as this is given in context to amazon but it works for hive running at local pc http://docs.amazonwebservices.com/ElasticMapReduce/latest/DeveloperGuide/UsingEMR_Hive.html On Wed, Apr

Re: Graph/Plotting in Hive/Hadoop

2012-04-11 Thread shashwat shriparv
Hey hive is qury language for no sql, by default i dont think it can be used for plotting graphs rather you can get data through and format it in required shape and the plot using some api, provided ∞ Shashwat Shriparv

Case Studies for 'Programming Hive' book from O'Reilly

2012-04-11 Thread Jason Rutherglen
Dear Hive User, We want your interesting case study for our upcoming book titled 'Programming Hive' from O'Reilly. How you use Hive, either high level or low level code details are both encouraged! Feel free to reach out with a brief abstract. Regards, Jason Rutherglen

Re: Thrift service + zklocks + time = death

2012-04-11 Thread Edward Capriolo
Once hive gets into this condition every meaningful query fails. Calling this: h.client.execute("describe fracture_act"); h.client.execute("show locks"); Will throw the exception. I do not know if a specific query is causing this but I doubt it. We have been using hive locks by default for months

Re: Lag function in Hive

2012-04-11 Thread Ashutosh Chauhan
Hey Harish, Awesome work on SQL Windowing. Judging from participation on this thread, it seems windowing is of sizable interest to Hive community. Would you consider contributing your work upstream in Hive? If its in Hive contrib, it will be accessible to lot of folks using Hive out of box. Thank

Re: Thrift service + zklocks + time = death

2012-04-11 Thread Ashutosh Chauhan
Premise of the locking is that in well-behaved queries you will obtain a lock at the start of the query and then relinquish it at the end of query. Since, locks are lease-based, in badly-behaving queries after lease expires, lock will be relinquished. Are you are NPE for same repeated query after

Re: Thrift service + zklocks + time = death

2012-04-11 Thread Edward Capriolo
BTW the problem is not tables being locked. On the server side acquireLocks is getting a null pointer. 32432495-OK 32432498:Error in acquireLocks: java.lang.NullPointerException 32432552-FAILED: Error in acquiring locks: locks on the underlying objects cannot be acquired. retry after some time 324

Thrift service + zklocks + time = death

2012-04-11 Thread Edward Capriolo
Hey all, Running 0.7.1 We are using a combination of hive-thrift+ zookeeper for locking. All works well for a couple days until eventually we hit this condition. HiveServerException(message:Query returned non-zero code: 10, cause: FAILED: Error in acquiring locks: locks on the underlying objects

RE: Does Hive supports EXISTS keyword in select query?

2012-04-11 Thread Hezhiqiang (Ransom)
SEMI is only for exist. Maybe you can try this Select a.* FROM tblA a left outer JOIN tblB b ON a.field1 = b.field1 where a.field2 is null or b.fild2 is null Best regards Ransom. -Original Message- From: Philip Tromans [mailto:philip.j.trom...@gmail.com] Sent: Wednesday, April 11, 20

Re: Lag function in Hive

2012-04-11 Thread Mark Grover
Hi Karan, The error you mentioned you get on creating the temporary function typically happens when there is a typo in the class name (com.example.hive.udf.Lag, in this case). Can you ensure that the jar was properly built and contains the Lag class in the com.example.hive.udf package? Mark M

Re: Does Hive supports EXISTS keyword in select query?

2012-04-11 Thread Philip Tromans
Hi, Hive supports EXISTS via SEMI JOIN. Have a look at: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Joins Cheers, Phil. On 11 April 2012 13:59, Bhavesh Shah wrote: > Hello all, > I want to query like below in Hive: > Select a.* FROM tblA a JOIN tblB b ON a.field1 = b.field

Does Hive supports EXISTS keyword in select query?

2012-04-11 Thread Bhavesh Shah
Hello all, I want to query like below in Hive: Select a.* FROM tblA a JOIN tblB b ON a.field1 = b.field1 where (a.field2 is null or not exists(select field2 from tblB where filed2 is not null) But I think Hive doesn't supports EXISTS keyword so how can I overcome this issue? Pls suggest me some so

RE: Lag function in Hive

2012-04-11 Thread karanveer.singh
That's the whole problem rite, I am unable to create a unique column for my record rows within Hive. If that's there, I can get the lag functionality to work for me. I was hoping that ROWNUM will act like a pseudo column in Hive. Regards, From: Nitin Pawar [mai

RE: Lag function in Hive

2012-04-11 Thread karanveer.singh
Rob n all - I tried below and created the jar file. For adding jar to class path, I do following: hive> add jar /users/unix/singhka/Analytics.jar; The above seems to have worked fine as I see the resource added but when I go ahead and create a function, I get the following error. Any ideas wh