RE: Lag function in Hive

2012-04-11 Thread Butani, Harish
To: user@hive.apache.org; Butani, Harish Subject: Re: Lag function in Hive Hey Harish, Awesome work on SQL Windowing. Judging from participation on this thread, it seems windowing is of sizable interest to Hive community. Would you consider contributing your work upstream in Hive? If its in Hive

Re: Lag function in Hive

2012-04-11 Thread Ashutosh Chauhan
> From: karanveer.si...@barclays.com [mailto:karanveer.si...@barclays.com] > Sent: Tuesday, April 10, 2012 7:52 AM > To: user@hive.apache.org > Subject: Re: Lag function in Hive > > Thanks - I will check this out. > > Meanwhile, would default clustering happen using ro

Re: Lag function in Hive

2012-04-11 Thread Mark Grover
e - From: "karanveer singh" To: user@hive.apache.org Sent: Wednesday, April 11, 2012 4:15:59 AM Subject: RE: Lag function in Hive Rob n all - I tried below and created the jar file. For adding jar to class path, I do following: hive> add jar /users/unix/singhka/Analytics.jar; T

RE: Lag function in Hive

2012-04-11 Thread karanveer.singh
itin Pawar [mailto:nitinpawar...@gmail.com] Sent: 11 April 2012 12:15 To: user@hive.apache.org Subject: Re: Lag function in Hive does your table have column called "rownum"? I think From Philip's mail, it was just an example On Wed, Apr 11, 2012 at 11:13 AM, mailto:karanveer.si...@barc

RE: Lag function in Hive

2012-04-11 Thread karanveer.singh
Sent: 10 April 2012 20:32 To: user@hive.apache.org Subject: RE: Lag function in Hive You can write a custom UDF - Here is one that I have played around with, along with some test SQL. It comes with no warrantee :) Sorry I can't really share the test data, but hopefully you get the idea.

Re: Lag function in Hive

2012-04-10 Thread Nitin Pawar
mething here? > > Regards, > Karan > > > -Original Message- > From: David Kulp [mailto:dk...@fiksu.com] > Sent: 10 April 2012 20:15 > To: user@hive.apache.org > Subject: Re: Lag function in Hive > > New here. Hello all. > > Could you try a self-join, possibly als

RE: Lag function in Hive

2012-04-10 Thread karanveer.singh
When I try using rownum in my Hive QL query, I get: "Invalid column reference rownum". Am I missing something here? Regards, Karan -Original Message- From: David Kulp [mailto:dk...@fiksu.com] Sent: 10 April 2012 20:15 To: user@hive.apache.org Subject: Re: Lag function in

RE: Lag function in Hive

2012-04-10 Thread Butani, Harish
data and you are ok with not needing to calculate across partitions. Regards, Harish. -Original Message- From: karanveer.si...@barclays.com [mailto:karanveer.si...@barclays.com] Sent: Tuesday, April 10, 2012 7:52 AM To: user@hive.apache.org Subject: Re: Lag function in Hive Thanks - I

Re: Lag function in Hive

2012-04-10 Thread David Kulp
efault clustering happen using rownum? How can I check on >>> how is clustering happening in our environment? >>> >>> Rgds >>> >>> - Original Message - >>> From: David Kulp >>> To: user@hive.apache.org >>> Sent: Tue Apr

Re: Lag function in Hive

2012-04-10 Thread Philip Tromans
rownum? How can I check on >> how is clustering happening in our environment? >> >> Rgds >> >> - Original Message - >> From: David Kulp >> To: user@hive.apache.org >> Sent: Tue Apr 10 15:45:25 2012 >> Subject: Re: Lag function in Hive &g

RE: Lag function in Hive

2012-04-10 Thread Hamilton, Robert (Austin)
46106448274394 2012-01-12 00:01:45 2012-01-12 00:01:32 1326326437-26270601625187049522752846106448274394 2012-01-12 00:01:48 2012-01-12 00:01:45 -Original Message- From: Philip Tromans [mailto:philip.j.trom...@gmail.com] Sent: Tuesday, April 10, 2012 9:18 AM To: user@hive.apa

Re: Lag function in Hive

2012-04-10 Thread David Kulp
Message - > From: David Kulp > To: user@hive.apache.org > Sent: Tue Apr 10 15:45:25 2012 > Subject: Re: Lag function in Hive > > New here. Hello all. > > Could you try a self-join, possibly also restricted to partitions? > > E.g. SELECT t2.value - t1.value FROM mytabl

Re: Lag function in Hive

2012-04-10 Thread karanveer.singh
explored the possibility of default data > type changes but that does not solve the problem. > > Regards, > Karan > > > -Original Message- > From: Philip Tromans [mailto:philip.j.trom...@gmail.com] > Sent: 10 April 2012 19:48 > To: user@hive.apache.org >

Re: Lag function in Hive

2012-04-10 Thread David Kulp
lored the possibility of default data > type changes but that does not solve the problem. > > Regards, > Karan > > > -Original Message- > From: Philip Tromans [mailto:philip.j.trom...@gmail.com] > Sent: 10 April 2012 19:48 > To: user@hive.apache.org > Sub

RE: Lag function in Hive

2012-04-10 Thread karanveer.singh
[mailto:philip.j.trom...@gmail.com] Sent: 10 April 2012 19:48 To: user@hive.apache.org Subject: Re: Lag function in Hive Hi Karan, To the best of my knowledge, there isn't one. It's also unlikely to happen because it's hard to parallelise in a map-reduce way (it requires knowing whe

Re: Lag function in Hive

2012-04-10 Thread Philip Tromans
Hi Karan, To the best of my knowledge, there isn't one. It's also unlikely to happen because it's hard to parallelise in a map-reduce way (it requires knowing where you are in a result set, and who your neighbours are and they in turn need to be present on the same node as you which is difficult t