Re: order by date

2012-03-13 Thread Keith Wiley
Thanks for all the feedback on this. I'll take a look at all the suggestions I received. Cheers! Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Yet mark his perfect self-contentm

RE: order by date

2012-03-13 Thread Tucker, Matt
ley [mailto:kwi...@keithwiley.com] Sent: Tuesday, March 13, 2012 1:47 PM To: user@hive.apache.org Subject: Re: order by date I see how I misled you, sorry. I wasn't implying that my csv data is cleanly represented in -MM-dd format. I was just asking syntactically how to use date functions in Hiv

Re: order by date

2012-03-13 Thread Keith Wiley
Okay, what are the differences and similarities with use a date function for the same purpose? Is there a reason to go one route or the other? On Mar 13, 2012, at 11:29 , Mark Grover wrote: > Hi Keith, > You should also consider writing you own UDF that takes in the date in > "American" format

Re: order by date

2012-03-13 Thread Mark Grover
l Message - From: "Keith Wiley" To: user@hive.apache.org Sent: Tuesday, March 13, 2012 1:47:12 PM Subject: Re: order by date I see how I misled you, sorry. I wasn't implying that my csv data is cleanly represented in -MM-dd format. I was just asking syntactically how to use date

Re: order by date

2012-03-13 Thread Keith Wiley
I see how I misled you, sorry. I wasn't implying that my csv data is cleanly represented in -MM-dd format. I was just asking syntactically how to use date functions in HiveQL because I hadn't found any examples and I used -MM-dd in my example. The dates in my csv tables are often in "

RE: order by date

2012-03-13 Thread Tucker, Matt
he date functions in hive take arguments in string format, with a few functions that will translate between unix timestamps and datetime strings. Matt Tucker -Original Message- From: Keith Wiley [mailto:kwi...@keithwiley.com] Sent: Tuesday, March 13, 2012 1:01 PM To: user@hive.apache.org S

Re: order by date

2012-03-13 Thread Keith Wiley
Is see, you store the date-time as a lexicographically sortable string. That's fine, but I'm operating on existing csv tables. I guess I could whip up a hadoop job to convert all the date-time columns to lexicographic strings and then wrap hive around the resulting converted tables. I was jus

RE: order by date

2012-03-13 Thread Tucker, Matt
Hi Keith, We generally store date columns as a string in a similar format to ISO 8601 (-mm-dd hh:MM:ss). This way, when we put the date column in the ORDER BY clause, it will be sorted chronologically. It also saves us the trouble of whipping out a unix timestamp calculator to figure out