Re: Unable to retrieve date

2015-01-29 Thread Nagarjuna Vissarapu
Help full thank you On Jan 30, 2015 11:45 AM, "Devopam Mittra" wrote: > please consider not writing a new UDF and instead using the following > syntax with built-in UDFs itself . > > SELECT > from_unixtime(unix_timestamp('07/Dec/2014:23:59:04','dd/MMM/:HH:mm:ss'), > 'dd-MMM- HH:mm:ss') >

Re: Unable to retrieve date

2015-01-29 Thread Devopam Mittra
please consider not writing a new UDF and instead using the following syntax with built-in UDFs itself . SELECT from_unixtime(unix_timestamp('07/Dec/2014:23:59:04','dd/MMM/:HH:mm:ss'), 'dd-MMM- HH:mm:ss') FROM twitter_data_raw LIMIT 1; feel free to play around with the formats to get desi

Re: Unable to retrieve date

2015-01-29 Thread DU DU
why not just replace / to - by internal string functions? On Thu, Jan 29, 2015 at 2:38 PM, Jason Dere wrote: > to_date() expects a string like '2014-12-07 23:59:04' rather than > '07-Dec-2014 23:59:04' > > > On Jan 29, 2015, at 1:42 AM, Nagarjuna Vissarapu > wrote: > > Hi All, > > I wrote hive

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

2015-01-29 Thread Teja Kunapareddy
unsubscribe On 29 January 2015 at 14:01, Brock Noland wrote: > Congratulations!! :) > > On Wed, Jan 28, 2015 at 1:15 PM, Carl Steinbach wrote: > >> I am pleased to announce that Szehon Ho, Vikram Dixit, Jason Dere, Owen >> O'Malley and Prasanth Jayachandran have been elected to the Hive Project

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

2015-01-29 Thread Brock Noland
Congratulations!! :) On Wed, Jan 28, 2015 at 1:15 PM, Carl Steinbach wrote: > I am pleased to announce that Szehon Ho, Vikram Dixit, Jason Dere, Owen > O'Malley and Prasanth Jayachandran have been elected to the Hive Project > Management Committee. Please join me in congratulating the these new

Re: Unable to retrieve date

2015-01-29 Thread Jason Dere
to_date() expects a string like '2014-12-07 23:59:04' rather than '07-Dec-2014 23:59:04' On Jan 29, 2015, at 1:42 AM, Nagarjuna Vissarapu wrote: > Hi All, > > I wrote hive UDF to convert > > 07/Dec/2014:23:59:04 to 07-Dec-2014 23:59:04 > > I attached UDF. PFA ... > > I added jar to hiv

Re: Partitioned table and Bucket Map Join

2015-01-29 Thread murali parimi
agreed! On Jan 29, 2015, at 11:42 PM, matshyeq wrote: no confusion here. My use case is exactly the same. 1. What I was saying is my/your join condition looks like (or should look like, in your terms): FROM A JOIN B ON A.X = B.X AND A.Y = B.Y which should trigger merge bucket map join in my

Re: Partitioned table and Bucket Map Join

2015-01-29 Thread matshyeq
no confusion here. My use case is exactly the same. 1. What I was saying is my/your join condition looks like (or should look like, in your terms): FROM A JOIN B ON A.X = B.X AND A.Y = B.Y which should trigger merge bucket map join in my opinion: Data locality information is full - you may look a

Re: Partitioned table and Bucket Map Join

2015-01-29 Thread murali parimi
Hello apologize for the confusion. Here I will iterate the problem again. I have two tables A, B which are partitioned on column X and bucketed (Same number of buckets) based on column Y. Table A is huge in terms of size (~135GB) and Table B is smaller table in terms of size (33GB). Both the ta

Re: Query fails for certain conditions in the while clause

2015-01-29 Thread murali parimi
please ignore. Wrong thread! On Jan 29, 2015, at 09:33 PM, Mostafa T wrote: would you elaborate please On Thu, Jan 29, 2015 at 5:50 PM, murali parimi wrote: My bad. The tables are Bucketed on the same join key. Sent from my iPhone On Jan 29, 2015, at 9:38 AM, Mostafa T wrote: Hello, I

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

2015-01-29 Thread Chaoyu Tang
Congratulations to everyone. On Thu, Jan 29, 2015 at 10:05 AM, Aihua Xu wrote: > +1. Cong~ everyone! > > On Jan 29, 2015, at 9:43 AM, Philippe Kernévez wrote: > > Congratulations everyone ! > > On Wed, Jan 28, 2015 at 10:15 PM, Carl Steinbach wrote: > >> I am pleased to announce that Szehon Ho

Re: Query fails for certain conditions in the while clause

2015-01-29 Thread Mostafa T
would you elaborate please On Thu, Jan 29, 2015 at 5:50 PM, murali parimi < muralikrishna.par...@icloud.com> wrote: > My bad. The tables are Bucketed on the same join key. > > Sent from my iPhone > > On Jan 29, 2015, at 9:38 AM, Mostafa T wrote: > > Hello, > I try to run a nested query. > In the

Re: Query fails for certain conditions in the while clause

2015-01-29 Thread murali parimi
My bad. The tables are Bucketed on the same join key. Sent from my iPhone > On Jan 29, 2015, at 9:38 AM, Mostafa T wrote: > > Hello, > I try to run a nested query. > In the where clause in the inner query if I include all of the expressions > hereunder, it fails. > WHERE query_id = 6028 > AND

Re: UPDATE : Adding new columns to parquet based Hive table

2015-01-29 Thread Kumar V
I wanted to clarify something.  It works if the Hive-Parquet table is a plain vanilla table.  But if the table is a partitioned table, then the error occurs after adding new fields to the table.   Any ideas on how to handle this ? hive> create table nvctest_part(col1 string,col2 string, col3 int)

Query fails for certain conditions in the while clause

2015-01-29 Thread Mostafa T
Hello, I try to run a nested query. In the where clause in the inner query if I include all of the expressions hereunder, it fails. WHERE query_id = 6028 AND created_at_basic_date >= 20141230 AND created_at_basic_date <= 20150126 However if I included only the query_id or one or both of the dates

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

2015-01-29 Thread Aihua Xu
+1. Cong~ everyone! On Jan 29, 2015, at 9:43 AM, Philippe Kernévez wrote: > Congratulations everyone ! > > On Wed, Jan 28, 2015 at 10:15 PM, Carl Steinbach wrote: > I am pleased to announce that Szehon Ho, Vikram Dixit, Jason Dere, Owen > O'Malley and Prasanth Jayachandran have been elected to

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

2015-01-29 Thread Philippe Kernévez
Congratulations everyone ! On Wed, Jan 28, 2015 at 10:15 PM, Carl Steinbach wrote: > I am pleased to announce that Szehon Ho, Vikram Dixit, Jason Dere, Owen > O'Malley and Prasanth Jayachandran have been elected to the Hive Project > Management Committee. Please join me in congratulating the the

Re: Partitioned table and Bucket Map Join

2015-01-29 Thread matshyeq
My hunch is while partitioning is in fact very similar to bucketing (actually superior as you have some control over what file data goes to) the hive optimizer only applies bucket joins if your tables are bucketed so your join condition t1.bucketed_column = t2.bucketed_column triggers the bucket

Re: Partitioned table and Bucket Map Join

2015-01-29 Thread murali parimi
I faced the same situation where two tables with 3 billion records on each side and partitioned, sorted on same key. Set the following parameters in the hive query assuming the join will happen in the map phase. set hive.input.format=org.apache.hadoop.hive.ql.io.BucketizedHiveInputFormat; set h

Partitioned table and Bucket Map Join

2015-01-29 Thread matshyeq
I do have two tables partitioned on the same criteria. Could I still take advantage of Bucket Map Join or better, Sort Merge Bucket Map Join? How? ~Maciek

Re: tfetchresultsresp row returns zero

2015-01-29 Thread George Livingston
Hi Vaibhav, Thank you so much, it was very helpful for me. Regards, George On Thu, Jan 29, 2015 at 12:36 AM, Vaibhav Gumashta < vgumas...@hortonworks.com> wrote: > Hi George, > > This was done as part of https://issues.apache.org/jira/browse/HIVE-3746. > The reason was that the previous seria

Unable to retrieve date

2015-01-29 Thread Nagarjuna Vissarapu
Hi All, I wrote hive UDF to convert 07/Dec/2014:23:59:04 to 07-Dec-2014 23:59:04 I attached UDF. PFA ... I added jar to hive and created temporary function *stringTotimestampQuery: select stringTotimestamp(date) from rm_get limit 1;* *Result: * [image: Inline image 1] *Query: select to_date

Re: HiveServer2 multiple instances

2015-01-29 Thread Vaibhav Gumashta
Arali, You can use this feature from Hive 14 onwards for your use case: https://issues.apache.org/jira/browse/HIVE-8376 Thanks, -Vaibhav From: arali tech mailto:aralitec...@gmail.com>> Reply-To: user mailto:user@hive.apache.org>> Date: Monday, December 15, 2014 at 1:35 AM To: user mailto:user@h

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

2015-01-29 Thread Matouk IFTISSEN
Congratulations ;) Le 29 janv. 2015 05:00, "Jimmy Xiang" a écrit : > Congrats!! > > On Wed, Jan 28, 2015 at 7:20 PM, Devopam Mittra wrote: > > +1 > > > > Congratulations !! > > > > warm regards > > Devopam > > > > > > On Thu, Jan 29, 2015 at 2:45 AM, Carl Steinbach wrote: > >> > >> I am pleased