Re: Row exception in Hive while using join

2015-03-05 Thread Divakar Reddy
Can you try this script? create table table_llv_N_C as select a.chromosome_number, a.position, b.id from (select * from table_line_n_passed where chromosome_number is not null) a join table_line_c_passed b on a.chromosome_number=b.chromosome_number; On Thu, Mar 5, 2015 at 1:41 PM, Vikram Dixit

Re: Create custom UDF

2015-03-05 Thread Buntu Dev
Is there a pivot/transform function available? I need to pivot the rows to columns without the knowledge of the values. Source table: date | page | count 20150301 | p1 | 10 20150301 | p2 | 20 ... Result table that I would like without the knowledge of the distinct values for 'page'

Error using ADD JAR with signed jars

2015-03-05 Thread Rahul Sharma
Hi, I am trying to use a signed jar (BouncyCastle) in one of my UDFs. Since signed jars shouldn't be extracted I am using two ADD JAR statements to add both the UDF jar as well as BouncyCastle provider jar to the classpath. However, hive/hadoop automatically extracts the signed jar (BouncyCastle)

Re: Row exception in Hive while using join

2015-03-05 Thread Vikram Dixit
Hi Krish, Which version of hive are you using? Can you also provide the logs for this run? Regards Vikram. From: krish mailto:kri22go...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Thursday, March 5, 2015 at 3:14 AM To: "user-i..

Re: Create custom UDF

2015-03-05 Thread Buntu Dev
Thanks for the info! On Thu, Mar 5, 2015 at 12:17 PM, Alexander Pivovarov wrote: > Several useful common udf methods we added to GenericUDF recently > https://issues.apache.org/jira/browse/HIVE-9744 > > > you can look at the following UDFs as an example: > > https://github.com/apache/hive/blob/t

Re: Create custom UDF

2015-03-05 Thread Alexander Pivovarov
Several useful common udf methods we added to GenericUDF recently https://issues.apache.org/jira/browse/HIVE-9744 you can look at the following UDFs as an example: https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLevenshtein.java https://githu

Re: Bucket map join - reducers role

2015-03-05 Thread Vikram Dixit
Hi Murali, I think you missed Xuefu's response. Can you post your query and explain output so that we can understand what is happening? Regards Vikram. From: murali parimi mailto:muralikrishna.par...@icloud.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.a

Re: Bucket map join - reducers role

2015-03-05 Thread murali parimi
Hi could someone look into this issue! Please let me know if more details are required. Sent from my iPhone > On Mar 5, 2015, at 8:53 AM, murali parimi > wrote: > >> Hello team, >> >> I have two tables A and B. A has 360Million rows with one column K. B has >> around two billion rows with mu

Re: Bucket map join - reducers role

2015-03-05 Thread murali parimi
> Hello team, > > I have two tables A and B. A has 360Million rows with one column K. B has > around two billion rows with multiple columns including K. > > Both tables are clustered and sorted by K and Bucketed into same number of > buckets. > > When I perform a join, I assumed there won't be

Re: Hive Transactions fail

2015-03-05 Thread Srinivas Thunga
Hi, After seeing your mail, i came to know that you are trying to update and delete operations on Hive 1.0. For doing the same, After extracting Hive version, you have to create Hive meta store http://www.cloudera.com/content/cloudera/en/documentation/cdh5/v5-1-x/CDH5-Installation-Guide/cdh5ig_

Hive Transactions fail

2015-03-05 Thread David Simoes
Ive had some troubles enabling transactions in Hive 1.0.0 and Ive made a post in http://stackoverflow.com/questions/28867368/hive-transactions-are-crashing Could anyone check it out and give me some pointers on why things are crashing? Tyvm, Dave

Fwd: Row exception in Hive while using join

2015-03-05 Thread krish
I got the following exception while executing join on Hive Query and reducer hang after 68% completion. java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=1) {"key":{"joinkey0":"12"},"value":{"_col2":"rs317647905"},"alias":1}

Re: FW: Hive error while starting up services using Ambari

2015-03-05 Thread Srinivas Thunga
Hi, Have you created the Hive Metastore? http://www.cloudera.com/content/cloudera/en/documentation/cdh5/v5-1-x/CDH5-Installation-Guide/cdh5ig_hive_metastore_configure.html and then try to start the server *Thanks & Regards,* *Srinivas T* On Thu, Mar 5, 2015 at 2:57 PM, Pratik Gadiya wrote:

FW: Hive error while starting up services using Ambari

2015-03-05 Thread Pratik Gadiya
Hi, I am trying to deploy a hadoop cluster using Ambari Blueprint. All the services are up and running except one i.e. Hive Server 2. I tried to look into the logs(/var/log/hive/hiveserver2.log) and looks like Hive is trying to access the MySQL service using username:hive. However, I think it does