Metadata_db error in Hive 0.8

2013-07-16 Thread Maheedhar Reddy
Hi All, I have installed hive 4 months back, i don't have any database installed in my system. till today it was working fine, but now i'm getting this metadata error... can anyone please suggest me do i have to create any settings for derby database to avoid this error?? error is like this..

Re: Use RANK OVER PARTITION function in Hive 0.11

2013-07-16 Thread Richa Sharma
Jerome I would recommend that you try Rank function with columns from just one table first. Once it is established that rank is working fine then add all the joins. I am still on Hive 0.10 so cannot test it myself. However, I can find a similar issue on following link - so its possible you are fa

Re: /tmp/hive-username folder in HDFS

2013-07-16 Thread Edward Capriolo
https://github.com/edwardcapriolo/filecrush The clean.Clean class in filecrush. https://github.com/edwardcapriolo/filecrush/blob/master/src/main/java/com/m6d/filecrush/clean/Clean.java We use it to remove these files once they pass a certain age. On Tue, Jul 16, 2013 at 11:55 PM, Babe Ruth wro

/tmp/hive-username folder in HDFS

2013-07-16 Thread Babe Ruth
Hi Everyone, Does a setting exist to autotrim the /tmp/hive-username folder? I have several TBs of space from old jobs and it is a pain to remember to remove them every few weeks. Thanks,George

Re: how to know a hive query failed

2013-07-16 Thread Brad Ruderman
Sry - sent email prematurely. You need to poll and read the stderr and stdout for text messages alerting there is an error. In python this is what I use: def execute_hive_query(query, hive_exception = None): return_code = None cmd = ["hive","-S", "-e", query] proc = subprocess.Popen(cmd, stdout=s

Re: how to know a hive query failed

2013-07-16 Thread Brad Ruderman
You need to stream and read the stderr and stdout for text messages alerting there is an error. In python this is what I use: On Tue, Jul 16, 2013 at 7:42 PM, kentkong_work wrote: > ** > hi, > I use a shell script to run hive query in background, like this > hive -e "select uname, age fr

how to know a hive query failed

2013-07-16 Thread kentkong_work
hi, I use a shell script to run hive query in background, like this hive -e "select uname, age from usertable" >> result.csv & sometimes, the hive query failed, but I can't find. only thing I can do is waiting for long time, 5 or 6 hours, if I still can't see the result.csv, I kno

Re: Hive 0.11 with Cloudera CHD4.3 MR v1

2013-07-16 Thread kulkarni.swar...@gmail.com
This error is not the actual reason why your job failed. Please look into your jobtracker logs to know the real reason. This error simply means that hive attempted to connect to JT to gather debugging info for your failed job but could not due to a classpath error. On Tue, Jul 16, 2013 at 4:50 PM

Re: Hive 0.11 with Cloudera CHD4.3 MR v1

2013-07-16 Thread Sunita Arvind
Hi Jim, I am new to hive too so cannot suggest much on that front. However, I'm pretty sure that this error indicates that a particular class is missing in your classpath. In the sense, your hive runtime is not able to locate the class org.apache.hadoop.mapreduce.util.HostUtil. Double check your H

Re: [ANNOUNCE] New Hive Committer - Brock Noland

2013-07-16 Thread Shreepadma Venugopalan
Many congrats, Brock! On Tue, Jul 16, 2013 at 7:33 AM, Ricky Saltzer wrote: > Congrats!! > > > On Tue, Jul 16, 2013 at 10:30 AM, Alexander Alten-Lorenz < > wget.n...@gmail.com> wrote: > >> Congratulations, Brock! >> >> On Jul 15, 2013, at 10:29 PM, Carl Steinbach wrote: >> >> > The Apache Hive

How Hive execute the stages?

2013-07-16 Thread Edson Ramiro
Hi all, I am executing the TPC-H [1] queries on Hive and I need help to understand if Hive execute some stages locally. The TPC-H Query-16 [2] is translated to three HiveQL queries, and the EXPLAIN [3] of each of these HiveQL queries show me that the first query has 8 stages, the second query has

Exception Running Hive in eclipse

2013-07-16 Thread Bharati Adkar
Hi Folks, I am running Hive in eclipse. I think I am missing a hive conf property either in the xml file or the debug configuration. The jar file name is set to null. 13/07/16 09:55:23 INFO exec.ExecDriver: Executing: /Users/bharati/hadoop/bin/hadoop jar null org.apache.hadoop.hive.ql.exec.Ex

How to read UDF returning a list

2013-07-16 Thread Kumar V
Hi,     I have a UDF that returns a list and another one that returns a list of lists.  I am not sure how to read the results back as lists in JDBC/hiveserver1. All I can do is while (rset.next()) {  String fld = rset.getString(2); } This returns the field as a string like :  "[[John,Jack,Jill

Re: [ANNOUNCE] New Hive Committer - Brock Noland

2013-07-16 Thread Ricky Saltzer
Congrats!! On Tue, Jul 16, 2013 at 10:30 AM, Alexander Alten-Lorenz < wget.n...@gmail.com> wrote: > Congratulations, Brock! > > On Jul 15, 2013, at 10:29 PM, Carl Steinbach wrote: > > > The Apache Hive PMC has passed a vote to make Brock Noland a new > committer > > on the project. > > > > Broc

Re: [ANNOUNCE] New Hive Committer - Brock Noland

2013-07-16 Thread Alexander Alten-Lorenz
Congratulations, Brock! On Jul 15, 2013, at 10:29 PM, Carl Steinbach wrote: > The Apache Hive PMC has passed a vote to make Brock Noland a new committer > on the project. > > Brock, please submit your ICLA to the Apache Software Foundation as > described here: > > http://www.apache.org/licens

Re: Use RANK OVER PARTITION function in Hive 0.11

2013-07-16 Thread Jérôme Verdier
You can see my query below : SELECT mag.co_magasin, dem.id_produit as id_produit_orig, pnvente.dt_debut_commercial as dt_debut_commercial, COALESCE(pnvente.id_produit,dem.id_produit) as id_prod

Re: Use RANK OVER PARTITION function in Hive 0.11

2013-07-16 Thread Richa Sharma
Can you share query with just RANK(). Richa On Tue, Jul 16, 2013 at 6:08 PM, Jérôme Verdier wrote: > Hi Richa, > > I tried to execute the rank function alone, but the result is the same > > Thanks > > > 2013/7/16 Richa Sharma > >> Hi Jerome >> >> >> I think the problem is you are trying to use

Re: Use RANK OVER PARTITION function in Hive 0.11

2013-07-16 Thread Jérôme Verdier
Hi Richa, I tried to execute the rank function alone, but the result is the same Thanks 2013/7/16 Richa Sharma > Hi Jerome > > > I think the problem is you are trying to use MIN, SUM and RANK function in > a single query. > > Try to get the rank first in a query and on top of it apply these >

Re: Use RANK OVER PARTITION function in Hive 0.11

2013-07-16 Thread Richa Sharma
Hi Jerome I think the problem is you are trying to use MIN, SUM and RANK function in a single query. Try to get the rank first in a query and on top of it apply these aggregate functions Richa On Tue, Jul 16, 2013 at 2:15 PM, Jérôme Verdier wrote: > Hi, > > I have a problem while using RAN

can I create index on an external table?

2013-07-16 Thread 李宏展
Hey,guys on this page https://cwiki.apache.org/confluence/display/Hive/IndexDev,I found this desciption: "Question: should we allow indexes on EXTERNAL tables? What does this mean for implicit DROP when the table is dropped? Is there a concept of an EXTERNAL index?" But there is no answers t

Use RANK OVER PARTITION function in Hive 0.11

2013-07-16 Thread Jérôme Verdier
Hi, I have a problem while using RANK OVER PARTITION function with Hive. Hive is in version 0.11 and, as we can see here : https://cwiki.apache.org/Hive/languagemanual-windowingandanalytics.html, we can now use these functions in Hive. But, when i use it, i encountered this error : FAILED: Sema

can hive use where clause in jdbc?

2013-07-16 Thread ch huang
here is my test output,why the beeline report error when i use where condition?? hive> select foo from demo_hive where bar='value3'; Total MapReduce jobs = 1 Launching Job 1 out of 1 Number of reduce tasks is set to 0 since there's no reduce operator Starting Job = job_1373509276088_0015, Tracking

Re: Strange error in hive

2013-07-16 Thread Jérôme Verdier
Hi, I have apply this patch but unfortunately, the error is still the same when i run the script. Thanks, 2013/7/16 Navis류승우 > patch -p0 -i would work. > > https://cwiki.apache.org/confluence/display/Hive/HowToContribute > > 2013/7/15 Jérôme Verdier : > > Hi, > > > > Thanks for your reply Na