Re:urldecode hive column

2011-09-15 Thread longmans163
It's easy to write a udf by yourself. such as: import org.apache.hadoop.hive.ql.exec.UDF; import org.apache.hadoop.io.Text; import java.net.URLDecoder; import java.io.UnsupportedEncodingException; public class urlDecoder extends UDF{ public urlDecoder(){ } private Text text = new Text(); public

Re: ExecDriver.runningJobKillURIs is not visible

2011-09-15 Thread Krish Khambadkone
Is there anyway to fix this in 0.70 w/o having to upgrade to 0.80. --Krish. On Sep 15, 2011, at 6:00 PM, Edward Capriolo wrote: > This was removed in 0.8.X because as you pointed out the function is no > longer visible. > > On Thu, Sep 15, 2011 at 8:40 PM, Krish Khambadkone > wrote: >

Re: ExecDriver.runningJobKillURIs is not visible

2011-09-15 Thread Edward Capriolo
This was removed in 0.8.X because as you pointed out the function is no longer visible. On Thu, Sep 15, 2011 at 8:40 PM, Krish Khambadkone wrote: > I am using Hive 0.70. When I click on the "List Running > Jobs" > under Administration in the

ExecDriver.runningJobKillURIs is not visible

2011-09-15 Thread Krish Khambadkone
I am using Hive 0.70. When I click on the "List Running Jobs" under Administration in the Hive GUI, I get this exception stack trace. HTTP ERROR 500 Problem accessing /hwi/admin_list_jobs.jsp. Reason: Unable to compile class for JSP An error occurred at line: 40 in the jsp file: /ad

Re: Error from thrift client

2011-09-15 Thread Krish Khambadkone
My bad. I wasn't using the right version libraries on the client. Issue is now fixed. On Sep 14, 2011, at 9:34 PM, Krish Khambadkone wrote: > Hi, I am trying to access Hive 0.70 through jdbc. The hive server is > running on port 6000. The server seems to be getting the call as I see a lo

Re: Compression and Indexing

2011-09-15 Thread yongqiang he
>>Question 1: Indexing should work for both. But i suggest u use block compression. >>Question 3 (and perhaps, the most important): block based compression. On Thu, Sep 15, 2011 at 2:16 PM, Mark Grover wrote: > Hi all, > I've a question regarding compression and indexing. > > I would like to co

Compression and Indexing

2011-09-15 Thread Mark Grover
Hi all, I've a question regarding compression and indexing. I would like to compress our Hive data (presently present as SequenceFile). Also, I have an index on this table and would like to maintain the index as well (i.e. keep using it). Question 1: Sequence file compression can be block or

Re: urldecode hive column

2011-09-15 Thread Loren Siebert
That is cool! I didn’t know this feature existed at all. I’ve been using https://cwiki.apache.org/confluence/display/Hive/LanguageManual as the online manual for Hive, and I don’t see ‘reflect’ mentioned there. I see it here, though: http://archive.cloudera.com/cdh/3/hive/udf/reflect.html. This

Re: urldecode hive column

2011-09-15 Thread Carl Steinbach
It's possible to call Java static methods directly using the built-in 'reflect' UDF. The performance will not be as good as writing your own UDF, but you'll get results a lot faster. On Thu, Sep 15, 2011 at 9:38 AM, Chalcy Raja wrote: > Thank you! Loren. So far I have only using hive as is. Lo

RE: Configuring Hive to automatically create _SUCCESS files

2011-09-15 Thread Siddharth Tiwari
Dear Mike Did u try the same using hive-0.7.1 and hadoop-0.20.2 ? try it out once ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! Date: Thu, 15 Sep 2011 15:59:00 +0200 Subject: Configuring Hive to automatically create _SUCCESS files From: michael.g.n...@go

RE: urldecode hive column

2011-09-15 Thread Chalcy Raja
Thank you! Loren. So far I have only using hive as is. Looks like I have to start extending :) --Chalcy From: Loren Siebert [mailto:lo...@siebert.org] Sent: Thursday, September 15, 2011 12:28 PM To: user@hive.apache.org Subject: Re: urldecode hive column You need to write a UDF, like this per

Re: urldecode hive column

2011-09-15 Thread Loren Siebert
You need to write a UDF, like this person did: http://search-hadoop.com/m/HFWE32CYs6x/v=plain On Sep 15, 2011, at 9:03 AM, Chalcy Raja wrote: > Hi, > > I have a situation where I need to do urldecode on one particular column. Is > there any hive built in function available? > > Thank you,

urldecode hive column

2011-09-15 Thread Chalcy Raja
Hi, I have a situation where I need to do urldecode on one particular column. Is there any hive built in function available? Thank you, Chalcy

Configuring Hive to automatically create _SUCCESS files

2011-09-15 Thread Michael G. Noll
Hello, is there a way to configure Hive 0.7.1 so that it creates _SUCCESS files similar to Hadoop MapReduce and Pig? Hadoop has the property "mapreduce.fileoutputcommitter.marksuccessfuljobs" (see FileOutputCommitter.java), which is as of Hadoop 0.20.203.0 enabled by default. In Pig 0.9.0, you c

Re: remove duplicates based on one (or a few) columns

2011-09-15 Thread Alex Scott-Simons
Hi, Something like: CREATE TABLE deduped AS SELECT col1, col2, MAX(col3), MAX(col4) FROM table GROUP BY col2, col2 That will give you one row per distinct col1, col2, and you can chose the aggregating function to get the appropriate values from the other columns. Alex On 14 September 2011 22:1