RE: hive map field question

Wow, this is great news. I read about explode and wished map had that. Thanks so much, Chalcy From: Bejoy Ks [mailto:bejoy...@yahoo.com] Sent: Wednesday, November 23, 2011 1:05 PM To: user@hive.apache.org Subject: Re: hive map field question Hi Chalcy Support for splitting a column of m

Re: hive map field question

Hi Chalcy     Support for splitting a column of map data type into key and values is available on the hive latest trunk. You can use a explode() UDF to achieve the same, which used to support only arrays previously. http://svn.apache.org/viewvc/hive/trunk/ql/src/java/org/apache/hadoop/hive/

Re:

Denis, As far as I understand, hive-site.xml is read at "start-up". Are you making sure that this file is available when Hive starts up? Is this an AWS cluster or an in-house cluster? Mark - Original Message - From: "Denis Kreis" To: user@hive.apache.org Sent: Wednesday, November 23, 20

Re: hive map field question

Chalcy, I don't know of an existing UDF that lists all keys and values of a map. You may want to check ql/src/java/org/apache/hadoop/hive/ql/udf in Hive source to double check. But, as you might have guessed, it'd be pretty straightforward to do that in your own UDF:-) Mark - Original Mess

Re:

If I set a property in the hive-site.xml, and wenn exetute "SET ;" in the shell I'm getting the property value that is in hive-default.xml file. 2011/11/23 shashwat shriparv : > What should add to add in hive-site.xml, where should i give the hbase site > adddress with port no and with what settin

RE: hive map field question

Thanks, Mark. I'll try that. Also, is there a way to list all the keys and values in a map field? Thanks, Chalcy -Original Message- From: Mark Grover [mailto:mgro...@oanda.com] Sent: Wednesday, November 23, 2011 11:01 AM To: user@hive.apache.org Subject: Re: hive map field question

Re:

What should add to add in hive-site.xml, where should i give the hbase site adddress with port no and with what setting?? Thanks and regards Shashwat On Wed, Nov 23, 2011 at 7:58 PM, Florin Diaconeasa < florin.diacone...@gmail.com> wrote: > Hi, > > How did you come to the conclusion that the hiv

Re: hive map field question

Hi Chalcy, You could write a UDF that takes in a Map object and returns you the string you need. Alternatively, you could use Hive Transform. Details here:https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Transform When a map gets passed to your custom transform script, you could

hive map field question

Hello HiveUsers, I have a need to convert a map field to string field and vice versa in a hive table. I could not do cast. I created two external tables with one has string and another map. I can join both to get what I want, takes a long time. Any ideas of how it can be done efficiently ?

Re: load data from s3 to hive

Hello, 1st of all hadoop needs to use S3 as primary file system. So inside hadoop configuration core-site.xml you need to set fs.default.name with a value of the following form: s3n://your-bucket-name After this, the way i've done it in hive 0.6 and i assume it still works: alter table my_table a

Re: Profiling Hive / Metrics

Hello, Unfortunately there are no Hive metrics. Hadoop has metrics, but not sure they would help you, as they are on a much lower level. Florin On 16 November 2011 21:43, john smith wrote: > Hey devs, > > My Hive reducers are running for too long. I wan't to profile Hive and > collect metrics

Re:

Hi, How did you come to the conclusion that the hive-site.xml config is not taken into consideration? Florin On 22 November 2011 21:06, shashwat shriparv wrote: > I have these versions of Hive : 0.7.1 Hbase :0.90.4 and > Hadoop: 0.20.203.0rc1. > I have configured Hive, Hadoop ad Hbase, separat