Re: Add external jars automatically

2013-03-13 Thread Alex Kozlov
If you look into ${HIVE_HOME}/bin/hive script there are multiple ways to add the jar. One of my favorite, besides the .hiverc file, has been to put the jar into ${HIVE_HOME}/auxlib dir. There always is the HIVE_AUX_JARS_PATH environment variable (but this introduces a dependency on the environmen

Re: Lifecycle and Configuration of a hive UDF

2012-04-20 Thread Alex Kozlov
You might also look at http://www.quora .com/Hive-computing/How-are-SQL-type-analytic-and-windowing-functions-accomplished-in-Hadoop-Hivefor a way to utilize secondary sort for analytic windowing functions. RANK() OVER(...) will require grouping and sorting. While it can be done in the mapper or

Re: Hive equivalent of row_number()

2012-04-12 Thread Alex Kozlov
http://www.quora.com/Hive-computing/How-are-SQL-type-analytic-and-windowing-functions-accomplished-in-Hadoop-Hive -- Alex K On Thu, Apr 12, 2012 at 1:43 PM, Saurabh S wrote: > > I have a table with three columns, A, B, and Score,

Re: Field delimited by chr(28)

2012-04-04 Thread Alex Kozlov
It's octal. On Wed, Apr 4, 2012 at 4:16 PM, Steven Wong wrote: > FIELDS TERMINATED BY '\001' is for chr(1). I’m not sure if it’s decimal > or octal. But you can test it out. > > ** ** > > ** ** > > *From:* Chen, Stefanie (GBI) [mailto:stefanie.kim.c...@hp.com] > *Sent:* Wednesday, April 04,

Re: How to load a table from external server....

2012-03-01 Thread Alex Kozlov
Hi Farah, If the data are on another server, you still need to move it one way or another. A bare bone way to do this is to use `hadoop fs -put ...` command after which you can create external or managed table in Hive. If the data are in a relational DB you can use sqoop. You can also look into

Re: Hive assert()?

2011-05-26 Thread Alex Kozlov
1) Would `select count(1) from (query)` do the same thing? I am a bit confused what is the semantic of assert: is it just no rows or some kind of syntax error check? 2) Hive is not an OLTP and is not optimized for single row inserts (or updates for this matter). In a trivial implementation one wo

Re: Multiple Hive queries at once

2011-05-25 Thread Alex Kozlov
Hive queries can be concurrent, however there is no specific locking mechanism to avoid concurrent modifications to either metadata or the data files. Hope this answers your question. On Wed, May 25, 2011 at 2:06 PM, wrote: > Hi everyone, > I couldn't find this information anywhere. I would l