Re: How to write Block of queries in Hive?

2012-01-04 Thread Aniket Mokashi
Hi Bhavesh, [moving discussion to hive user list] I would suggest you to send your discussion to hive user list in order to reach a broader audience. As per my understanding, in the query- map_script and reduce_script are custom scripts that run as a streaming jobs. You are asking hive to run ma

Re: Regarding the error in Hive query

2012-01-04 Thread James Warren
(moving to user@hive, bcc'ing dev@hive) Hi Bhavesh - Hive only supports equality conditions for joins. See https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Joins cheers, -James On Tue, Jan 3, 2012 at 10:16 PM, Bhavesh Shah wrote: > Hello, > I am trying to implement join query

drop table -> java.lang.OutOfMemoryError: Java heap space

2012-01-04 Thread Matt Vonkip
Hi folks, I am using elastic-mapreduce in the Amazon EC2 eco-system and would like to upgrade from Hive 0.5 on Hadoop 0.20 to Hive 0.7.1 on Hadoop 0.20.205.  I created a new metastore (on S3) to support testing the latter and have run into some problems.  I have about 15000 partitions in S3 and

Re: Insert based on whether string contains

2012-01-04 Thread bejoy_ks
I agree with Matt on that aspect. The solution proposed by me was purely based on the sample data provided where there were 3 digit comma separated values. If there are chances of 4 digit values as well in event_list you may need to revisit the solution. Regards Bejoy K S -Original Messag

Re: Insert based on whether string contains

2012-01-04 Thread Tucker, Matt
The find_in_set() UDF is a safer choice for doing a search for that value, as %239% could also match 2390, which has a different meaning in Omniture logs. On Jan 4, 2012, at 8:46 AM, "Bejoy Ks" mailto:bejoy...@yahoo.com>> wrote: Hi Dave If I get your requirement correct, you need to l

Re: Insert based on whether string contains

2012-01-04 Thread Bejoy Ks
Hi Dave      If I get your requirement correct, you need to load data into video_plays_for_sept   table FROM omniture table only if omniture.event_list contain the string 239.   Try the following query, it should work fine.   INSERT OVERWRITE TABLE video_plays_for_sept SELECT concat(visid_high,

Insert based on whether string contains

2012-01-04 Thread Dave Houston
Hi there, i have a string that has '239, 236, 232, 934' (not always in that order) and want to insert into another table if 239 is in the string. INSERT OVERWRITE TABLE video_plays_for_sept SELECT concat(visid_high, visid_low), geo_city, geo_country, geo_region from omniture where regexp_extrac

Hive alter table SerDe doesn't work in hive CDH3 for me

2012-01-04 Thread Wei Yao
Hi all: hive alter serde seems doesn't work in CDH3u2 Hadoop and CDH3 Hive 1. create table with wrong regex: CREATE TABLE sample1(key string, value string) row format serde 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe' with serdeproperties (“input.regex”=”[\\w] is [\\w]”) 2. import data file