Re: Problem in reduce phase(critical)

2012-02-03 Thread Bharath Mundlapudi
Findout the machine where this attempt_201201271626_5282_m_07_2 was run. See if TT is running or hanged. Rebounce TT on this machine. -Bharath On Fri, Feb 3, 2012 at 6:02 AM, hadoop hive wrote: > > > On Fri, Feb 3, 2012 at 4:56 PM, hadoop hive wrote: > >> hey folks, >> >> i m getting th

hive character encoding

2012-02-03 Thread Chris Kudelka
Greetings, I've some data in HDFS that are non-ASCII utf-8 characters, which display correctly when I cat/text out of hadoop, but Hive doesn't seem to interpret the characters the same way. I can't seem to find any documentation capturing how to alter the table to support utf-8 encoding. Can anyo

Re: How to check if all key/value pairs in two maps are equal?

2012-02-03 Thread Mark Grover
Hi Mark, How about writing your own UDF that does the comparison you want? UDFs can accept complex arguments (e.g. Maps) just like they do primitive ones. If you want to go the string route, you could write a UDF that converts a map to JSON string (I have written something similar, I haven't gott

Re: Problem in reduce phase(critical)

2012-02-03 Thread praveenesh kumar
Logs are saying your reducer is not able to communicate with the mapper.. Its waiting for map-outputs. It could be internet problem or ssh problem. Check your machine 'hadoopdata3' -- Are you able to ping it from all other machines and ssh into it without password from your NN and JT? Thanks, Prav

RE: How to check if all key/value pairs in two maps are equal?

2012-02-03 Thread Sunderlin, Mark
No, can't cast a map into a string *sigh* --- Mark E. Sunderlin Solutions Architect |AOLCore Data Technologies P: 703-256-6935 | C: 540-327-6222 | AIM: MESunderlin 22000 AOL Way | Dulles, VA | 20166 From: Aniket Mokashi [mailto:aniket...@gmail.com] Sent: Thursday, February 02, 2012 1:36 PM T

Problem in reduce phase(critical)

2012-02-03 Thread hadoop hive
On Fri, Feb 3, 2012 at 4:56 PM, hadoop hive wrote: > hey folks, > > i m getting this error while running mapreduce and these comes up in > reduce phase.. > > > 2012-02-03 16:41:19,780 WARN org.apache.hadoop.mapred.ReduceTask: > attempt_201201271626_5282_r_00_0 copy failed: > attempt_2012012

Problem in reduce phase

2012-02-03 Thread hadoop hive
hey folks, i m getting this error while running mapreduce and these comes up in reduce phase.. 2012-02-03 16:41:19,780 WARN org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_00_0 copy failed: attempt_201201271626_5282_m_07_2 from hadoopdata3 2012-02-03 16:41:19,954 WARN or

RE: Not able to create table in hive

2012-02-03 Thread Manish . Bhoge
This command can just tell about the data node and block details. My question was not specific to particular table. But I was not able to run any Hive command from command however same SQL can run from WEB UI. Yes, I am using 2 different users, 'Guest' user from Web and 'admin' user from comma

Re: Not able to create table in hive

2012-02-03 Thread hadoop hive
Thanks Mark, I do have an access on metastore as I am login as admin. However when I query through Hue web interface it is working for me (using User: Guest). Here is how my hive-site.xml looks like. Is there any property that I need to extend here. javax.jdo.option.ConnectionURL jdbc:derby:

Re: Not able to create table in hive

2012-02-03 Thread alo alt
check the rights in hdfs for the table hadoop dfs -fsck /path/to/warehouse/dir/table The table was created with the right of the user guest, so only guest can write in. - Alex -- Alexander Lorenz http://mapredit.blogspot.com On Feb 3, 2012, at 8:58 AM, Manish.Bhoge wrote: > Thanks Mark, >