Optimized Hadoop

2012-02-16 Thread Anty
Hi: Guys We just deliver a optimized hadoop , if you are interested, Pls refer to https://github.com/hanborq/hadoop -- Best Regards Anty Rao

Re: Optimized Hadoop

2012-02-16 Thread Schubert Zhang
Here is the presentation to describe our job, http://www.slideshare.net/hanborq/hanborq-optimizations-on-hadoop-mapreduce-20120216aWellcome to give your advises. It's just a little step, and we are continue to do more improvements, thanks for your help. On Thu, Feb 16, 2012 at 11:01 PM, Anty wr

Re: Optimized Hadoop

2012-02-16 Thread Todd Lipcon
Hey Schubert, Looking at the code on github, it looks like your rewritten shuffle is in fact just a backport of the shuffle from MR2. I didn't look closely - are there any distinguishing factors? Also, the OOB heartbeat and adaptive heartbeat code seems to be the same as what's in 1.0? -Todd On

hive -e '' not working in 0.8.0

2012-02-16 Thread Sam William
We recently upgraded to Hive-0.8.0 and noticed that all queries fail when run as hive -e with the error , sampd@face:~$ hive -e "show tables;" FAILED: Parse Error: line 1:0 cannot recognize input near 'show' '' '' in ddl statement hive -f option works though . Has anyone else f

Re: hive -e '' not working in 0.8.0

2012-02-16 Thread Carl Steinbach
Hi Sam, I tried running this against the hive-0.8.0 release tarball and did not encounter any problems. Is it possible that you have some old JARs or shell scripts hanging around from a previous Hive install? On Thu, Feb 16, 2012 at 11:58 AM, Sam William wrote: > We recently upgraded to Hive-0.

Re: hive -e '' not working in 0.8.0

2012-02-16 Thread Sam William
Sorry guys, I figured this out. We have a shell script that sets the env variables and then calls the standard hive-0.8.0/bin/hive "$@" . The problem was that the quotes around $@ were missing and the hive executable was just getting the first word . It was just my bad. Thanks, Sam

Re: Optimized Hadoop

2012-02-16 Thread Anty
Hi: Todd yes, the rewritten shuffle in actual a backport of the shuffle from MR2 . We mainly add the following two features: 1) shuffle avoidance 2) work pool On Fri, Feb 17, 2012 at 3:27 AM, Todd Lipcon wrote: > Hey Schubert, > > Looking at the code on github, it looks like your rewritten shuf

Hive Web Interface boots-up fine but doest show the webapp (Hive 0.8.1)

2012-02-16 Thread Abhishek Parolkar
Hi there, I just want to have a simple hive interface with HWI. when I start it with "hive --service hwi' it boots up but when I visit the index.jsp it always complain 404. This is what I am doing http://screencast.com/t/c5Qm8vnNAaI any pointers? -v_abhi_v

Re: Optimized Hadoop

2012-02-16 Thread Schubert Zhang
1) it should be sort-avoidance. 2) work pool (like Tenzing) Sorry ,the adaptive heartbeat code is not in this github code, we are discussing it. On Fri, Feb 17, 2012 at 11:00 AM, Anty wrote: > Hi: Todd > > yes, the rewritten shuffle in actual a backport of the shuffle from MR2 . > We mainly ad

Re: Hive Web Interface boots-up fine but doest show the webapp (Hive 0.8.1)

2012-02-16 Thread Ashutosh Chauhan
Try: 127.0.0.1:9900/hwi On Thu, Feb 16, 2012 at 19:53, Abhishek Parolkar wrote: > > Hi there, >I just want to have a simple hive interface with HWI. when I start it > with "hive --service hwi' it boots up but when I visit the index.jsp it > always complain 404. > This is what I am doing htt

strange error.

2012-02-16 Thread 杨辉强
Hi, all: I am a newbie to hive. When I excute command (select count(*) from log where end_clock = '2012-02-14_08'; ) in hive, it is OK. While I excute command (select count(*) from log where end_clock >= '2012-01-18_08' and end_clock <= '2012-02-14_08';) in hive, it report the follo