[jira] [Created] (HADOOP-10063) RunJar ClassLoader cached the class can't release

2013-10-22 Thread Joe Au (JIRA)
Joe Au created HADOOP-10063: --- Summary: RunJar ClassLoader cached the class can't release Key: HADOOP-10063 URL: https://issues.apache.org/jira/browse/HADOOP-10063 Project: Hadoop Common Issue Type:

Combiner Execution

2013-10-22 Thread Mike Schliep
For a class project my group and I are looking to experiment with combining the output from Mappers on the same node or in the same rack. We found the idea at http://wiki.apache.org/hadoop/HadoopResearchProjects. According to http://developer.yahoo.com/hadoop/tutorial/module4.html the output i

Re: Managing docs with hadoop-1 & hadoop-2

2013-10-22 Thread Eli Collins
On Mon, Oct 21, 2013 at 9:50 PM, Arun C Murthy wrote: > > On Oct 18, 2013, at 2:17 PM, Eli Collins wrote: > > On Fri, Oct 18, 2013 at 2:10 PM, Arun C Murthy wrote: > > Folks, > > Currently http://hadoop.apache.org/docs/stable/ points to hadoop-1. With > hadoop-2 going GA, should we just point th

Re: Combiner Execution

2013-10-22 Thread Amr Shahin
What sort of combining are you trying to achieve? Hadoop combining means that hadoop will collect the output from all the maps and guarantee that all the outputs that have the same key will be sent to the same reducer (you can find more details in "hadoop the definitive guide chapters 2 and 6).

Re: Combiner Execution

2013-10-22 Thread Gopal Vijayaraghavan
Hi, I'll answer your questions in reverse. > According to http://developer.yahoo.com/hadoop/tutorial/module4.html the > output is already combined over all Mappers in a node. But we can not find > how this is happening. Can someone point us to where this combiner is > executed? You'll find th

RE: Combiner Execution

2013-10-22 Thread Bikas Saha
+1. A node level or rack level or any level intermediate combiner is fairly straightforward to add in Tez. Please carry over your question to the Apache Tez dev mailing list d...@tez.incubator.apache.org if you are interested in following that path. Bikas -Original Message- From: go...@ho

Re: Combiner Execution

2013-10-22 Thread Tsuyoshi OZAWA
Hi, I'm working in node-level aggregation for MapReduce. Please check the JIRA as follows: https://issues.apache.org/jira/browse/MAPREDUCE-4502 I'm waiting for the review by community. And it also can be implemented in Tez as Bikas and Gopal mentioned. Thanks, On Wed, Oct 23, 2013 at 1:28 AM, B

[jira] [Created] (HADOOP-10064) Upgrade to maven antrun plugin version 1.7

2013-10-22 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HADOOP-10064: -- Summary: Upgrade to maven antrun plugin version 1.7 Key: HADOOP-10064 URL: https://issues.apache.org/jira/browse/HADOOP-10064 Project: Hadoop Common Issu

Re: Hbase to hive

2013-10-22 Thread abhisekgun...@yahoo.com
Thanks Samar ! Sent from my HTC - Reply message - From: "samar.opensource" To: Subject: Hbase to hive Date: Wed, Oct 16, 2013 8:13 AM Hi Abhishek, Not sure if you have seen this link.. https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration It has most of the information n

Hive Hbase Integration

2013-10-22 Thread abhisekgun...@yahoo.com
Hi All, This question is to the developers in hbase and hive integration expertise. How effective is it to create a external hbase table in hive. Refer the below link for hive-hbase integration. Please advice if this would be good idea to go with in a large volume of data being accessed concu