How is data of each job assigned to nodes in Mumak ?

2011-11-14 Thread ArunKumar
Hi guys ! Q> How can i assign data of each job in mumak nodes and what else i need to do ? In genreral how can i use the pluggable block-placement for HDFS in Mumak ? Meaning in my context i am using 19-jobs-trace json file and modified topology json file consisting of say 4 nodes. Since the nu

Re: 0.21 stable schedule?

2011-11-14 Thread Matt Foley
Sorry, the new bug I opened to backport HADOOP-4012 is HADOOP-7823 . On Mon, Nov 14, 2011 at 11:23 PM, Matt Foley wrote: > Hi Tim, > I'd be happy to look at incorporating this in branch-0.20-security for the > 206 release (or whatever it's calle

Re: 0.21 stable schedule?

2011-11-14 Thread Matt Foley
Hi Tim, I'd be happy to look at incorporating this in branch-0.20-security for the 206 release (or whatever it's called by then :-) I opened a new Jira for the back-port, HADOOP-4012. Please assign the Jira to yourself if you'll be able to do the

[jira] [Created] (HADOOP-7823) port HADOOP-4012 to branch-0.20-security

2011-11-14 Thread Matt Foley (Created) (JIRA)
port HADOOP-4012 to branch-0.20-security Key: HADOOP-7823 URL: https://issues.apache.org/jira/browse/HADOOP-7823 Project: Hadoop Common Issue Type: New Feature Affects Versions: 0.20.205.0

Re: 0.21 stable schedule?

2011-11-14 Thread Arun C Murthy
Sounds good. The hope is that 0.23 will be stable for most folks by end of Q1, 2011 - it really depends on your scale. At Yahoo (50k nodes), Facebook and similar places it will probably take a bit longer. Arun On Nov 14, 2011, at 9:46 PM, Tim Broberg wrote: > Thanks, Arun. > > Any idea how

Re: 0.21 stable schedule?

2011-11-14 Thread Konstantin Boudnik
Tim, stay tuned for upcoming 0.22 release in a coupla weeks or so. You can take a look at/download current tarballs at https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-22-Build/ Cos On Mon, Nov 14, 2011 at 09:19PM, Tim Broberg wrote: > I need a stable version of hadoop with splitt

RE: 0.21 stable schedule?

2011-11-14 Thread Tim Broberg
Thanks, Arun. Any idea how many months to 0.23 (or higher) stable? (years?) I'll try to get cleared to contribute and get that patch in, and meanwhile will ask for that feature in 0.20.206. - Tim. From: Arun Murthy [a...@hortonworks.com] Sent: Monda

Re: 0.21 stable schedule?

2011-11-14 Thread Arun Murthy
Tim, It's highly unlikely you'll see a stable 0.21 at this point. You can ask for a backport to 0.20.2xx (pls open a jira, better yet, a patch :) ) or consider trying hadoop-0.23 which we just released. Fair warning: 0.23 is very much 'alpha' quality currently. thanks, Arun Sent from my iPhone

0.21 stable schedule?

2011-11-14 Thread Tim Broberg
I need a stable version of hadoop with splittable bzip2 compression which is an 0.21 feature.   Is there a schedule for stable 0.21 release?   Failing that, what are my chances of getting splittable bzip2 incorporated into an 0.20.20x.x release?       - Tim.

[jira] [Created] (HADOOP-7822) Hadoop startup script has a race condition : this causes failures in datanodes status and stop commands

2011-11-14 Thread Rahul Jain (Created) (JIRA)
Hadoop startup script has a race condition : this causes failures in datanodes status and stop commands --- Key: HADOOP-7822 URL: https://issues.apache.org/jira/br

[jira] [Created] (HADOOP-7821) Hadoop Messaging Service

2011-11-14 Thread John George (Created) (JIRA)
Hadoop Messaging Service Key: HADOOP-7821 URL: https://issues.apache.org/jira/browse/HADOOP-7821 Project: Hadoop Common Issue Type: New Feature Affects Versions: 0.24.0 Reporter: John George It will

Re: Detecting/Predicting hotspots

2011-11-14 Thread Milind.Bhandarkar
Last year, Rini Kaushik and I authored a paper "GreenHDFS: Towards An Energy-Conserving, Storage-Efficient, Hybrid Hadoop Compute Cluster" at HotPower'10 (PDF here: http://www.usenix.org/event/hotpower10/tech/full_papers/Kaushik.pdf) that analyzed "hotness" of files based on real namenode audit logs

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-14 Thread Todd Lipcon
On Fri, Nov 11, 2011 at 2:29 PM, Todd Lipcon wrote: > On Fri, Nov 11, 2011 at 1:29 AM, Matt Foley wrote: > >> >> Also, I believe in the HDFS-2246 Jira, Todd requested extra time to review, >> due to commitments at Hadoop World.  Todd, would Monday be sufficient extra >> time, so as not to slow do

[jira] [Resolved] (HADOOP-7820) http://wiki.apache.org/hadoop/EclipseEnvironment need to update with correct trunk Repository.

2011-11-14 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HADOOP-7820. - Resolution: Fixed You can just update the wiki in place, no need to file a jira.

[jira] [Created] (HADOOP-7820) http://wiki.apache.org/hadoop/EclipseEnvironment need to update with correct trunk Repository.

2011-11-14 Thread Uma Maheswara Rao G (Created) (JIRA)
http://wiki.apache.org/hadoop/EclipseEnvironment need to update with correct trunk Repository. -- Key: HADOOP-7820 URL: https://issues.apache.org/jira/browse/HADOOP-7820

Build failed in Jenkins: Hadoop-Common-0.23-Build #65

2011-11-14 Thread Apache Jenkins Server
See -- [...truncated 7638 lines...] [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ hadoop-dist --- [WARNING] JAR will be empty - no content was marked for i