Build failed in Jenkins: Hadoop-Common-trunk #400

2012-05-08 Thread Apache Jenkins Server
See Changes: [eli] HDFS-3378. Remove DFS_NAMENODE_SECONDARY_HTTPS_PORT_KEY and DEFAULT. Contributed by Eli Collins [szetszwo] HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileU

Build failed in Jenkins: Hadoop-Common-0.23-Build #246

2012-05-08 Thread Apache Jenkins Server
See Changes: [tomwhite] Merge -r 1335196:1335197 from trunk to branch-0.23. Fixes: MAPREDUCE-4226 [bobby] HADOOP-8328. Duplicate FileSystem Statistics object for 'file' scheme. [bobby] svn merge -c 1335096 FIXES: MAPREDUCE-42

Thoughts on managing big changes to Hadoop project

2012-05-08 Thread Eric Baldeschwieler
Hi Folks, Owen suggested we move a discussion from HADOOP-8248 to this list. I thought I'd repost my comment for feedback... A community process for change management is on my mind because we are seeing a lot of major change going into things like HDFS, where the down side to user of getting

Project announcement: Sailfish (also, looking for colloborators)

2012-05-08 Thread Sriram Rao
Hi, I'd like to announce the release of a new open source project, Sailfish. http://code.google.com/p/sailfish/ Sailfish tries to improve Hadoop-performance, particularly for large-jobs which process TB's of data and run for hours. In building Sailfish, we modify how map-output is handled and t

Re: Project announcement: Sailfish (also, looking for colloborators)

2012-05-08 Thread Raghu Sakleshpur
Hi Sriram,        I'm interested in getting involved. Let me know in what capacity I can get involved.. Thanks, Raghu From: Sriram Rao To: common-dev@hadoop.apache.org Sent: Tuesday, May 8, 2012 10:32 AM Subject: Project announcement: Sailfish (also, looking

Re: Project announcement: Sailfish (also, looking for colloborators)

2012-05-08 Thread Anil Gurnani
Me too Sent from my iPhone On May 8, 2012, at 1:35 PM, Raghu Sakleshpur wrote: > Hi Sriram, > >I'm interested in getting involved. Let me know in what capacity I can > get involved.. > > Thanks, > Raghu > > > > From: Sriram Rao > To: common-dev@had

RE: Project announcement: Sailfish (also, looking for colloborators)

2012-05-08 Thread Saikat Kanjilal
Me 2, let me know as well. > Date: Tue, 8 May 2012 10:35:34 -0700 > From: mrra...@yahoo.com > Subject: Re: Project announcement: Sailfish (also, looking for colloborators) > To: common-dev@hadoop.apache.org > > Hi Sriram, > >I'm interested in getting involved. Let me know in what capaci

[jira] [Created] (HADOOP-8371) Hadoop 1.0.1 release - DFS rollback issues

2012-05-08 Thread Giri (JIRA)
Giri created HADOOP-8371: Summary: Hadoop 1.0.1 release - DFS rollback issues Key: HADOOP-8371 URL: https://issues.apache.org/jira/browse/HADOOP-8371 Project: Hadoop Common Issue Type: Bug

Re: Project announcement: Sailfish (also, looking for colloborators)

2012-05-08 Thread Andrew Purtell
Sriram et. al., Do you intend this to be a joint project with the Hadoop community or a technology competitor? Regrettably, KFS is not a "drop in replacement" for HDFS. Hypothetically: I have several petabytes of data in an existing HDFS deployment, which is the norm, and a continuous MapReduce w

Re: Project announcement: Sailfish (also, looking for colloborators)

2012-05-08 Thread Eric Baldeschwieler
This would seem like a perfect use case for YARN. Is that what you are thinking? You could implement this as a new framework rather then trying to incrementally change map-reduce. This would let you move faster and demonstrate side by side performance improvements. --- E14 - typing on glass On

Re: Sailfish

2012-05-08 Thread Sriram Rao
Dear Andy, > From: Andrew Purtell > ... > Do you intend this to be a joint project with the Hadoop community or > a technology competitor? As I had said in my email, we are looking for folks to colloborate with us to help get us integrated with Hadoop. So, to be explicitly clear, we are intend

Re: sailfish

2012-05-08 Thread Sriram Rao
Hi Eric, > From: Eric Baldeschwieler > This would seem like a perfect use case for YARN. Is that what you are > thinking? You could implement this as a new framework rather then > trying to incrementally change map-reduce. Currently, we have done with this Hadoop 0.20.2. Major code surgery he

Re: Scan Benchmark

2012-05-08 Thread ASHISH ATTARDE
Thanks for pointing me to link below but I have seen that link before. What I am looking for is the executable(jar) or source code for scan benchmark. I checked with the hadoop source code I have obtained. It does only gridmix, gridmixV2 benchmarks. Thanks -Ashish On Mon, May 7, 2012 at 6:21 PM, Ra

[VOTE] Hadoop-1.0.3-rc1

2012-05-08 Thread Matt Foley
> > Hi all, release Candidate for Hadoop-1.0.3 is now available for vote, at http://people.apache.org/~mattf/hadoop-1.0.3-rc1/ There are 29 bug fixes and enhancements in this release, including: > 4 patches in support of non-Oracle JDKs several patches to clean up error handling and log mess

[jira] [Resolved] (HADOOP-7489) Hadoop logs errors upon startup on OS X 10.7

2012-05-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-7489. -- Resolution: Won't Fix I'm closing this as Won't Fix since this is a known JRE bug and

[jira] [Resolved] (HADOOP-8308) Support cross-project Jenkins builds

2012-05-08 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White resolved HADOOP-8308. --- Resolution: Fixed Hadoop Flags: Reviewed > Support cross-project Jenkins builds >