Re: Sailfish

2012-05-10 Thread Todd Lipcon
Hey Sriram, We discussed this before, but for the benefit of the wider audience: :) It seems like the requirements imposed on KFS by Sailfish are in most ways much simplier than the requirements of a full distributed filesystem. The one thing we need is atomic record append -- but we don't need a

Re: Sailfish

2012-05-10 Thread Sriram Rao
Srivas, Sailfish is builds upon record append (a feature not present in HDFS). The software that is currently released is based on Hadoop-0.20.2. You use the Sailfish version of Hadoop-0.20.2, KFS for the intermediate data, and then HDFS (or KFS) for storing the job/input. Since the changes are

Re: Sailfish

2012-05-10 Thread M. C. Srivas
Sriram, Sailfish depends on append. I just noticed the HDFS disabled append. How does one use this with Hadoop? On Wed, May 9, 2012 at 9:00 AM, Otis Gospodnetic wrote: > Hi Sriram, > > >> The I-file concept could possibly be implemented here in a fairly self > contained way. One > >> could ev

[jira] [Created] (HADOOP-8390) TestFileSystemCanonicalization fails with JDK7

2012-05-10 Thread Trevor Robinson (JIRA)
Trevor Robinson created HADOOP-8390: --- Summary: TestFileSystemCanonicalization fails with JDK7 Key: HADOOP-8390 URL: https://issues.apache.org/jira/browse/HADOOP-8390 Project: Hadoop Common

Re: Test failures in TestFileSystemCanonicalization

2012-05-10 Thread Eli Collins
Yup, please file a bug. Thanks! On Thu, May 10, 2012 at 4:04 PM, Trevor Robinson wrote: > I just tried it and it works with JDK6. Should I open a bug and > indicate that it's a JDK7 issue? I need JDK7 to be supported/tested > since there is no ARM Server JIT for JDK6. :-) I will, of course, look

Re: Test failures in TestFileSystemCanonicalization

2012-05-10 Thread Trevor Robinson
I just tried it and it works with JDK6. Should I open a bug and indicate that it's a JDK7 issue? I need JDK7 to be supported/tested since there is no ARM Server JIT for JDK6. :-) I will, of course, look into the cause/fix as time allows. On Wed, May 9, 2012 at 9:42 PM, Eli Collins wrote: > Do you

[jira] [Created] (HADOOP-8389) MetricsDynamicMBeanBase throws IllegalArgumentException for empty attribute list

2012-05-10 Thread Elias Ross (JIRA)
Elias Ross created HADOOP-8389: -- Summary: MetricsDynamicMBeanBase throws IllegalArgumentException for empty attribute list Key: HADOOP-8389 URL: https://issues.apache.org/jira/browse/HADOOP-8389 Project:

[jira] [Created] (HADOOP-8388) remove unused BlockLocation serialization

2012-05-10 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HADOOP-8388: Summary: remove unused BlockLocation serialization Key: HADOOP-8388 URL: https://issues.apache.org/jira/browse/HADOOP-8388 Project: Hadoop Common

[jira] [Created] (HADOOP-8387) Documentation - build hadoop for IBM PowerLinux (ppc64) enablement

2012-05-10 Thread Adalberto Medeiros (JIRA)
Adalberto Medeiros created HADOOP-8387: -- Summary: Documentation - build hadoop for IBM PowerLinux (ppc64) enablement Key: HADOOP-8387 URL: https://issues.apache.org/jira/browse/HADOOP-8387 Projec