Re: Solaris Port

2014-12-10 Thread malcolm
Hi Colin, Exactly, as you noticed, the problem is the thread-local buffer needed to return from terror. Currently, terror just returns a static string from an array, this is fast, simple and error-proof. In order to use strerror_r inside terror, would require allocating a buffer inside terr

Re: Hadoop without HDFS

2014-12-10 Thread Jay Vyas
Yup, that's a great summary. More details... The HCFS wiki page will give you insight into some tests you can run to test your FileSystem plugin class, which you will put in a jar file described below. In general, hadoop apps are written to the file system interface which is loaded runtime, s

Re: Hadoop without HDFS

2014-12-10 Thread Roman Shaposhnik
On Wed, Dec 10, 2014 at 12:20 PM, Ari King wrote: > Hi, > > I'm doing a research paper on Hadoop -- specifically relating to its > dependency on HDFS. I need to determine if and how HDFS can be replaced. As > I understand it, there are a number of organizations that have produced > HDFS alternativ

Hadoop without HDFS

2014-12-10 Thread Ari King
Hi, I'm doing a research paper on Hadoop -- specifically relating to its dependency on HDFS. I need to determine if and how HDFS can be replaced. As I understand it, there are a number of organizations that have produced HDFS alternatives that support the Hadoop ecosystem, i.e. MapReduce, Hive, HB

Re: Solaris Port

2014-12-10 Thread Colin McCabe
On Wed, Dec 10, 2014 at 2:31 AM, malcolm wrote: > Hi Colin, > > Thanks for the hints around JIRAs. > > You are correct errno still exists, however sys_errlist does not. > > Hadoop uses a function terror (defined in exception.c) which indexes > sys_errlist by errno to return the error message from

[jira] [Reopened] (HADOOP-11389) Clean up byte to string encoding issues in hadoop-common

2014-12-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reopened HADOOP-11389: - > Clean up byte to string encoding issues in hadoop-common > ---

[jira] [Resolved] (HADOOP-11389) Clean up byte to string encoding issues in hadoop-common

2014-12-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11389. - Resolution: Fixed > Clean up byte to string encoding issues in hadoop-common > -

[jira] [Created] (HADOOP-11389) Clean up byte to string encoding issues in hadoop-common

2014-12-10 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11389: --- Summary: Clean up byte to string encoding issues in hadoop-common Key: HADOOP-11389 URL: https://issues.apache.org/jira/browse/HADOOP-11389 Project: Hadoop Common

[jira] [Created] (HADOOP-11388) Remove deprecated o.a.h.metrics.file.FileContext

2014-12-10 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11388: --- Summary: Remove deprecated o.a.h.metrics.file.FileContext Key: HADOOP-11388 URL: https://issues.apache.org/jira/browse/HADOOP-11388 Project: Hadoop Common Issu

Re: Solaris Port

2014-12-10 Thread Steve Loughran
On 10 December 2014 at 10:31, malcolm wrote: > Also, I have been requested to ensure my port is available on 2.4, > perceived as a more stable release. If I make changes to this branch are > they automatically available for 2.6, or will I need multiple JIRAs ? nobody is backporting patches to A

Re: Solaris Port

2014-12-10 Thread malcolm
Hi Colin, Thanks for the hints around JIRAs. You are correct errno still exists, however sys_errlist does not. Hadoop uses a function terror (defined in exception.c) which indexes sys_errlist by errno to return the error message from the array. This function is called 26 times in various plac

Build failed in Jenkins: Hadoop-Common-trunk #1337

2014-12-10 Thread Apache Jenkins Server
See Changes: [wheat9] HADOOP-10476. Bumping the findbugs version to 3.0.0. Contributed by Haohui Mai. [wheat9] HADOOP-11367. Fix warnings from findbugs 3.0 in hadoop-streaming. Contributed by Li Lu. [wheat9] HADOOP-11369. Fix ne

Re: Solaris Port

2014-12-10 Thread Colin McCabe
Hi Malcolm, In general we file JIRAs for particular issues. So if one issue is handling errlist on Solaris, that might be one JIRA. Another issue might be handling socket write timeouts on Solaris. And so on. Most of these should probably be HADOOP tickets since they sound like they are mostly