Re: Solaris Port

2014-12-11 Thread malcolm
So, turns out that if I had naively changed all calls to terror or references to sys_errlist, to using strerror_r, then I would have broken code for Windows and HPUX (and possibly other OSes). If we are to assume that current code runs fine on all platforms (maybe even AIX an MacOS, for exampl

[jira] [Resolved] (HADOOP-11389) Clean up byte to string encoding issues in hadoop-common

2014-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-11389. - Resolution: Fixed I've committed the patch to trunk and branch-2. > Clean up byte to string enc

Re: submitting a hadoop patch doesn't trigger jenkins test run

2014-12-11 Thread Yongjun Zhang
Sorry my bad, I named Andrew Wang for Andrew Bayer in my last mail, both of them helped anyways:-) So thanks to all for the help on this matter! --Yongjun On Thu, Dec 11, 2014 at 3:38 PM, Yongjun Zhang wrote: > Many thanks to Ted Yu, Steve Loughran and Andrew Wang for replying in the > jira and

Re: submitting a hadoop patch doesn't trigger jenkins test run

2014-12-11 Thread Yongjun Zhang
Many thanks to Ted Yu, Steve Loughran and Andrew Wang for replying in the jira and Steve/Andrew for making the related changes! --Yongjun On Thu, Dec 11, 2014 at 12:41 PM, Yongjun Zhang wrote: > Hi, > > I wonder if anyone can help on resolving HADOOP-11320 >

[jira] [Created] (HADOOP-11398) RetryUpToMaximumTimeWithFixedSleep needs to behave more accurately

2014-12-11 Thread Li Lu (JIRA)
Li Lu created HADOOP-11398: -- Summary: RetryUpToMaximumTimeWithFixedSleep needs to behave more accurately Key: HADOOP-11398 URL: https://issues.apache.org/jira/browse/HADOOP-11398 Project: Hadoop Common

RE: Solaris Port

2014-12-11 Thread Asokan, M
Hi Malcom, The Windows versions of strerror() and strerror_s() functions are probably meant for ANSI C library functions that set errno. For core Windows API calls (like UNIX system calls), one gets the error number by calling GetLastError() function. In the code snippet I sent earlier, the

[jira] [Created] (HADOOP-11397) Can't override HADOOP_IDENT_STRING

2014-12-11 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-11397: - Summary: Can't override HADOOP_IDENT_STRING Key: HADOOP-11397 URL: https://issues.apache.org/jira/browse/HADOOP-11397 Project: Hadoop Common Issue

Re: Solaris Port

2014-12-11 Thread malcolm
Hi Asok, I googled and found that windows has strerror, and strerror_s (which is the strerror_r equivalent). Is there a reason why you didn't use this call ? On 12/11/2014 06:27 PM, Asokan, M wrote: Hi Malcom, Recently, I had to work on a function to get system error message on various s

Re: submitting a hadoop patch doesn't trigger jenkins test run

2014-12-11 Thread Yongjun Zhang
Hi, I wonder if anyone can help on resolving HADOOP-11320 to increase timeout for jenkins test of crossing-subproject patches? Thanks a lot, --Yongjun On Tue, Dec 2, 2014 at 10:10 AM, Yongjun Zhang wrote: > Hi, > > Thank you all for the inp

[jira] [Created] (HADOOP-11396) Provide navigation in the site documentation linking to the Hadoop Compatible File Systems.

2014-12-11 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-11396: -- Summary: Provide navigation in the site documentation linking to the Hadoop Compatible File Systems. Key: HADOOP-11396 URL: https://issues.apache.org/jira/browse/HADOOP-11396

[jira] [Created] (HADOOP-11395) Add site documentation for Azure Storage FileSystem integration.

2014-12-11 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-11395: -- Summary: Add site documentation for Azure Storage FileSystem integration. Key: HADOOP-11395 URL: https://issues.apache.org/jira/browse/HADOOP-11395 Project: Hadoo

[jira] [Created] (HADOOP-11394) hadoop-aws documentation missing.

2014-12-11 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-11394: -- Summary: hadoop-aws documentation missing. Key: HADOOP-11394 URL: https://issues.apache.org/jira/browse/HADOOP-11394 Project: Hadoop Common Issue Type: B

[jira] [Created] (HADOOP-11393) Revert HADOOP_PREFIX, go back to HADOOP_HOME

2014-12-11 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-11393: - Summary: Revert HADOOP_PREFIX, go back to HADOOP_HOME Key: HADOOP-11393 URL: https://issues.apache.org/jira/browse/HADOOP-11393 Project: Hadoop Common

[jira] [Created] (HADOOP-11392) FileUtil.java leaks file descriptor when copybytes success.

2014-12-11 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HADOOP-11392: - Summary: FileUtil.java leaks file descriptor when copybytes success. Key: HADOOP-11392 URL: https://issues.apache.org/jira/browse/HADOOP-11392 Proje

RE: Solaris Port

2014-12-11 Thread Asokan, M
Hi Malcom, Recently, I had to work on a function to get system error message on various systems. Here is the piece of code I came up with. Hope it helps. static void get_system_error_message(char * buf, int buf_len, int code) { #if defined(_WIN32) LPVOID lpMsgBuf; DWORD status = Form

Re: Solaris Port

2014-12-11 Thread malcolm
Fine with me, I volunteer to do this, if accepted. On 12/11/2014 05:48 PM, Allen Wittenauer wrote: sys_errlist was removed for a reason. Creating a fake sys_errlist on Solaris will mean the libhadoop.so will need to be tied a specific build (kernel/include pairing) and therefore limits upward

[jira] [Created] (HADOOP-11391) Enabling HVE/node awareness does not rebalance replicas on data that existed prior to topology changes.

2014-12-11 Thread ellen johansen (JIRA)
ellen johansen created HADOOP-11391: --- Summary: Enabling HVE/node awareness does not rebalance replicas on data that existed prior to topology changes. Key: HADOOP-11391 URL: https://issues.apache.org/jira/brows

Re: Solaris Port

2014-12-11 Thread Allen Wittenauer
sys_errlist was removed for a reason. Creating a fake sys_errlist on Solaris will mean the libhadoop.so will need to be tied a specific build (kernel/include pairing) and therefore limits upward mobility/compatibility. That doesn’t seem like a very good idea. IMO, switching to strerror_r i

Jenkins build is back to normal : Hadoop-Common-trunk #1340

2014-12-11 Thread Apache Jenkins Server
See

Re: Solaris Port

2014-12-11 Thread malcolm
FYI, there are a couple more files that reference sys_errlist directly (not just terror within exception.c) , but also hdfs_http_client.c and NativeiO.c On 12/11/2014 07:38 AM, malcolm wrote: Hi Colin, Exactly, as you noticed, the problem is the thread-local buffer needed to return from terr

Build failed in Jenkins: Hadoop-Common-trunk #1339

2014-12-11 Thread Apache Jenkins Server
See -- [...truncated 2944 lines...] [INFO] [INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ hadoop-sls --- [INFO] Compiling 6 source files to

Re: Hadoop without HDFS

2014-12-11 Thread Steve Loughran
one more thing, the "if" excludes object stores which don't offer consistency and atomic create-no-overwrite and rename. You can't run all hadoop apps directly on top of Amazon S3, without extra work (see netflix S3mper). Object stores do not always behave as filesystems, even if they implement the

[jira] [Created] (HADOOP-11390) Metrics 2 ganglia provider to include hostname in unresolved address problems

2014-12-11 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-11390: --- Summary: Metrics 2 ganglia provider to include hostname in unresolved address problems Key: HADOOP-11390 URL: https://issues.apache.org/jira/browse/HADOOP-11390

Build failed in Jenkins: Hadoop-Common-trunk #1338

2014-12-11 Thread Apache Jenkins Server
See Changes: [wheat9] HADOOP-10482. Fix various findbugs warnings in hadoop-common. Contributed by Haohui Mai. [wheat9] HADOOP-11388. Remove deprecated o.a.h.metrics.file.FileContext. Contributed by Li Lu. [aw] HADOOP-10950. rew