[jira] [Resolved] (HADOOP-7585) hadoop-config.sh should be changed to not rely on java6 behavior for classpath expansion since it breaks jsvc

2011-08-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved HADOOP-7585. --- Resolution: Not A Problem Not a problem if we upgrade commons-daemon to 1.0.3 > hadoop-conf

[jira] [Created] (HADOOP-7586) Hadoop daemon does not clean up pid file upon normal shutdown

2011-08-25 Thread Joep Rottinghuis (JIRA)
Hadoop daemon does not clean up pid file upon normal shutdown - Key: HADOOP-7586 URL: https://issues.apache.org/jira/browse/HADOOP-7586 Project: Hadoop Common Issue Type: Improvemen

[jira] [Created] (HADOOP-7585) hadoop-config.sh should be changed to not rely on java6 behavior for classpath expansion since it breaks jsvc

2011-08-25 Thread Arun C Murthy (JIRA)
hadoop-config.sh should be changed to not rely on java6 behavior for classpath expansion since it breaks jsvc - Key: HADOOP-7585 URL: https://issues.apache

[VOTE] Should we release 0.20.204.0-rc3?

2011-08-25 Thread Owen O'Malley
All, I've fixed the issues that Allen observed in the previous rc for 0.20.204 and rolled the new bundled up in http://people.apache.org/~omalley/hadoop-0.20.204.0-rc3 . Please download the tarball, compile it, and try it out. All of the tests pass, and I've run several 1TB sorts with 15,00

[jira] [Reopened] (HADOOP-7559) Broken Link On Web Access Source View

2011-08-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HADOOP-7559: - Codebase is somewhat migratory this week... reopening > Broken Link On Web Access Source View > ---

[jira] [Created] (HADOOP-7584) Truncate stack traces coming out of RPC

2011-08-25 Thread Todd Lipcon (JIRA)
Truncate stack traces coming out of RPC --- Key: HADOOP-7584 URL: https://issues.apache.org/jira/browse/HADOOP-7584 Project: Hadoop Common Issue Type: Improvement Reporter: Todd Lipcon Curren

Jenkins build is back to normal : Hadoop-Common-trunk #143

2011-08-25 Thread Apache Jenkins Server
See

Re: Hadoop 21.1, appends maintenance, roadmap?

2011-08-25 Thread Allen Wittenauer
On Aug 25, 2011, at 1:07 PM, wrote: >> >> >> >> The problem is that the 0.20.2xx releases are neither a superset or subset >> of the 0.21 release. In many ways, the 0.20.2xx.y releases would be better >> named as 1.x.y. > > This confused me totally. Is the thinking to make 0.20.2xx.y as 1.

[jira] [Resolved] (HADOOP-7163) "java.net.SocketTimeoutException: 60000 millis timeout" happens a lot

2011-08-25 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-7163. --- Resolution: Fixed > "java.net.SocketTimeoutException: 6 millis timeout" happens a lot >

Re: Hadoop 21.1, appends maintenance, roadmap?

2011-08-25 Thread Milind.Bhandarkar
> > > >The problem is that the 0.20.2xx releases are neither a superset or subset >of the 0.21 release. In many ways, the 0.20.2xx.y releases would be better >named as 1.x.y. This confused me totally. Is the thinking to make 0.20.2xx.y as 1.x.y or is it 0.23.x which will become 1.x.y ? - milind

Build failed in Jenkins: Hadoop-Common-trunk #142

2011-08-25 Thread Apache Jenkins Server
See Changes: [mahadev] HADOOP-7578. Fix test-patch to be able to run on MR patches. (mahadev and tom white) [acmurthy] MAPREDUCE-2879. Fix version for MR-279 to 0.23.0. [acmurthy] MAPREDUCE-2796. Set start times for MR application

RE: Question about invoking an executable from Hadoop mapper

2011-08-25 Thread Zhixuan Zhu
A shell script actually worked great! Thanks so much! Grace -Original Message- From: Robert Evans [mailto:ev...@yahoo-inc.com] Sent: Thursday, August 25, 2011 11:32 AM To: common-dev@hadoop.apache.org Subject: Re: Question about invoking an executable from Hadoop mapper I think this is

Re: Any related paper on how to resolve hadoop SPOF issue?

2011-08-25 Thread Alex Nelson
Hi George, UC Santa Cruz contributed a ;login: article describing replacing HDFS with Ceph. (I was one of the authors.) One of the key architectural advantages of Ceph over HDFS is that Ceph distributes its metadata service over multiple metadata servers. I hope that helps. --Alex On Aug

Build failed in Jenkins: Hadoop-Common-trunk #141

2011-08-25 Thread Apache Jenkins Server
See -- [...truncated 9866 lines...] Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.244 sec Running org.apache.hadoop.ipc.TestRPC Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Ti

Build failed in Jenkins: Hadoop-Common-trunk #140

2011-08-25 Thread Apache Jenkins Server
See Changes: [mahadev] MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev) [szetszwo] Setup svn:ignore in hadoop-auth. --

[jira] [Resolved] (HADOOP-7581) Update asf-mailer.conf for moved trees

2011-08-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved HADOOP-7581. --- Resolution: Fixed Thanks for committing this Ian. > Update asf-mailer.conf for moved trees

Re: Question about invoking an executable from Hadoop mapper

2011-08-25 Thread Robert Evans
I think this is a java issue. I don't think that it is launching a shell to run your command. I think it is just splitting on white space and then passing all the args to hadoop. What you want to do is to run sh -e 'hadoop dfs -cat file| myExec' Or with streaming white a small shell script t

[jira] [Reopened] (HADOOP-7583) mvn -Ptar and -Pbintar are broken

2011-08-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened HADOOP-7583: --- Please use -Ptar to activate -Pdist and build tarball > mvn -Ptar and -Pbintar are broken > ---

Question about invoking an executable from Hadoop mapper

2011-08-25 Thread Zhixuan Zhu
I think this should be a common use case. I'm trying to invoke an executable from my mapper. Because my executable takes steaming input, I used something like the following: String lCmdStr = "hadoop dfs -cat file | myExec"; Process lChldProc = Runtime.getRuntime().exec(lCmdStr); All executable a

[jira] [Resolved] (HADOOP-7583) mvn -Ptar and -Pbintar are broken

2011-08-25 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved HADOOP-7583. Resolution: Invalid As per Thomas' comment, use '-Pdist' (to create layout only) a

Re: Any related paper on how to resolve hadoop SPOF issue?

2011-08-25 Thread George Kousiouris
Hi, many thanks!! I also found this one, which has some related work also with other efforts, in case it is helpful for someone else: https://ritdml.rit.edu/bitstream/handle/1850/13321/ATalwalkarThesis1-2011.pdf?sequence=1 BR, George On 8/25/2011 12:46 PM, Nan Zhu wrote: Hope it helps ht

Re: Any related paper on how to resolve hadoop SPOF issue?

2011-08-25 Thread Uma Maheswara Rao G 72686
Hi, Community started working on NameNode High availabily. you can refer : https://issues.apache.org/jira/browse/HDFS-1623 regards, Uma - Original Message - From: George Kousiouris Date: Thursday, August 25, 2011 3:15 pm Subject: Any related paper on how to resolve hadoop SPOF issue?

Re: Any related paper on how to resolve hadoop SPOF issue?

2011-08-25 Thread Nan Zhu
Hope it helps http://www.springerlink.com/content/h17r882710314147/ Best, Nan On Thu, Aug 25, 2011 at 5:43 PM, George Kousiouris wrote: > > Hi guys, > > We are currently in the process of writing a paper regarding hadoop and we > would like to reference any attempt to remove the single point o

Any related paper on how to resolve hadoop SPOF issue?

2011-08-25 Thread George Kousiouris
Hi guys, We are currently in the process of writing a paper regarding hadoop and we would like to reference any attempt to remove the single point of failure of the Namenode. We have found in various presentations some efforts (like dividing the namespace between more than one namenodes if i

Build failed in Jenkins: Hadoop-Common-trunk #139

2011-08-25 Thread Apache Jenkins Server
See Changes: [sharad] MAPREDUCE-2807. Fix AM restart and client redirection. Contributed by Sharad Agarwal. [acmurthy] HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur. [acmurthy] HADOOP-7560.

[jira] [Created] (HADOOP-7583) mvn -Ptar and -Pbintar are broken

2011-08-25 Thread Arun C Murthy (JIRA)
mvn -Ptar and -Pbintar are broken - Key: HADOOP-7583 URL: https://issues.apache.org/jira/browse/HADOOP-7583 Project: Hadoop Common Issue Type: Bug Reporter: Arun C Murthy Priority: Bloc