Code Review Request

Please review patch: https://issues.apache.org/jira/browse/HDFS-4730 https://issues.apache.org/jira/browse/HDFS-4709 https://issues.apache.org/jira/browse/HDFS-4681 Thanks

Re: Why failed to use Distcp over FTP protocol?

If I execute 'hadoop distcp hdfs:///tmp/test1.txt ftp://ftpuser:ftpuser@hostname/tmp/', the exception will be: attempt_20130440_0006_m_00_1: log4j:ERROR Could not connect to remote log4j server at [localhost]. We will try again later. 13/04/23 19:31:33 INFO mapred.JobClient: Task Id : attem

Re: Cannot communicate

Hi Kevin, Since it seems like this is a CDH-specific question, I recommend you email cdh-u...@cloudera.org where you should be able to get some help with this. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Apr 22, 2013 at 10:33 AM, wrote: > > I am on a Ubuntu server. When I go to the

Re: Convention question for using DFSConfigKey constants : are zeros magic?

On Fri, Apr 19, 2013 at 3:40 PM, Jay Vyas wrote: > The more generic question is wether or not there is enforcement of naming > conventions or commenting for special values in numeric configuration > parameters: I'm interpretting your answer as "No"...? > There's certainly no "enforcement" of it,

[jira] [Resolved] (HDFS-4738) Fix javadoc and other warnings in the snapshot branch

[ https://issues.apache.org/jira/browse/HDFS-4738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4738. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) Hadoop Flags: R

Re: Why failed to use Distcp over FTP protocol?

Now, I can successfully run "hadoop distcp ftp://ftpuser:ftpuser@hostname/tmp/test1.txt hdfs:///tmp/test1.txt" But failed on "hadoop distcp hdfs:///tmp/test1.txt ftp://ftpuser:ftpuser@hostname/tmp/test1.txt.v1";, it returns issue like: attempt_20130440_0005_m_00_1: log4j:ERROR Could not c

[jira] [Created] (HDFS-4738) Fix javadoc and other warnings in the snapshot branch

Tsz Wo (Nicholas), SZE created HDFS-4738: Summary: Fix javadoc and other warnings in the snapshot branch Key: HDFS-4738 URL: https://issues.apache.org/jira/browse/HDFS-4738 Project: Hadoop HDFS

Re: Why failed to use Distcp over FTP protocol?

I can success execute "hadoop fs -ls ftp://hadoopadm:@ftphostname", it returns the root path of linux system. But failed to execute "hadoop fs -rm ftp://hadoopadm:@ftphostname/some/path/here";, and it returns: rm: Delete failed f

[jira] [Resolved] (HDFS-4735) DisallowSnapshot throws IllegalStateException

[ https://issues.apache.org/jira/browse/HDFS-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4735. -- Resolution: Fixed I have committed this. Thanks, Jing! > Disal

[jira] [Created] (HDFS-4736) SnapshotAccessControlException does not return valid exit codes

Ramya Sunil created HDFS-4736: - Summary: SnapshotAccessControlException does not return valid exit codes Key: HDFS-4736 URL: https://issues.apache.org/jira/browse/HDFS-4736 Project: Hadoop HDFS

[jira] [Created] (HDFS-4735) DisallowSnapshot throws IllegalStateException

Ramya Sunil created HDFS-4735: - Summary: DisallowSnapshot throws IllegalStateException Key: HDFS-4735 URL: https://issues.apache.org/jira/browse/HDFS-4735 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Created] (HDFS-4734) TestDFSHAAdmin fails on Windows

Arpit Agarwal created HDFS-4734: --- Summary: TestDFSHAAdmin fails on Windows Key: HDFS-4734 URL: https://issues.apache.org/jira/browse/HDFS-4734 Project: Hadoop HDFS Issue Type: Bug Affects V

CfP 2013 Workshop on Middleware for HPC and Big Data Systems (MHPC'13)

we apologize if you receive multiple copies of this message === CALL FOR PAPERS 2013 Workshop on Middleware for HPC and Big Data Systems MHPC '13 as part of Euro-Par 2013, Aachen, Germany

Re: Why failed to use Distcp over FTP protocol?

The ftp fs is listing the contents of the given path's parent directory, and then trying to match the basename of each child path returned against the basename of the given path – quite inefficient… The FNF is it didn't find a match for the basename. It may be that the ftp server isn't returni

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

With 15 +1s (8 binding), 1 -0 and no -1s the vote passes. Thanks to all who verified the bits, I'll push them out. thanks, Arun On Apr 12, 2013, at 2:56 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I would > like to release. > > The

Re: Sqoop installation?

Transferring to user list (hdfs-dev bcc'd). Hi Kevin, The datanodes are definitely more disposable than the namenodes. If a Sqoop command unexpectedly consumes a lot of resources, then stealing resources from the namenode could impact performance of the whole cluster. Stealing resources from a

[jira] [Created] (HDFS-4733) Make HttpFS username pattern configurable

Alejandro Abdelnur created HDFS-4733: Summary: Make HttpFS username pattern configurable Key: HDFS-4733 URL: https://issues.apache.org/jira/browse/HDFS-4733 Project: Hadoop HDFS Issue Typ

Re: Testing online one class

Thank u :) U helped me a lot :) On Tue, Apr 23, 2013 at 10:01 PM, Chris Nauroth wrote: > Test pass/fail will print to the console. If it fails, then the console > also shows the assertion failure message or the exception stack trace, > depending on the nature of the failure. > > The full log ou

Re: Testing online one class

Test pass/fail will print to the console. If it fails, then the console also shows the assertion failure message or the exception stack trace, depending on the nature of the failure. The full log output emitted during the test run does not go to the console. Instead, you can find that in /target

[jira] [Created] (HDFS-4732) TestDFSUpgradeFromImage fails on Windows due to failure to unpack old image tarball that contains hard links

Chris Nauroth created HDFS-4732: --- Summary: TestDFSUpgradeFromImage fails on Windows due to failure to unpack old image tarball that contains hard links Key: HDFS-4732 URL: https://issues.apache.org/jira/browse/HDFS-

Hadoop version?

Sorry if this is such a beginning question but I have installed CDH4 and now I am asked for the Hadoop version (0.20, 0.23, 1.0, 2.0, etc) I am not sure how to find that out?

Sqoop installation?

The Apache documentation on installing a Sqoop server indicates: "Copy Sqoop artifact on machine where you want to run Sqoop server. This machine must have installed and configured Hadoop. You don't need to run any Hadoop related services there, however the machine must be able to act as an Had

[jira] [Resolved] (HDFS-4731) Loading data from HDFS to tape

[ https://issues.apache.org/jira/browse/HDFS-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans resolved HDFS-4731. --- Resolution: Invalid Is this a question of how you would go about doing this? If so pl

Re: For release 2.0.X, about when will have a stable release?

What do you consider stable? Do you mean that it will not have the -alpha tag? That should hopefully be in a month or two. Do you mean that it is stable enough for production use? That is likely to be before the end of the year depending on the size of your cluster and your use cases, but a lot o

[jira] [Created] (HDFS-4731) Loading data from HDFS to tape

prashanthi created HDFS-4731: Summary: Loading data from HDFS to tape Key: HDFS-4731 URL: https://issues.apache.org/jira/browse/HDFS-4731 Project: Hadoop HDFS Issue Type: Bug Reporter

transfer -> CreateSocketForPipeline : hardcoded length of 2?

Hi guys: I noticed that in the call to createSocketForPipeline, there is a hardcoded length of "2". //from sock = createSocketForPipeline(src, 2, dfsClient); This cascades down to the "getDataNodeReadTimeout" method, resulting in a multiplier of 2. //from DFSClient.java int getDatanodeReadTimeou

Hadoop-Hdfs-trunk - Build # 1381 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1381/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10219 lines...] Tests run: 42, Failures: 0, Errors: 0, Sk

Build failed in Jenkins: Hadoop-Hdfs-trunk #1381

See Changes: [vinodkv] YARN-583. Moved application level local resources to be localized under the filecache sub-directory under application directory. Contributed by Omkar Vinit Joshi. [bikas] YARN-549. YarnClient.submitApplicatio

Hadoop-Hdfs-0.23-Build - Build # 590 - Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/590/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11809 lines...] [INFO] [INFO] --- maven-source-plugi

Jenkins build became unstable: Hadoop-Hdfs-0.23-Build #590

See

Re: Encounter 'error: possibly undefined macro: AC_PROG_LIBTOOL', when build Hadoop project in SUSE 11(x86_64)

autoconf.noarch 2.68-4.1 2013/4/23 Harsh J > What version of autoconf are you using? > > On Tue, Apr 23, 2013 at 12:18 PM, sam liu wrote: > > Hi Experts, > > > > I failed to build Hadoop 1.1.1 source code project in SUSE 11(x86_64), > and > > encounter a issue: > > > > [exec] configure.ac

Re: Encounter 'error: possibly undefined macro: AC_PROG_LIBTOOL', when build Hadoop project in SUSE 11(x86_64)

What version of autoconf are you using? On Tue, Apr 23, 2013 at 12:18 PM, sam liu wrote: > Hi Experts, > > I failed to build Hadoop 1.1.1 source code project in SUSE 11(x86_64), and > encounter a issue: > > [exec] configure.ac:48: error: possibly undefined macro: > AC_PROG_LIBTOOL > [ex