Re: can't copy between hdfs

Not sure if this helps but copyFromLocal is just to write data from the current client machine to hdfs; but distcp will start a mapreduce job to do the copy, that means the NodeManager/taskTracker machine need to write data to the remote hdfs cluster; Regards, *Stanley Shi,* On Sun, Apr 13, 20

[jira] [Created] (HDFS-6239) start-dfs.sh does not start remote DataNode due to escape characters

xyzzy created HDFS-6239: --- Summary: start-dfs.sh does not start remote DataNode due to escape characters Key: HDFS-6239 URL: https://issues.apache.org/jira/browse/HDFS-6239 Project: Hadoop HDFS Issue T

Re: Thinking ahead

Sandy, On Apr 12, 2014, at 10:09 AM, Sandy Ryza wrote: > I'm having trouble editing the wiki, but I think Timeline Server stability > (e.g. security and locking down APIs) should go on that list. I'm very glad to see you are very passionate about security for ATS since you've asked about it

Re: Thinking ahead

I'm still wading through 2.4.1 critical issues (failing tests, blockers etc) so haven't gotten time to think about the 2.5 list w.r.t YARN. Will do so in the next week. BTW, folks, please refrain from adding items to the list that you yourselves are not volunteering to work on. Anyone keen to see

Re: Thinking ahead

> On Apr 12, 2014, at 10:09 AM, Sandy Ryza wrote: > > +1 for starting to think about 2.5. Early June seems a little early to me > - we had talked about a quarterly release cadence and this would be about > half that. We can debate whether or June is too early for hadoop-2.5 and it's contents,

[jira] [Created] (HDFS-6238) TestDirectoryScanner leaks file descriptors.

Chris Nauroth created HDFS-6238: --- Summary: TestDirectoryScanner leaks file descriptors. Key: HDFS-6238 URL: https://issues.apache.org/jira/browse/HDFS-6238 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6237) TestDFSShell#testGet fails on Windows due to invalid file system path.

Chris Nauroth created HDFS-6237: --- Summary: TestDFSShell#testGet fails on Windows due to invalid file system path. Key: HDFS-6237 URL: https://issues.apache.org/jira/browse/HDFS-6237 Project: Hadoop HDFS

Hadoop-Hdfs-trunk - Build # 1731 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1731/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12917 lines...] [INFO] Deleting /home/jenkins/jenkins-sl

Build failed in Jenkins: Hadoop-Hdfs-trunk #1731

See Changes: [cnauroth] HDFS-6236. ImageServlet should use Time#monotonicNow to measure latency. Contributed by Chris Nauroth. -- [...truncated 12724 lines...] Tests run: 13, Failures: 0, Erro

Re: can't copy between hdfs

For curiosity, I can copy a file from host1 to host2 with the copyFromLocal. I cannot do this with distcp. I think the problem is related to the 'distcp' command. Maybe it is a question of permissions I already set " dfs.permissions false " in the hdfs-site.xml and core-site. Any suggestion

Re: can't copy between hdfs

As far as I can see, the source host can't write to the destination host. This is a similar problem to the one described here (https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/0nTALQjbrT0 ). But I can't find a way to fix this error. Any help to try to fix this? On 04/13/2014 11:

can't copy between hdfs

Hi, I am trying to copy data between HDFS that are located away from each other, and when I run the distcp command, I get the errors below in the namenode and the datanode of the target hosts. What is happening? The 2 mapreduce runtime are running in a VLAN. The host are physically distant,