[jira] [Resolved] (HDFS-4642) Allow lease recovery for multiple paths to be issued in one request

[ https://issues.apache.org/jira/browse/HDFS-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-4642. -- Resolution: Later > Allow lease recovery for multiple paths to be issued in one request > --

Re: HDFS read/write data throttling

2013/11/11 Andrew Wang > Hey Lohit, > > This is an interesting topic, and something I actually worked on in grad > school before coming to Cloudera. It'd help if you could outline some of > your usecases and how per-FileSystem throttling would help. For what I was > doing, it made more sense to t

Re: HDFS read/write data throttling

Hey Lohit, This is an interesting topic, and something I actually worked on in grad school before coming to Cloudera. It'd help if you could outline some of your usecases and how per-FileSystem throttling would help. For what I was doing, it made more sense to throttle on the DN side since you hav

[jira] [Resolved] (HDFS-5494) Fix findbugs warnings for HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5494. - Resolution: Fixed Fix Version/s: Heterogeneous Storage (HDFS-2832) Hadoop Flags: Review

[jira] [Created] (HDFS-5502) Fix HTTPS support for HsftpFileSystem

Haohui Mai created HDFS-5502: Summary: Fix HTTPS support for HsftpFileSystem Key: HDFS-5502 URL: https://issues.apache.org/jira/browse/HDFS-5502 Project: Hadoop HDFS Issue Type: Sub-task

Re: HDFS read/write data throttling

Hi, lohit. There is a Class named ThrottledInputStream in hadoop-distcp, you could check it out and find more details. In addition to this, I am wor

[jira] [Resolved] (HDFS-5491) Update stored edits for HDFS-2832

[ https://issues.apache.org/jira/browse/HDFS-5491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5491. - Resolution: Fixed Fix Version/s: Heterogeneous Storage (HDFS-2832) Thanks Nicholas. I commi

[jira] [Created] (HDFS-5501) Fix pendingReceivedRequests tracking in BPServiceActor

Arpit Agarwal created HDFS-5501: --- Summary: Fix pendingReceivedRequests tracking in BPServiceActor Key: HDFS-5501 URL: https://issues.apache.org/jira/browse/HDFS-5501 Project: Hadoop HDFS Issue

Re: Next releases

HADOOP-10020 is a JIRA that disables symlinks temporarily. They will be disabled in 2.2.1 as well, if the plan is to have only minor fixes in that branch. To be honest, I'm not aware of anything in 2.2.1 that shouldn't be there. However, I have only been following the HDFS and common side of thi

[jira] [Created] (HDFS-5500) Critical datanode threads may terminate silently on uncaught exceptions

Kihwal Lee created HDFS-5500: Summary: Critical datanode threads may terminate silently on uncaught exceptions Key: HDFS-5500 URL: https://issues.apache.org/jira/browse/HDFS-5500 Project: Hadoop HDFS

[jira] [Created] (HDFS-5499) Provide way to throttle per FileSystem read/write bandwidth

Lohit Vijayarenu created HDFS-5499: -- Summary: Provide way to throttle per FileSystem read/write bandwidth Key: HDFS-5499 URL: https://issues.apache.org/jira/browse/HDFS-5499 Project: Hadoop HDFS

[jira] [Created] (HDFS-5498) Improve datanode startup time

Kihwal Lee created HDFS-5498: Summary: Improve datanode startup time Key: HDFS-5498 URL: https://issues.apache.org/jira/browse/HDFS-5498 Project: Hadoop HDFS Issue Type: Improvement R

Re: HDFS read/write data throttling

Hi Adam, Thanks for the reply. The changes I was referring was in FileSystem.java layer which should not affect HDFS Replication/NameNode operations. To give better idea this would affect clients something like this Configuration conf = new Configuration(); conf.setInt("read.bandwitdh.mbpersec",

[jira] [Created] (HDFS-5497) Performance may suffer when UnderReplicatedBlocks is used heavily

Kihwal Lee created HDFS-5497: Summary: Performance may suffer when UnderReplicatedBlocks is used heavily Key: HDFS-5497 URL: https://issues.apache.org/jira/browse/HDFS-5497 Project: Hadoop HDFS

Re: HDFS read/write data throttling

See https://issues.apache.org/jira/browse/HDFS-3475 Please note that this has met with many unexpected impacts on workload. Be careful and be mindful of your Datanode memory and network capacity. On Mon, Nov 11, 2013 at 1:59 PM, lohit wrote: > Hello Devs, > > Wanted to reach out and see if a

[jira] [Created] (HDFS-5496) Make replication queue initialization asynchronous

Kihwal Lee created HDFS-5496: Summary: Make replication queue initialization asynchronous Key: HDFS-5496 URL: https://issues.apache.org/jira/browse/HDFS-5496 Project: Hadoop HDFS Issue Type: Impr

HDFS read/write data throttling

Hello Devs, Wanted to reach out and see if anyone has thought about ability to throttle data transfer within HDFS. One option we have been thinking is to throttle on a per FileSystem basis, similar to Statistics in FileSystem. This would mean anyone with handle to HDFS/Hftp will be throttled globa

[jira] [Created] (HDFS-5495) Remove further JUnit3 usages from HDFS

Andrew Wang created HDFS-5495: - Summary: Remove further JUnit3 usages from HDFS Key: HDFS-5495 URL: https://issues.apache.org/jira/browse/HDFS-5495 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-5494) Fix findbugs warnings for HDFS-2832

Arpit Agarwal created HDFS-5494: --- Summary: Fix findbugs warnings for HDFS-2832 Key: HDFS-5494 URL: https://issues.apache.org/jira/browse/HDFS-5494 Project: Hadoop HDFS Issue Type: Sub-task

Re: Exception in mid of reading files.

Divya, thank you for reporting back on this. Nicholas and I had an offline conversation and came to the conclusion that this is likely to be a different problem from HDFS-3373. Although the symptoms look similar, the socket caching code mentioned in HDFS-3373 is not present in branch-1. I filed

[jira] [Created] (HDFS-5493) DFSClient#DFSInputStream#blockSeekTo may leak socket connection.

Chris Nauroth created HDFS-5493: --- Summary: DFSClient#DFSInputStream#blockSeekTo may leak socket connection. Key: HDFS-5493 URL: https://issues.apache.org/jira/browse/HDFS-5493 Project: Hadoop HDFS

Re: Next releases

Hi Arun, Another feature that would be relevant and got deferred was the symlink work (HADOOP-10020) that Colin and Andrew were working on. Can we include this in hadoop-2.3.0 also? thanks hari On Sun, Nov 10, 2013 at 2:07 PM, Alejandro Abdelnur wrote: > Arun, thanks for jumping on this. > > O

Hadoop-Hdfs-0.23-Build - Build # 788 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/788/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7885 lines...] [ERROR] location: class com.google.pro

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #788

See -- [...truncated 7692 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

[jira] [Created] (HDFS-5492) Port HDFS-2069 (Incorrect default trash interval in the docs) to trunk

Akira AJISAKA created HDFS-5492: --- Summary: Port HDFS-2069 (Incorrect default trash interval in the docs) to trunk Key: HDFS-5492 URL: https://issues.apache.org/jira/browse/HDFS-5492 Project: Hadoop HDFS