Re: [E] Cost Based FairCallQueue latency issue

2020-11-05 Thread Daryn Sharp
I submitted the original 2.8 cost-based FCQ patch (thanks to community members for porting to other branches). We've been running with it since early 2019 on all clusters. Multiple clusters run at a baseline of ~30k+ ops/sec with some bursting over 100k ops/sec. If you are looking at the overall

Re: [E] Cost Based FairCallQueue latency issue

2020-11-05 Thread Daryn Sharp
mpl > > org.apache.hadoop.ipc.WeightedTimeCostProvider > > > > > > ipc.8020.decay-scheduler.blacklisted.users.enabled > > true > > > > > > ipc.8020.decay-scheduler.decay-factor > > 0.01 > > > >

Re: WebHDFS Create File redirect

2013-03-11 Thread Daryn Sharp
I'm not sure, but I believe it uses the name the DN used to register with the NN. But… The NN will reject registrations from unresolvable hostnames so I believe DNS is mandatory. Daryn On Mar 11, 2013, at 12:58 PM, Steven Matthews wrote: > I'm writing some test code to try out the WebHDFS RE

Re: Why failed to use Distcp over FTP protocol?

2013-04-22 Thread Daryn Sharp
I believe it should work… What error message did you receive? Daryn On Apr 22, 2013, at 3:45 AM, sam liu wrote: > Hi Experts, > > I failed to execute following command, does not Distcp support FTP protocol? > > hadoop distcp ftp://hadoopadm:@ftphostname/tmp/file1.txt > hdfs:///tmp/fi

Re: Why failed to use Distcp over FTP protocol?

2013-04-23 Thread Daryn Sharp
er.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.hadoop.tools.DistCp.main(DistCp.java:908) 2013/4/23 Daryn Sharp mailto:da...@yahoo-inc.com>> I believe it should work… What error message did you receive? Daryn On Apr 22, 2013, at 3:45 AM, s

Re: Why failed to use Distcp over FTP protocol?

2013-04-24 Thread Daryn Sharp
quot;;, and it returns: rm: Delete failed ftp://hadoopadm:<ftp://hadoopadm:@ftphostname/some/path/here>@ftphostname/some/path/here<ftp://hadoopadm:@ftphostname/some/path/here> 2013/4/24 Daryn Sharp mailto:da...@yahoo-inc.com>> The ftp fs is listing the conten

Re: Why failed to use Distcp over FTP protocol?

2013-04-25 Thread Daryn Sharp
me', it will return the root path of my linux file system. 2013/4/24 Daryn Sharp mailto:da...@yahoo-inc.com>> Listing the root is a bit of a special case that is different than N-many directories deep. Can you list ftp://hadoopadm:@ftphostname/some/dir/file or ftp://hadoopa

Re: Class responsible for Registered DataNode.

2013-04-25 Thread Daryn Sharp
DatanodeManager Daryn On Apr 25, 2013, at 1:41 AM, Mohammad Mustaqeem wrote: > Which class keeps track of all the registered DataNodes? > > -- > *With regards ---* > *Mohammad Mustaqeem*, > M.Tech (CSE) > MNNIT Allahabad > 9026604270

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-01 Thread Daryn Sharp
I broke RPC QOP for integrity and privacy options. :( See blocker HADOOP-9816. I think I understand the problem and it shouldn't be hard to fix. The bug went unnoticed because sadly there are no unit tests for the QOP options, even though it just involves a conf setting. Daryn On Jul 29, 20

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Daryn Sharp
I've been OOO (got a call to fix this bug), but just to clarify: We're ok with HA _not working at all_ with security enabled in 2.1.0-beta? That's the ramification of omitting HADOOP-9880. Daryn On Aug 16, 2013, at 9:20 PM, Arun C Murthy wrote: > Yep, there are quite a number of such fixes in

Re: symlink support in Hadoop 2 GA

2013-10-03 Thread Daryn Sharp
I reluctantly agree that we should disable symlinks in 2.2 until we can sort out the compatibility issues. I'm reluctant in the sense that its a feature users have long wanted, and it's something we'd like to use from an administrative view. However I don't see all the issues being shorted out

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-07 Thread Daryn Sharp
+1 I did some basic testing and it appears to work fine. Daryn On Oct 7, 2013, at 2:00 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.2.0 that I would like to > get released - this release fixes a small number of bugs and some > protocol/api issues

Re: [VOTE] Merging branch HDFS-7240 to trunk

2018-03-01 Thread Daryn Sharp
I’m generally neutral and looked foremost at developer impact. Ie. Will it be so intertwined with hdfs that each project risks destabilizing the other? Will developers with no expertise in ozone will be impeded? I think the answer is currently no. These are the intersections and some concerns

Re: relative symbolic links in HDFS

2011-10-31 Thread Daryn Sharp
It's generally been a problem that filesystem operations mangle paths to be something other than what the user provided. FsShell has to go to some (unnecessary, imho) lengths to independently track the user's given path so the output paths will match what the user provided. Not displaying the

Re: relative symbolic links in HDFS

2011-10-31 Thread Daryn Sharp
n't gone to the extent of fully porting it to > FileContext. Though I'd love to, unfortunately I'm too busy right now to > contribute :( > > Thanks! > > -Chuck > > > > -Original Message- > From: Daryn Sharp [mailto:da...@yahoo-inc.com] > Sen

Re: relative symbolic links in HDFS

2011-10-31 Thread Daryn Sharp
On Oct 31, 2011, at 1:45 PM, Eli Collins wrote: > On Mon, Oct 31, 2011 at 9:27 AM, Charles Baker wrote: >> But even >> if it did return the relative path, it seems counter-intuitive to me. I agree >> with Daryn and expect the behavior of getFileLinkStatus() to return the >> symlink as is and not

Re: relative symbolic links in HDFS

2011-11-01 Thread Daryn Sharp
On Oct 31, 2011, at 5:41 PM, Eli Collins wrote: >> Regardless, I do think it makes sense to have a convenience method to get the >> raw path that was supplied at symlink creation. The first thing I tried was >> Path#toString() so that I guess is pretty intuitive but I can't comment on >> whether th

Re: [DISCUSS] Remove append?

2012-03-22 Thread Daryn Sharp
On Mar 20, 2012, at 7:37 PM, Eli Collins wrote: > Hey gang, > > I'd like to get people's thoughts on the following proposal. I think > we should consider removing append from HDFS. > > Where we are today.. append was added in the 0.17-19 releases > (HADOOP-1700) and subsequently disabled (HADOOP-

Re: [DISCUSS] Remove append?

2012-03-23 Thread Daryn Sharp
I think Yarn/MR might be able to benefit from the ability to append to logs in hdfs. It might reduce some of the after-the-fact copying of logs into hdfs. Daryn On Mar 22, 2012, at 8:18 PM, Dhruba Borthakur wrote: > I think "append" would be useful. But not precisely sure which applications >

Re: [DISCUSS] Hadoop RPC encryption performance improvements

2018-10-31 Thread Daryn Sharp
; encryption performance) and HADOOP-13836 > > <https://issues.apache.org/jira/browse/HADOOP-13836> (Securing Hadoop > RPC > > using SSL). But it looks like both attempts have not been progressing. > > > > During the recent Hadoop contributor meetup, Daryn Sharp ment

Re: [VOTE] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby

2018-12-06 Thread Daryn Sharp
-1 pending additional info. After a cursory scan, I have serious concerns regarding the design. This seems like a feature that should have been purely implemented in hdfs w/o touching the common IPC layer. The biggest issue in the alignment context. It's purpose appears to be for allowing handl

Re: TestHDFSCLI is broken

2011-06-10 Thread Daryn Sharp
Hi Eli, I noticed the issue yesterday. It's from a recent change of mine in common, and I'm not sure how I didn't catch the problem... I must have missed doing a veryclean in hdfs before running the tests. I'll have a patch up this morning. Daryn On Jun 9, 2011, at 5:33 PM, Eli Collins wro

[jira] [Created] (HDFS-9198) Coalesce IBR processing in the NN

2015-10-05 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9198: - Summary: Coalesce IBR processing in the NN Key: HDFS-9198 URL: https://issues.apache.org/jira/browse/HDFS-9198 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-9258) NN should indicate which nodes are stale

2015-10-16 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9258: - Summary: NN should indicate which nodes are stale Key: HDFS-9258 URL: https://issues.apache.org/jira/browse/HDFS-9258 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-9287) Block placement completely fails if too many nodes are decommissioning

2015-10-22 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9287: - Summary: Block placement completely fails if too many nodes are decommissioning Key: HDFS-9287 URL: https://issues.apache.org/jira/browse/HDFS-9287 Project: Hadoop HDFS

[jira] [Created] (HDFS-9557) Reduce object allocation in PB conversion

2015-12-15 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9557: - Summary: Reduce object allocation in PB conversion Key: HDFS-9557 URL: https://issues.apache.org/jira/browse/HDFS-9557 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-9566) Remove expensive getStorages method

2015-12-16 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9566: - Summary: Remove expensive getStorages method Key: HDFS-9566 URL: https://issues.apache.org/jira/browse/HDFS-9566 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-4437) Clients should not retain leases on moved files

2013-01-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4437: - Summary: Clients should not retain leases on moved files Key: HDFS-4437 URL: https://issues.apache.org/jira/browse/HDFS-4437 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-4474) Command : "hadoop fs -ls / " suggesting local directories/files instead hdfs directories/files

2013-02-06 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-4474. --- Resolution: Invalid > Command : "hadoop fs -ls / " suggesting local directories/

[jira] [Created] (HDFS-4478) Token operations should not lock namespace

2013-02-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4478: - Summary: Token operations should not lock namespace Key: HDFS-4478 URL: https://issues.apache.org/jira/browse/HDFS-4478 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4488) Confusing WebHDFS exception when host doesn't resolve

2013-02-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4488: - Summary: Confusing WebHDFS exception when host doesn't resolve Key: HDFS-4488 URL: https://issues.apache.org/jira/browse/HDFS-4488 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4490) Confusing WebHDFS exception when user has no TGT

2013-02-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4490: - Summary: Confusing WebHDFS exception when user has no TGT Key: HDFS-4490 URL: https://issues.apache.org/jira/browse/HDFS-4490 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4493) webhdfs fails after SPNEGO token expires

2013-02-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4493: - Summary: webhdfs fails after SPNEGO token expires Key: HDFS-4493 URL: https://issues.apache.org/jira/browse/HDFS-4493 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4494) Confusing exception for unresolvable hdfs host with security enabled

2013-02-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4494: - Summary: Confusing exception for unresolvable hdfs host with security enabled Key: HDFS-4494 URL: https://issues.apache.org/jira/browse/HDFS-4494 Project: Hadoop HDFS

[jira] [Created] (HDFS-4532) RPC call queue may fill due to current user lookup

2013-02-26 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4532: - Summary: RPC call queue may fill due to current user lookup Key: HDFS-4532 URL: https://issues.apache.org/jira/browse/HDFS-4532 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4539) Secret manager saves expired items

2013-02-28 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4539: - Summary: Secret manager saves expired items Key: HDFS-4539 URL: https://issues.apache.org/jira/browse/HDFS-4539 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-4539) Secret manager saves expired items

2013-02-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-4539. --- Resolution: Invalid Approach is fatally flawed. See HDFS-4539. > Secret mana

[jira] [Created] (HDFS-4542) Webhdfs doesn't support secure proxy users

2013-03-01 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4542: - Summary: Webhdfs doesn't support secure proxy users Key: HDFS-4542 URL: https://issues.apache.org/jira/browse/HDFS-4542 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4546) Hftp does not audit log

2013-03-04 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4546: - Summary: Hftp does not audit log Key: HDFS-4546 URL: https://issues.apache.org/jira/browse/HDFS-4546 Project: Hadoop HDFS Issue Type: Bug Components

[jira] [Created] (HDFS-4548) Webhdfs doesn't renegotiate SPNEGO token

2013-03-04 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4548: - Summary: Webhdfs doesn't renegotiate SPNEGO token Key: HDFS-4548 URL: https://issues.apache.org/jira/browse/HDFS-4548 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4553) Webhdfs will NPE on some unexpected response codes

2013-03-05 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4553: - Summary: Webhdfs will NPE on some unexpected response codes Key: HDFS-4553 URL: https://issues.apache.org/jira/browse/HDFS-4553 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-4490) Confusing WebHDFS exception when user has no TGT

2013-03-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-4490. --- Resolution: Duplicate > Confusing WebHDFS exception when user has no

[jira] [Created] (HDFS-4560) Webhdfs cannot use tokens obtained by another user

2013-03-06 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4560: - Summary: Webhdfs cannot use tokens obtained by another user Key: HDFS-4560 URL: https://issues.apache.org/jira/browse/HDFS-4560 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4564) Webhdfs returns incorrect http response codes for denied operations

2013-03-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4564: - Summary: Webhdfs returns incorrect http response codes for denied operations Key: HDFS-4564 URL: https://issues.apache.org/jira/browse/HDFS-4564 Project: Hadoop HDFS

[jira] [Created] (HDFS-4566) Webdhfs token cancelation should use authentication

2013-03-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4566: - Summary: Webdhfs token cancelation should use authentication Key: HDFS-4566 URL: https://issues.apache.org/jira/browse/HDFS-4566 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4567) Webhdfs does not need a token for token operations

2013-03-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4567: - Summary: Webhdfs does not need a token for token operations Key: HDFS-4567 URL: https://issues.apache.org/jira/browse/HDFS-4567 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4568) NN should require authenticated connections to cancel tokens

2013-03-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4568: - Summary: NN should require authenticated connections to cancel tokens Key: HDFS-4568 URL: https://issues.apache.org/jira/browse/HDFS-4568 Project: Hadoop HDFS

[jira] [Created] (HDFS-4576) Webhdfs authentication issues

2013-03-08 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4576: - Summary: Webhdfs authentication issues Key: HDFS-4576 URL: https://issues.apache.org/jira/browse/HDFS-4576 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4577) Webhdfs operations should declare if authentication is required

2013-03-08 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4577: - Summary: Webhdfs operations should declare if authentication is required Key: HDFS-4577 URL: https://issues.apache.org/jira/browse/HDFS-4577 Project: Hadoop HDFS

[jira] [Created] (HDFS-4585) Webhdfs sometimes can't negotiate a SPNEGO token

2013-03-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4585: - Summary: Webhdfs sometimes can't negotiate a SPNEGO token Key: HDFS-4585 URL: https://issues.apache.org/jira/browse/HDFS-4585 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4587) Webhdfs secure clients are incompatible with non-secure NN

2013-03-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4587: - Summary: Webhdfs secure clients are incompatible with non-secure NN Key: HDFS-4587 URL: https://issues.apache.org/jira/browse/HDFS-4587 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-4585) Webhdfs sometimes can't negotiate a SPNEGO token

2013-03-13 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-4585. --- Resolution: Duplicate It's actually the other way around: curl is sending more, java is sending

[jira] [Created] (HDFS-4649) Webhdfs cannot list large directories

2013-03-28 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4649: - Summary: Webhdfs cannot list large directories Key: HDFS-4649 URL: https://issues.apache.org/jira/browse/HDFS-4649 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4690) Namenode exits if entering safemode while secret manager is edit logging

2013-04-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4690: - Summary: Namenode exits if entering safemode while secret manager is edit logging Key: HDFS-4690 URL: https://issues.apache.org/jira/browse/HDFS-4690 Project: Hadoop HDFS

[jira] [Created] (HDFS-4766) Enable NN spnego filters only if kerberos is enabled

2013-04-26 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4766: - Summary: Enable NN spnego filters only if kerberos is enabled Key: HDFS-4766 URL: https://issues.apache.org/jira/browse/HDFS-4766 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4805) Webhdfs client is fragile to token renewal errors

2013-05-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-4805: - Summary: Webhdfs client is fragile to token renewal errors Key: HDFS-4805 URL: https://issues.apache.org/jira/browse/HDFS-4805 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-4874) create with OVERWRITE deletes existing file without checking the lease: feature or a bug.

2013-06-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-4874. --- Resolution: Not A Problem Hadoop Flags: Incompatible change I fully agree with Suresh. An

[jira] [Created] (HDFS-5029) Token operations should not block write operations

2013-07-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5029: - Summary: Token operations should not block write operations Key: HDFS-5029 URL: https://issues.apache.org/jira/browse/HDFS-5029 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5238) Improve NN operation throughput

2013-09-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5238: - Summary: Improve NN operation throughput Key: HDFS-5238 URL: https://issues.apache.org/jira/browse/HDFS-5238 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-5240) Separate formatting from logging in the audit logger API

2013-09-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5240: - Summary: Separate formatting from logging in the audit logger API Key: HDFS-5240 URL: https://issues.apache.org/jira/browse/HDFS-5240 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5241) Provide alternate queuing audit logger to reduce logging contention

2013-09-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5241: - Summary: Provide alternate queuing audit logger to reduce logging contention Key: HDFS-5241 URL: https://issues.apache.org/jira/browse/HDFS-5241 Project: Hadoop HDFS

[jira] [Created] (HDFS-5242) Reduce contention on DatanodeInfo instances

2013-09-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5242: - Summary: Reduce contention on DatanodeInfo instances Key: HDFS-5242 URL: https://issues.apache.org/jira/browse/HDFS-5242 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5243) Remove contention during block token creation

2013-09-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5243: - Summary: Remove contention during block token creation Key: HDFS-5243 URL: https://issues.apache.org/jira/browse/HDFS-5243 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-5239) Allow FSNamesystem lock fairness to be configurable

2013-09-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5239: - Summary: Allow FSNamesystem lock fairness to be configurable Key: HDFS-5239 URL: https://issues.apache.org/jira/browse/HDFS-5239 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5293) Symlink resolution requires unnecessary RPCs

2013-10-03 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5293: - Summary: Symlink resolution requires unnecessary RPCs Key: HDFS-5293 URL: https://issues.apache.org/jira/browse/HDFS-5293 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5294) DistributedFileSystem getLinkStatus should not fully qualifies the link target

2013-10-03 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5294: - Summary: DistributedFileSystem getLinkStatus should not fully qualifies the link target Key: HDFS-5294 URL: https://issues.apache.org/jira/browse/HDFS-5294 Project: Hadoop

[jira] [Created] (HDFS-5453) Support fine grain locking in FSNamesystem

2013-11-04 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5453: - Summary: Support fine grain locking in FSNamesystem Key: HDFS-5453 URL: https://issues.apache.org/jira/browse/HDFS-5453 Project: Hadoop HDFS Issue Type: New

[jira] [Created] (HDFS-5477) Block manager as a service

2013-11-07 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5477: - Summary: Block manager as a service Key: HDFS-5477 URL: https://issues.apache.org/jira/browse/HDFS-5477 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-5514) FSNamesystem's fsLock should allow custom implementation

2013-11-14 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5514: - Summary: FSNamesystem's fsLock should allow custom implementation Key: HDFS-5514 URL: https://issues.apache.org/jira/browse/HDFS-5514 Project: Hadoop HDFS

[jira] [Created] (HDFS-5654) Add lock context support to FSNamesystemLock

2013-12-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5654: - Summary: Add lock context support to FSNamesystemLock Key: HDFS-5654 URL: https://issues.apache.org/jira/browse/HDFS-5654 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-5655) Update FSNamesystem path operations to use a lock context

2013-12-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5655: - Summary: Update FSNamesystem path operations to use a lock context Key: HDFS-5655 URL: https://issues.apache.org/jira/browse/HDFS-5655 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5681) renewLease should not hold fsn write lock

2013-12-18 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5681: - Summary: renewLease should not hold fsn write lock Key: HDFS-5681 URL: https://issues.apache.org/jira/browse/HDFS-5681 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5773) NN may reject formerly dead DNs

2014-01-14 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5773: - Summary: NN may reject formerly dead DNs Key: HDFS-5773 URL: https://issues.apache.org/jira/browse/HDFS-5773 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Created] (HDFS-5823) Document async audit logging

2014-01-23 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5823: - Summary: Document async audit logging Key: HDFS-5823 URL: https://issues.apache.org/jira/browse/HDFS-5823 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-5875) Add iterator support to INodesInPath

2014-02-03 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5875: - Summary: Add iterator support to INodesInPath Key: HDFS-5875 URL: https://issues.apache.org/jira/browse/HDFS-5875 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12639) BPOfferService lock may stall all service actors

2017-10-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12639: -- Summary: BPOfferService lock may stall all service actors Key: HDFS-12639 URL: https://issues.apache.org/jira/browse/HDFS-12639 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12645) FSDatasetImpl lock will stall BP service actors and may cause missing blocks

2017-10-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12645: -- Summary: FSDatasetImpl lock will stall BP service actors and may cause missing blocks Key: HDFS-12645 URL: https://issues.apache.org/jira/browse/HDFS-12645 Project

[jira] [Created] (HDFS-12646) Avoid IO while holding the FsDataset lock

2017-10-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12646: -- Summary: Avoid IO while holding the FsDataset lock Key: HDFS-12646 URL: https://issues.apache.org/jira/browse/HDFS-12646 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-12647) DN commands processing should be async

2017-10-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12647: -- Summary: DN commands processing should be async Key: HDFS-12647 URL: https://issues.apache.org/jira/browse/HDFS-12647 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12648) DN should provide feedback to NN for throttling commands

2017-10-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12648: -- Summary: DN should provide feedback to NN for throttling commands Key: HDFS-12648 URL: https://issues.apache.org/jira/browse/HDFS-12648 Project: Hadoop HDFS

[jira] [Created] (HDFS-12657) Operations based on inode id must not fallback to the path

2017-10-13 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12657: -- Summary: Operations based on inode id must not fallback to the path Key: HDFS-12657 URL: https://issues.apache.org/jira/browse/HDFS-12657 Project: Hadoop HDFS

[jira] [Created] (HDFS-12658) Lease renewal causes connection flapping

2017-10-13 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12658: -- Summary: Lease renewal causes connection flapping Key: HDFS-12658 URL: https://issues.apache.org/jira/browse/HDFS-12658 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2017-10-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12703: -- Summary: Exceptions are fatal to decommissioning monitor Key: HDFS-12703 URL: https://issues.apache.org/jira/browse/HDFS-12703 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12704) FBR may corrupt block state

2017-10-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12704: -- Summary: FBR may corrupt block state Key: HDFS-12704 URL: https://issues.apache.org/jira/browse/HDFS-12704 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12705: -- Summary: WebHdfsFileSystem exceptions should retain the caused by exception Key: HDFS-12705 URL: https://issues.apache.org/jira/browse/HDFS-12705 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-4493) webhdfs fails after SPNEGO token expires

2017-10-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-4493. --- Resolution: Works for Me Release Note: This issue was fixed years ago when authenticated url was

[jira] [Created] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2017-10-30 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12747: -- Summary: Lease monitor may infinitely loop on the same lease Key: HDFS-12747 URL: https://issues.apache.org/jira/browse/HDFS-12747 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-06 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12907: -- Summary: Allow read-only access to reserved raw for non-superusers Key: HDFS-12907 URL: https://issues.apache.org/jira/browse/HDFS-12907 Project: Hadoop HDFS

[jira] [Created] (HDFS-12914) Block report leases cause missing blocks until next report

2017-12-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12914: -- Summary: Block report leases cause missing blocks until next report Key: HDFS-12914 URL: https://issues.apache.org/jira/browse/HDFS-12914 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-13038) User with no permission on file is able to run getfacl for that file

2018-01-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-13038. Resolution: Not A Problem > User with no permission on file is able to run getfacl for that f

[jira] [Created] (HDFS-13111) Close recovery may incorrectly mark blocks corrupt

2018-02-06 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-13111: -- Summary: Close recovery may incorrectly mark blocks corrupt Key: HDFS-13111 URL: https://issues.apache.org/jira/browse/HDFS-13111 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

2018-02-06 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-13112: -- Summary: Token expiration edits may cause log corruption or deadlock Key: HDFS-13112 URL: https://issues.apache.org/jira/browse/HDFS-13112 Project: Hadoop HDFS

[jira] [Created] (HDFS-13465) Overlapping lease recoveries cause NPE in NN

2018-04-17 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-13465: -- Summary: Overlapping lease recoveries cause NPE in NN Key: HDFS-13465 URL: https://issues.apache.org/jira/browse/HDFS-13465 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-13929) DFSClient leaks data streamer sockets

2018-09-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-13929: -- Summary: DFSClient leaks data streamer sockets Key: HDFS-13929 URL: https://issues.apache.org/jira/browse/HDFS-13929 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10326: -- Summary: Disable setting tcp socket send/receive buffers for write pipelines Key: HDFS-10326 URL: https://issues.apache.org/jira/browse/HDFS-10326 Project: Hadoop HDFS

[jira] [Created] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-04-28 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10342: -- Summary: BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt Key: HDFS-10342 URL: https://issues.apache.org/jira/browse/HDFS-10342

[jira] [Created] (HDFS-10343) BlockManager#createLocatedBlocks may return blocks on failed storages

2016-04-28 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10343: -- Summary: BlockManager#createLocatedBlocks may return blocks on failed storages Key: HDFS-10343 URL: https://issues.apache.org/jira/browse/HDFS-10343 Project: Hadoop HDFS

[jira] [Created] (HDFS-7964) Add support for async edit logging

2015-03-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-7964: - Summary: Add support for async edit logging Key: HDFS-7964 URL: https://issues.apache.org/jira/browse/HDFS-7964 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7967) Reduce the performance impact of the balancer

2015-03-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-7967: - Summary: Reduce the performance impact of the balancer Key: HDFS-7967 URL: https://issues.apache.org/jira/browse/HDFS-7967 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-7990) IBR delete ack should not be delayed

2015-03-25 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-7990: - Summary: IBR delete ack should not be delayed Key: HDFS-7990 URL: https://issues.apache.org/jira/browse/HDFS-7990 Project: Hadoop HDFS Issue Type: Bug

  1   2   3   >