Daryn Sharp created HADOOP-17638:
Summary: Checksum type is always forced to be crc32
Key: HADOOP-17638
URL: https://issues.apache.org/jira/browse/HADOOP-17638
Project: Hadoop Common
Issue
There’s a few too many issues being mixed here.
We aren’t very far from having OIDC support. The pre-requisite RPC/TLS &
RPC/mTLS recently completed rollout to our entire production grid.
Majority of the past year was spent shaking out bugs and ensuring 100%
compatibility. There are a few rough
[
https://issues.apache.org/jira/browse/HADOOP-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-16521.
--
Resolution: Invalid
> Subject has a contradiction between proxy user and real u
[
https://issues.apache.org/jira/browse/HADOOP-16291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-16291.
--
Resolution: Not A Problem
> HDFS Permissions Guide appears incorrect about getFileSta
-1 pending additional info. After a cursory scan, I have serious concerns
regarding the design. This seems like a feature that should have been
purely implemented in hdfs w/o touching the common IPC layer.
The biggest issue in the alignment context. It's purpose appears to be for
allowing handl
Daryn Sharp created HADOOP-15980:
Summary: Enable TLS in RPC client/server
Key: HADOOP-15980
URL: https://issues.apache.org/jira/browse/HADOOP-15980
Project: Hadoop Common
Issue Type: Sub
Daryn Sharp created HADOOP-15981:
Summary: Add mutual TLS support for RPC
Key: HADOOP-15981
URL: https://issues.apache.org/jira/browse/HADOOP-15981
Project: Hadoop Common
Issue Type: Sub
Daryn Sharp created HADOOP-15979:
Summary: Add Netty support to the RPC client
Key: HADOOP-15979
URL: https://issues.apache.org/jira/browse/HADOOP-15979
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-15978:
Summary: Add Netty support to the RPC server
Key: HADOOP-15978
URL: https://issues.apache.org/jira/browse/HADOOP-15978
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-15977:
Summary: RPC support for TLS
Key: HADOOP-15977
URL: https://issues.apache.org/jira/browse/HADOOP-15977
Project: Hadoop Common
Issue Type: Improvement
Daryn Sharp created HADOOP-15897:
Summary: Port range binding fails due to socket bind race condition
Key: HADOOP-15897
URL: https://issues.apache.org/jira/browse/HADOOP-15897
Project: Hadoop Common
; encryption performance) and HADOOP-13836
> > <https://issues.apache.org/jira/browse/HADOOP-13836> (Securing Hadoop
> RPC
> > using SSL). But it looks like both attempts have not been progressing.
> >
> > During the recent Hadoop contributor meetup, Daryn Sharp ment
Daryn Sharp created HADOOP-15813:
Summary: Enable more reliable SSL connection reuse
Key: HADOOP-15813
URL: https://issues.apache.org/jira/browse/HADOOP-15813
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-15811:
Summary: Optimizations for Java's TLS performance
Key: HADOOP-15811
URL: https://issues.apache.org/jira/browse/HADOOP-15811
Project: Hadoop Common
Daryn Sharp created HADOOP-15743:
Summary: Jetty and SSL tunings to stabilize KMS performance
Key: HADOOP-15743
URL: https://issues.apache.org/jira/browse/HADOOP-15743
Project: Hadoop Common
Daryn Sharp created HADOOP-15402:
Summary: Prevent double logout of UGI's LoginContext
Key: HADOOP-15402
URL: https://issues.apache.org/jira/browse/HADOOP-15402
Project: Hadoop Common
I’m generally neutral and looked foremost at developer impact. Ie. Will
it be so intertwined with hdfs that each project risks destabilizing the
other? Will developers with no expertise in ozone will be impeded? I
think the answer is currently no. These are the intersections and some
concerns
Daryn Sharp created HADOOP-15212:
Summary: Add independent secret manager method for logging expired
tokens
Key: HADOOP-15212
URL: https://issues.apache.org/jira/browse/HADOOP-15212
Project: Hadoop
Daryn Sharp created HADOOP-14912:
Summary: FairCallQueue may defer servicing calls
Key: HADOOP-14912
URL: https://issues.apache.org/jira/browse/HADOOP-14912
Project: Hadoop Common
Issue Type
[
https://issues.apache.org/jira/browse/HADOOP-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-9856.
-
Resolution: Duplicate
Release Note: Incorporated into parent jira.
> Av
[
https://issues.apache.org/jira/browse/HADOOP-9852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-9852.
-
Resolution: Duplicate
Incorporated into parent jira.
> UGI login user keytab and princi
Daryn Sharp created HADOOP-14687:
Summary: AuthenticatedURL will reuse bad/expired session cookies
Key: HADOOP-14687
URL: https://issues.apache.org/jira/browse/HADOOP-14687
Project: Hadoop Common
Daryn Sharp created HADOOP-14659:
Summary: UGI getShortUserName does not need to search the Subject
Key: HADOOP-14659
URL: https://issues.apache.org/jira/browse/HADOOP-14659
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp reopened HADOOP-14146:
--
Failing with java 7 due to java 8's Iterator having a default impl of remove.
Will
Daryn Sharp created HADOOP-14578:
Summary: Bind IPC connections to kerberos UPN host for proxy users
Key: HADOOP-14578
URL: https://issues.apache.org/jira/browse/HADOOP-14578
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-14031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-14031.
--
Resolution: Fixed
All subtasks are complete.
> Reduce fair call queue performance imp
[
https://issues.apache.org/jira/browse/HADOOP-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-9749.
-
Resolution: Duplicate
> Remove synchronization for UGI.getCurrentU
Daryn Sharp created HADOOP-14146:
Summary: KerberosAuthenticationHandler should authenticate with
SPN in AP-REQ
Key: HADOOP-14146
URL: https://issues.apache.org/jira/browse/HADOOP-14146
Project
Daryn Sharp created HADOOP-14035:
Summary: Reduce fair call queue backoff's impact on clients
Key: HADOOP-14035
URL: https://issues.apache.org/jira/browse/HADOOP-14035
Project: Hadoop C
Daryn Sharp created HADOOP-14034:
Summary: Allow ipc layer exceptions to selectively close
connections
Key: HADOOP-14034
URL: https://issues.apache.org/jira/browse/HADOOP-14034
Project: Hadoop Common
Daryn Sharp created HADOOP-14033:
Summary: Reduce fair call queue lock contention
Key: HADOOP-14033
URL: https://issues.apache.org/jira/browse/HADOOP-14033
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-14032:
Summary: Reduce fair call queue priority inversion
Key: HADOOP-14032
URL: https://issues.apache.org/jira/browse/HADOOP-14032
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-14031:
Summary: Reduce fair call queue performance impact
Key: HADOOP-14031
URL: https://issues.apache.org/jira/browse/HADOOP-14031
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-13549:
Summary: Eliminate intermediate buffer for server-side PB encoding
Key: HADOOP-13549
URL: https://issues.apache.org/jira/browse/HADOOP-13549
Project: Hadoop Common
Daryn Sharp created HADOOP-13547:
Summary: Optimize IPC client protobuf decoding
Key: HADOOP-13547
URL: https://issues.apache.org/jira/browse/HADOOP-13547
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-13537:
Summary: Support external calls in the RPC call queue
Key: HADOOP-13537
URL: https://issues.apache.org/jira/browse/HADOOP-13537
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-13465:
Summary: Design Server.Call to be extensible for unified call queue
Key: HADOOP-13465
URL: https://issues.apache.org/jira/browse/HADOOP-13465
Project: Hadoop Common
Daryn Sharp created HADOOP-13442:
Summary: Optimize UGI group lookups
Key: HADOOP-13442
URL: https://issues.apache.org/jira/browse/HADOOP-13442
Project: Hadoop Common
Issue Type: Improvement
Daryn Sharp created HADOOP-13438:
Summary: Optimize IPC server protobuf decoding
Key: HADOOP-13438
URL: https://issues.apache.org/jira/browse/HADOOP-13438
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-13429:
Summary: Dispose of unnecessary SASL servers
Key: HADOOP-13429
URL: https://issues.apache.org/jira/browse/HADOOP-13429
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-13426:
Summary: More efficiently build IPC responses
Key: HADOOP-13426
URL: https://issues.apache.org/jira/browse/HADOOP-13426
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-13425:
Summary: IPC layer optimizations
Key: HADOOP-13425
URL: https://issues.apache.org/jira/browse/HADOOP-13425
Project: Hadoop Common
Issue Type: Improvement
Daryn Sharp created HADOOP-13052:
Summary: ChecksumFileSystem mishandles crc file permissions
Key: HADOOP-13052
URL: https://issues.apache.org/jira/browse/HADOOP-13052
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-7733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-7733.
-
Resolution: Won't Fix
The configuration mismatch isn't something that can be worked ar
Daryn Sharp created HADOOP-12861:
Summary: RPC client fails too quickly when server connection limit
is reached
Key: HADOOP-12861
URL: https://issues.apache.org/jira/browse/HADOOP-12861
Project
Daryn Sharp created HADOOP-12858:
Summary: Reduce UGI getGroups overhead
Key: HADOOP-12858
URL: https://issues.apache.org/jira/browse/HADOOP-12858
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-12483:
Summary: Maintain wrapped SASL ordering for postponed IPC responses
Key: HADOOP-12483
URL: https://issues.apache.org/jira/browse/HADOOP-12483
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-11019.
--
Resolution: Duplicate
> Queued IPC calls are not aborted if the connection dr
Daryn Sharp created HADOOP-12054:
Summary: RPC client should not retry for InvalidToken exceptions
Key: HADOOP-12054
URL: https://issues.apache.org/jira/browse/HADOOP-12054
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-11888.
--
Resolution: Duplicate
The hostname must be canonicalized, not just resolved. This is a dup
Daryn Sharp created HADOOP-11780:
Summary: Prevent IPC reader thread death
Key: HADOOP-11780
URL: https://issues.apache.org/jira/browse/HADOOP-11780
Project: Hadoop Common
Issue Type: Bug
Daryn Sharp created HADOOP-11628:
Summary: SPNEGO auth does not work with CNAMEs in JDK8
Key: HADOOP-11628
URL: https://issues.apache.org/jira/browse/HADOOP-11628
Project: Hadoop Common
Daryn Sharp created HADOOP-11019:
Summary: Queued IPC calls are not aborted if the connection drops
Key: HADOOP-11019
URL: https://issues.apache.org/jira/browse/HADOOP-11019
Project: Hadoop Common
Daryn Sharp created HADOOP-10944:
Summary: AbstractFileSystem may not return correct home directory
Key: HADOOP-10944
URL: https://issues.apache.org/jira/browse/HADOOP-10944
Project: Hadoop Common
Daryn Sharp created HADOOP-10942:
Summary: Globbing optimizations and regression fix
Key: HADOOP-10942
URL: https://issues.apache.org/jira/browse/HADOOP-10942
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-10941:
Summary: Proxy user verification NPEs if remote host is
unresolvable
Key: HADOOP-10941
URL: https://issues.apache.org/jira/browse/HADOOP-10941
Project: Hadoop Common
Daryn Sharp created HADOOP-10940:
Summary: RPC client does poor bounds checking of responses
Key: HADOOP-10940
URL: https://issues.apache.org/jira/browse/HADOOP-10940
Project: Hadoop Common
Daryn Sharp created HADOOP-10716:
Summary: Cannot use more than 1 har filesystem
Key: HADOOP-10716
URL: https://issues.apache.org/jira/browse/HADOOP-10716
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-10585:
Summary: Retry polices ignore interrupted exceptions
Key: HADOOP-10585
URL: https://issues.apache.org/jira/browse/HADOOP-10585
Project: Hadoop Common
Issue
[
https://issues.apache.org/jira/browse/HADOOP-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-8490.
-
Resolution: Won't Fix
Specific issue that prompted the bug was fixed in the NM long ago.
Daryn Sharp created HADOOP-10504:
Summary: Document proxy server support
Key: HADOOP-10504
URL: https://issues.apache.org/jira/browse/HADOOP-10504
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-10498:
Summary: Add support for proxy server
Key: HADOOP-10498
URL: https://issues.apache.org/jira/browse/HADOOP-10498
Project: Hadoop Common
Issue Type: New
[
https://issues.apache.org/jira/browse/HADOOP-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-10269.
--
Resolution: Not A Problem
> SaslException is completely igno
Daryn Sharp created HADOOP-10332:
Summary: HttpServer's jetty audit log always logs 200 OK
Key: HADOOP-10332
URL: https://issues.apache.org/jira/browse/HADOOP-10332
Project: Hadoop C
Daryn Sharp created HADOOP-10301:
Summary: AuthenticationFilter should return Forbidden for failed
authentication
Key: HADOOP-10301
URL: https://issues.apache.org/jira/browse/HADOOP-10301
Project
Daryn Sharp created HADOOP-10300:
Summary: Allowed deferred sending of call responses
Key: HADOOP-10300
URL: https://issues.apache.org/jira/browse/HADOOP-10300
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-10233:
Summary: RPC lacks output flow control
Key: HADOOP-10233
URL: https://issues.apache.org/jira/browse/HADOOP-10233
Project: Hadoop Common
Issue Type: Bug
Daryn Sharp created HADOOP-10172:
Summary: Cache SASL server factories
Key: HADOOP-10172
URL: https://issues.apache.org/jira/browse/HADOOP-10172
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-10174:
Summary: Run RPC server within the Subject that instantiated it
Key: HADOOP-10174
URL: https://issues.apache.org/jira/browse/HADOOP-10174
Project: Hadoop Common
Daryn Sharp created HADOOP-10173:
Summary: Remove UGI from DIGEST-MD5 SASL server creation
Key: HADOOP-10173
URL: https://issues.apache.org/jira/browse/HADOOP-10173
Project: Hadoop Common
Are you adding something internal to the NN? If not, you cannot get the
namesystem instance via a client unless you are using a minicluster object.
Daryn
On Dec 9, 2013, at 7:11 AM, Yoonmin Nam wrote:
> I want to get a running instance of FSNamesystem of HDFS. However, it is
> somewhat compli
Daryn Sharp created HADOOP-10146:
Summary: Workaround JDK7 Process fd close bug
Key: HADOOP-10146
URL: https://issues.apache.org/jira/browse/HADOOP-10146
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-10129:
Summary: Distcp may succeed when it fails
Key: HADOOP-10129
URL: https://issues.apache.org/jira/browse/HADOOP-10129
Project: Hadoop Common
Issue Type: Bug
Daryn Sharp created HADOOP-10099:
Summary: Reduce chance for RPC denial of service
Key: HADOOP-10099
URL: https://issues.apache.org/jira/browse/HADOOP-10099
Project: Hadoop Common
Issue Type
+1 I did some basic testing and it appears to work fine.
Daryn
On Oct 7, 2013, at 2:00 AM, Arun C Murthy wrote:
> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.2.0 that I would like to
> get released - this release fixes a small number of bugs and some
> protocol/api issues
I reluctantly agree that we should disable symlinks in 2.2 until we can sort
out the compatibility issues. I'm reluctant in the sense that its a feature
users have long wanted, and it's something we'd like to use from an
administrative view. However I don't see all the issues being shorted out
Daryn Sharp created HADOOP-10014:
Summary: Symlink resolution is fundamentally broken for
multi-layered filesystems
Key: HADOOP-10014
URL: https://issues.apache.org/jira/browse/HADOOP-10014
Project
Daryn Sharp created HADOOP-10013:
Summary: FileSystem checkPath accepts invalid paths with an
authority but no scheme
Key: HADOOP-10013
URL: https://issues.apache.org/jira/browse/HADOOP-10013
Project
Daryn Sharp created HADOOP-9956:
---
Summary: RPC listener inefficiently assigns connections to readers
Key: HADOOP-9956
URL: https://issues.apache.org/jira/browse/HADOOP-9956
Project: Hadoop Common
Daryn Sharp created HADOOP-9955:
---
Summary: RPC idle connection closing is extremely inefficient
Key: HADOOP-9955
URL: https://issues.apache.org/jira/browse/HADOOP-9955
Project: Hadoop Common
Daryn Sharp created HADOOP-9953:
---
Summary: Improve RPC server throughput
Key: HADOOP-9953
URL: https://issues.apache.org/jira/browse/HADOOP-9953
Project: Hadoop Common
Issue Type: Improvement
Daryn Sharp created HADOOP-9930:
---
Summary: Desync AbstractDelegationTokenSecretManager
Key: HADOOP-9930
URL: https://issues.apache.org/jira/browse/HADOOP-9930
Project: Hadoop Common
Issue Type
I've been OOO (got a call to fix this bug), but just to clarify:
We're ok with HA _not working at all_ with security enabled in 2.1.0-beta?
That's the ramification of omitting HADOOP-9880.
Daryn
On Aug 16, 2013, at 9:20 PM, Arun C Murthy wrote:
> Yep, there are quite a number of such fixes in
[
https://issues.apache.org/jira/browse/HADOOP-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp resolved HADOOP-9789.
-
Resolution: Fixed
Will be fixed by HADOOP-9868.
> Support server adverti
Daryn Sharp created HADOOP-9868:
---
Summary: Server must not advertise kerberos realm
Key: HADOOP-9868
URL: https://issues.apache.org/jira/browse/HADOOP-9868
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-9856:
---
Summary: Avoid Krb5LoginModule.logout issue
Key: HADOOP-9856
URL: https://issues.apache.org/jira/browse/HADOOP-9856
Project: Hadoop Common
Issue Type: Sub
Daryn Sharp created HADOOP-9852:
---
Summary: UGI login user keytab and principal should not be static
Key: HADOOP-9852
URL: https://issues.apache.org/jira/browse/HADOOP-9852
Project: Hadoop Common
Daryn Sharp created HADOOP-9850:
---
Summary: RPC kerberos errors don't trigger relogin
Key: HADOOP-9850
URL: https://issues.apache.org/jira/browse/HADOOP-9850
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-9832:
---
Summary: Add RPC header to client ping
Key: HADOOP-9832
URL: https://issues.apache.org/jira/browse/HADOOP-9832
Project: Hadoop Common
Issue Type: Sub-task
Daryn Sharp created HADOOP-9820:
---
Summary: RPCv9 wire protocol is insufficient to support
multiplexing
Key: HADOOP-9820
URL: https://issues.apache.org/jira/browse/HADOOP-9820
Project: Hadoop Common
I broke RPC QOP for integrity and privacy options. :( See blocker HADOOP-9816.
I think I understand the problem and it shouldn't be hard to fix.
The bug went unnoticed because sadly there are no unit tests for the QOP
options, even though it just involves a conf setting.
Daryn
On Jul 29, 20
Daryn Sharp created HADOOP-9816:
---
Summary: RPC Sasl QOP is broken
Key: HADOOP-9816
URL: https://issues.apache.org/jira/browse/HADOOP-9816
Project: Hadoop Common
Issue Type: Bug
Daryn Sharp created HADOOP-9789:
---
Summary: Support server advertised kerberos principals
Key: HADOOP-9789
URL: https://issues.apache.org/jira/browse/HADOOP-9789
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-9749:
---
Summary: Remove synchronization for UGI.getCurrentUser
Key: HADOOP-9749
URL: https://issues.apache.org/jira/browse/HADOOP-9749
Project: Hadoop Common
Issue
Daryn Sharp created HADOOP-9748:
---
Summary: Reduce blocking on UGI.ensureInitialized
Key: HADOOP-9748
URL: https://issues.apache.org/jira/browse/HADOOP-9748
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-9747:
---
Summary: Reduce unnecessary UGI synchronization
Key: HADOOP-9747
URL: https://issues.apache.org/jira/browse/HADOOP-9747
Project: Hadoop Common
Issue Type: Bug
Sorry for falling out of the loop. I'm catching up the jiras and discussion,
and will comment this afternoon.
Daryn
On Jul 10, 2013, at 8:42 AM, Larry McCay wrote:
> All -
>
> After combing through this thread - as well as the summit session summary
> thread, I think that we have the followi
Daryn Sharp created HADOOP-9698:
---
Summary: RPCv9 client must honor server's SASL negotiate response
Key: HADOOP-9698
URL: https://issues.apache.org/jira/browse/HADOOP-9698
Project: Hadoop C
Daryn Sharp created HADOOP-9645:
---
Summary: KerberosAuthenticator NPEs on connect error
Key: HADOOP-9645
URL: https://issues.apache.org/jira/browse/HADOOP-9645
Project: Hadoop Common
Issue Type
Daryn Sharp created HADOOP-9516:
---
Summary: Enable spnego filters only if kerberos is enabled
Key: HADOOP-9516
URL: https://issues.apache.org/jira/browse/HADOOP-9516
Project: Hadoop Common
1 - 100 of 226 matches
Mail list logo
