+1
Successfully compiled a standalone HDFS app using the 2.6.5 jars extracted
from the release tar.gz.
On Thu, Sep 29, 2016 at 10:33 AM, Chris Trezzo wrote:
> +1
>
> Thanks Sangjin!
>
> 1. Verified md5 checksums and signature on src, and release tar.gz.
> 2. Built from source.
> 3. Started up a
I would also prefer releasing current 2.8 branch sooner. There are several
incomplete features in branch-2 such as YARN-914 and HDFS-7877 that are
better served if we can complete them in the next major release. Letting
them span across multiple releases might not be desirable as there could be
som
Ming Ma created HDFS-9259:
-
Summary: Make SO_SNDBUF size configurable at DFSClient side for
hdfs write scenario
Key: HDFS-9259
URL: https://issues.apache.org/jira/browse/HDFS-9259
Project: Hadoop HDFS
Ming Ma created HDFS-9313:
-
Summary: Possible NullPointerException in BlockManager if no
excess replica can be chosen
Key: HDFS-9313
URL: https://issues.apache.org/jira/browse/HDFS-9313
Project: Hadoop HDFS
Ming Ma created HDFS-9314:
-
Summary: Improve BlockPlacementPolicyDefault's picking of excess
replicas
Key: HDFS-9314
URL: https://issues.apache.org/jira/browse/HDFS-9314
Project: Hadoop HDFS
Ming Ma created HDFS-9315:
-
Summary: Update excess storage type list properly when del hint is
picked
Key: HDFS-9315
URL: https://issues.apache.org/jira/browse/HDFS-9315
Project: Hadoop HDFS
Issue
Ming Ma created HDFS-9360:
-
Summary: Storage type usage isn't updated properly after file
deletion
Key: HDFS-9360
URL: https://issues.apache.org/jira/browse/HDFS-9360
Project: Hadoop HDFS
Ming Ma created HDFS-9388:
-
Summary: Refactor decommission related code to support maintenance
state for datanodes
Key: HDFS-9388
URL: https://issues.apache.org/jira/browse/HDFS-9388
Project: Hadoop HDFS
Ming Ma created HDFS-9389:
-
Summary: Add maintenance states to AdminStates
Key: HDFS-9389
URL: https://issues.apache.org/jira/browse/HDFS-9389
Project: Hadoop HDFS
Issue Type: Sub-task
Ming Ma created HDFS-9390:
-
Summary: Block management for maintenance states
Key: HDFS-9390
URL: https://issues.apache.org/jira/browse/HDFS-9390
Project: Hadoop HDFS
Issue Type: Sub-task
Ming Ma created HDFS-9391:
-
Summary: Update webUI/JMX/fsck to display maintenance state info
Key: HDFS-9391
URL: https://issues.apache.org/jira/browse/HDFS-9391
Project: Hadoop HDFS
Issue Type: Sub
Ming Ma created HDFS-9392:
-
Summary: Admins support for maintenance state
Key: HDFS-9392
URL: https://issues.apache.org/jira/browse/HDFS-9392
Project: Hadoop HDFS
Issue Type: Sub-task
Ming Ma created HDFS-9577:
-
Summary: ReadStatistics not thread safe when hedged read is enabled
Key: HDFS-9577
URL: https://issues.apache.org/jira/browse/HDFS-9577
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-9579:
-
Summary: Provide bytes-read-by-network-distance metrics at
FileSystem.Statistics level
Key: HDFS-9579
URL: https://issues.apache.org/jira/browse/HDFS-9579
Project: Hadoop HDFS
Ming Ma created HDFS-5639:
-
Summary: rpc scheduler abstraction
Key: HDFS-5639
URL: https://issues.apache.org/jira/browse/HDFS-5639
Project: Hadoop HDFS
Issue Type: Improvement
Reporter
Ming Ma created HDFS-5693:
-
Summary: Few NN metrics data points were collected via JMX when NN
is under heavy load
Key: HDFS-5693
URL: https://issues.apache.org/jira/browse/HDFS-5693
Project: Hadoop HDFS
Ming Ma created HDFS-5757:
-
Summary: Decommisson lots of nodes at the same time could slow
down NN
Key: HDFS-5757
URL: https://issues.apache.org/jira/browse/HDFS-5757
Project: Hadoop HDFS
Issue
Ming Ma created HDFS-12473:
--
Summary: Change host JSON file format
Key: HDFS-12473
URL: https://issues.apache.org/jira/browse/HDFS-12473
Project: Hadoop HDFS
Issue Type: Bug
Reporter
[
https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma resolved HDFS-7877.
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.1.0
3.0.0-beta1
Ming Ma created HDFS-10203:
--
Summary: Excessive topology lookup for large number of client
machines in namenode
Key: HDFS-10203
URL: https://issues.apache.org/jira/browse/HDFS-10203
Project: Hadoop HDFS
Ming Ma created HDFS-10206:
--
Summary: getBlockLocations might not sort datanodes properly by
distance
Key: HDFS-10206
URL: https://issues.apache.org/jira/browse/HDFS-10206
Project: Hadoop HDFS
Ming Ma created HDFS-10208:
--
Summary: Addendum for HDFS-9579: to handle the case when client
machine can't resolve network path
Key: HDFS-10208
URL: https://issues.apache.org/jira/browse/HDFS-10208
Pr
Ming Ma created HDFS-10221:
--
Summary: Replace test resource dfs.hosts.json with json file
generated at runtime
Key: HDFS-10221
URL: https://issues.apache.org/jira/browse/HDFS-10221
Project: Hadoop HDFS
Ming Ma created HDFS-7993:
-
Summary: Incorrect descriptions in fsck when nodes are
decommissioned
Key: HDFS-7993
URL: https://issues.apache.org/jira/browse/HDFS-7993
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-8025:
-
Summary: Addendum for HDFS-3087
Key: HDFS-8025
URL: https://issues.apache.org/jira/browse/HDFS-8025
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Ming Ma
Ming Ma created HDFS-8056:
-
Summary: Decommissioned dead nodes should continue to be counted
as dead after NN restart
Key: HDFS-8056
URL: https://issues.apache.org/jira/browse/HDFS-8056
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma resolved HDFS-7442.
---
Resolution: Duplicate
HDFS-7411 has addressed this issue.
> Optimization for decommission-in-progress ch
Ming Ma created HDFS-8647:
-
Summary: Abstract BlockManager's rack policy into
BlockPlacementPolicy
Key: HDFS-8647
URL: https://issues.apache.org/jira/browse/HDFS-8647
Project: Hadoop HDFS
Ming Ma created HDFS-8670:
-
Summary: Better to exclude decommissioned nodes for namenode
NodeUsage JMX
Key: HDFS-8670
URL: https://issues.apache.org/jira/browse/HDFS-8670
Project: Hadoop HDFS
Issue
Ming Ma created HDFS-8837:
-
Summary: Remove the unnecessary Quota.Counts class
Key: HDFS-8837
URL: https://issues.apache.org/jira/browse/HDFS-8837
Project: Hadoop HDFS
Issue Type: Improvement
Ming Ma created HDFS-8874:
-
Summary: Add DN metrics for balancer and other block movement
scenarios
Key: HDFS-8874
URL: https://issues.apache.org/jira/browse/HDFS-8874
Project: Hadoop HDFS
Issue
Ming Ma created HDFS-8875:
-
Summary: Optimize the wait time in Balancer for federation scenario
Key: HDFS-8875
URL: https://issues.apache.org/jira/browse/HDFS-8875
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-8876:
-
Summary: Make hard coded parameters used by balancer and other
tools configurable
Key: HDFS-8876
URL: https://issues.apache.org/jira/browse/HDFS-8876
Project: Hadoop HDFS
Ming Ma created HDFS-8940:
-
Summary: Support for large-scale multi-tenant inotify service
Key: HDFS-8940
URL: https://issues.apache.org/jira/browse/HDFS-8940
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-9004:
-
Summary: Add upgrade domain to DatanodeInfo
Key: HDFS-9004
URL: https://issues.apache.org/jira/browse/HDFS-9004
Project: Hadoop HDFS
Issue Type: Sub-task
Ming Ma created HDFS-9005:
-
Summary: Provide support for upgrade domain script
Key: HDFS-9005
URL: https://issues.apache.org/jira/browse/HDFS-9005
Project: Hadoop HDFS
Issue Type: Sub-task
Ming Ma created HDFS-9006:
-
Summary: Provide BlockPlacementPolicy that supports upgrade domain
Key: HDFS-9006
URL: https://issues.apache.org/jira/browse/HDFS-9006
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-9007:
-
Summary: Fix HDFS Balancer to honor upgrade domain policy
Key: HDFS-9007
URL: https://issues.apache.org/jira/browse/HDFS-9007
Project: Hadoop HDFS
Issue Type: Sub-task
Ming Ma created HDFS-9015:
-
Summary: Refactor TestReplicationPolicy to test different block
placement policies
Key: HDFS-9015
URL: https://issues.apache.org/jira/browse/HDFS-9015
Project: Hadoop HDFS
Ming Ma created HDFS-9016:
-
Summary: Display upgrade domain information in fsck
Key: HDFS-9016
URL: https://issues.apache.org/jira/browse/HDFS-9016
Project: Hadoop HDFS
Issue Type: Sub-task
Ming Ma created HDFS-3655:
-
Summary: datenode recoverRbw could hang sometime
Key: HDFS-3655
URL: https://issues.apache.org/jira/browse/HDFS-3655
Project: Hadoop HDFS
Issue Type: Bug
Ming Ma created HDFS-3998:
-
Summary: Speed up fsck
Key: HDFS-3998
URL: https://issues.apache.org/jira/browse/HDFS-3998
Project: Hadoop HDFS
Issue Type: Improvement
Components: name-node
[
https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma resolved HDFS-7541.
---
Resolution: Fixed
Assignee: Ming Ma
Fix Version/s: 2.9.0
Thanks for the everyone's inpu
[
https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma reopened HDFS-9392:
---
> Admins support for maintenance state
>
>
> Ke
[
https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma resolved HDFS-9392.
---
Resolution: Fixed
> Admins support for maintenance st
[
https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma reopened HDFS-9016:
---
> Display upgrade domain information in fsck
> --
>
>
[
https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma reopened HDFS-9922:
---
> Upgrade Domain placement policy status marks a good block in violation when
> there are decommissioned
Ming Ma created HDFS-12285:
--
Summary: Better handling of namenode ip address change
Key: HDFS-12285
URL: https://issues.apache.org/jira/browse/HDFS-12285
Project: Hadoop HDFS
Issue Type: Bug
Ming Ma created HDFS-6178:
-
Summary: Decommission on standby NN couldn't finish
Key: HDFS-6178
URL: https://issues.apache.org/jira/browse/HDFS-6178
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-6184:
-
Summary: Better health check from ZKFC
Key: HDFS-6184
URL: https://issues.apache.org/jira/browse/HDFS-6184
Project: Hadoop HDFS
Issue Type: Improvement
Ming Ma created HDFS-6272:
-
Summary: Improve FSNamesystem.listCorruptFileBlocks so that it
doesn't need to acquire the readLock.
Key: HDFS-6272
URL: https://issues.apache.org/jira/browse/HDFS-6272
Pr
Ming Ma created HDFS-6306:
-
Summary: Standby NN can hold FSDirectory's writeLock for a long
time under heavy load
Key: HDFS-6306
URL: https://issues.apache.org/jira/browse/HDFS-6306
Project: Hadoop
Ming Ma created HDFS-6424:
-
Summary: blockReport doesn't need to invalidate blocks on SBN
Key: HDFS-6424
URL: https://issues.apache.org/jira/browse/HDFS-6424
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-6425:
-
Summary: reset postponedMisreplicatedBlocks and
postponedMisreplicatedBlocksCount when NN becomes active
Key: HDFS-6425
URL: https://issues.apache.org/jira/browse/HDFS-6425
Ming Ma created HDFS-6477:
-
Summary: Have RetryInvocationHandler log failover attempt at INFO
level
Key: HDFS-6477
URL: https://issues.apache.org/jira/browse/HDFS-6477
Project: Hadoop HDFS
Issue
Ming Ma created HDFS-6478:
-
Summary: RemoteException can't be retried properly for non-HA
scenario
Key: HDFS-6478
URL: https://issues.apache.org/jira/browse/HDFS-6478
Project: Hadoop HDFS
Ming Ma created HDFS-6626:
-
Summary: Node is marked decommissioned if it becomes dead when it
is being decommissioned
Key: HDFS-6626
URL: https://issues.apache.org/jira/browse/HDFS-6626
Project: Hadoop HDFS
Ming Ma created HDFS-6697:
-
Summary: Make NN lease soft and hard limits configurable
Key: HDFS-6697
URL: https://issues.apache.org/jira/browse/HDFS-6697
Project: Hadoop HDFS
Issue Type: Improvement
Ming Ma created HDFS-6721:
-
Summary: Handle the situation where SBN is in zombie state
Key: HDFS-6721
URL: https://issues.apache.org/jira/browse/HDFS-6721
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-6722:
-
Summary: Display readable last contact time for dead nodes on NN
webUI
Key: HDFS-6722
URL: https://issues.apache.org/jira/browse/HDFS-6722
Project: Hadoop HDFS
Issue
Ming Ma created HDFS-6723:
-
Summary: New NN webUI no longer displays decommissioned state for
dead node
Key: HDFS-6723
URL: https://issues.apache.org/jira/browse/HDFS-6723
Project: Hadoop HDFS
Ming Ma created HDFS-6742:
-
Summary: Support sorting datanode list on the new NN webUI
Key: HDFS-6742
URL: https://issues.apache.org/jira/browse/HDFS-6742
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-6743:
-
Summary: Put IP address into a new column on the new NN webUI
Key: HDFS-6743
URL: https://issues.apache.org/jira/browse/HDFS-6743
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-6744:
-
Summary: Improve decommissioning nodes and dead nodes access on
the new NN webUI
Key: HDFS-6744
URL: https://issues.apache.org/jira/browse/HDFS-6744
Project: Hadoop HDFS
Ming Ma created HDFS-6745:
-
Summary: Display the list of "very-under-replicated blocks" as
well as the files on NN webUI
Key: HDFS-6745
URL: https://issues.apache.org/jira/browse/HDFS-6745
Proje
Ming Ma created HDFS-6746:
-
Summary: Support datanode list pagination and filtering for big
clusters on NN webUI
Key: HDFS-6746
URL: https://issues.apache.org/jira/browse/HDFS-6746
Project: Hadoop HDFS
Ming Ma created HDFS-6747:
-
Summary: Display the most recent GC info on NN webUI
Key: HDFS-6747
URL: https://issues.apache.org/jira/browse/HDFS-6747
Project: Hadoop HDFS
Issue Type: Improvement
Ming Ma created HDFS-6751:
-
Summary: NN WebUI enhancements
Key: HDFS-6751
URL: https://issues.apache.org/jira/browse/HDFS-6751
Project: Hadoop HDFS
Issue Type: Task
Reporter: Ming Ma
[
https://issues.apache.org/jira/browse/HDFS-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma resolved HDFS-6747.
---
Resolution: Won't Fix
> Display the most recent GC info on
Ming Ma created HDFS-6772:
-
Summary: Get DNs out of blockContentsStale==true state faster when
NN restarts
Key: HDFS-6772
URL: https://issues.apache.org/jira/browse/HDFS-6772
Project: Hadoop HDFS
Ming Ma created HDFS-6791:
-
Summary: A block could remain under replicated if all of its
replicas are on decommissioned nodes
Key: HDFS-6791
URL: https://issues.apache.org/jira/browse/HDFS-6791
Project
Ming Ma created HDFS-6816:
-
Summary: Standby NN new webUI Startup Progress tab displays
"Failed to retrieve data from ..." error
Key: HDFS-6816
URL: https://issues.apache.org/jira/browse/HDFS-6816
Ming Ma created HDFS-6943:
-
Summary: Improve NN allocateBlock log to include replicas'
datanode IPs
Key: HDFS-6943
URL: https://issues.apache.org/jira/browse/HDFS-6943
Project: Hadoop HDFS
Ming Ma created HDFS-7009:
-
Summary: No enough retry during DN's initial handshake with NN
Key: HDFS-7009
URL: https://issues.apache.org/jira/browse/HDFS-7009
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-7123:
-
Summary: Run legacy fsimage checkpoint in parallel with PB fsimage
checkpoint
Key: HDFS-7123
URL: https://issues.apache.org/jira/browse/HDFS-7123
Project: Hadoop HDFS
Ming Ma created HDFS-7128:
-
Summary: Decommission slows way down when it gets towards the end
Key: HDFS-7128
URL: https://issues.apache.org/jira/browse/HDFS-7128
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-7150:
-
Summary: MissingBlocks > 0 when all replicas are on
decomm-in-progress nodes
Key: HDFS-7150
URL: https://issues.apache.org/jira/browse/HDFS-7150
Project: Hadoop H
Ming Ma created HDFS-7182:
-
Summary: RollingUpgradeStatus JMX metrics can't be accessed when
NN is busy
Key: HDFS-7182
URL: https://issues.apache.org/jira/browse/HDFS-7182
Project: Hadoop
Ming Ma created HDFS-7208:
-
Summary: NN doesn't schedule replication when a DN storage fails
Key: HDFS-7208
URL: https://issues.apache.org/jira/browse/HDFS-7208
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-7269:
-
Summary: NN and DN don't check whether corrupted blocks reported
by clients are actually corrupted
Key: HDFS-7269
URL: https://issues.apache.org/jira/browse/HDFS-7269
Pr
Ming Ma created HDFS-7281:
-
Summary: Missing block is marked as corrupted block
Key: HDFS-7281
URL: https://issues.apache.org/jira/browse/HDFS-7281
Project: Hadoop HDFS
Issue Type: Bug
Ming Ma created HDFS-7314:
-
Summary: Aborted DFSClient's impact on long running service like
YARN
Key: HDFS-7314
URL: https://issues.apache.org/jira/browse/HDFS-7314
Project: Hadoop HDFS
Issue
Ming Ma created HDFS-7400:
-
Summary: More reliable namenode health check to detect OS/HW issues
Key: HDFS-7400
URL: https://issues.apache.org/jira/browse/HDFS-7400
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-7401:
-
Summary: Add block info to DFSInputStream' WARN message when it
adds node to deadNodes
Key: HDFS-7401
URL: https://issues.apache.org/jira/browse/HDFS-7401
Project: Hadoop
Ming Ma created HDFS-7439:
-
Summary: Add BlockOpResponseProto's message to DFSClient's
exception message
Key: HDFS-7439
URL: https://issues.apache.org/jira/browse/HDFS-7439
Project: H
Ming Ma created HDFS-7441:
-
Summary: More accurate slow node detection in HDFS write pipeline
Key: HDFS-7441
URL: https://issues.apache.org/jira/browse/HDFS-7441
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-7442:
-
Summary: Optimization for decommission-in-progress check
Key: HDFS-7442
URL: https://issues.apache.org/jira/browse/HDFS-7442
Project: Hadoop HDFS
Issue Type: Improvement
Ming Ma created HDFS-7491:
-
Summary: Add incremental blockreport latency to DN metrics
Key: HDFS-7491
URL: https://issues.apache.org/jira/browse/HDFS-7491
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-7518:
-
Summary: Heartbeat processing doesn't have to take FSN readLock
Key: HDFS-7518
URL: https://issues.apache.org/jira/browse/HDFS-7518
Project: Hadoop HDFS
Issue Type
Ming Ma created HDFS-7521:
-
Summary: Refactor DN state management
Key: HDFS-7521
URL: https://issues.apache.org/jira/browse/HDFS-7521
Project: Hadoop HDFS
Issue Type: Improvement
Ming Ma created HDFS-7541:
-
Summary: Support for fast HDFS datanode rolling upgrade
Key: HDFS-7541
URL: https://issues.apache.org/jira/browse/HDFS-7541
Project: Hadoop HDFS
Issue Type: Improvement
Ming Ma created HDFS-7725:
-
Summary: Incorrect "nodes in service" metrics caused all writes to
fail
Key: HDFS-7725
URL: https://issues.apache.org/jira/browse/HDFS-7725
Project: Hadoop HDFS
Ming Ma created HDFS-7877:
-
Summary: Support maintenance state for datanodes
Key: HDFS-7877
URL: https://issues.apache.org/jira/browse/HDFS-7877
Project: Hadoop HDFS
Issue Type: New Feature
93 matches
Mail list logo
