hdfs-dev  

Messages by Thread

• Re: JDK17 support for Hadoop slfan1989
  • Re: [External Sender] Re: JDK17 support for Hadoop Jason Wen
  • Re: [External Sender] Re: JDK17 support for Hadoop slfan1989
• [jira] [Resolved] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17372) CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command farmmamba (Jira)
• Jdk17 bilwa st
  • Re: JDK17 support for Hadoop Battula, Brahma Reddy
• [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1) slfan1989
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1) Xiaoqiao He
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1) Xiaoqiao He
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1) Takanobu Asanuma
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1) Ayush Saxena
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1) slfan1989
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 (RC1) slfan1989
• [jira] [Resolved] (HDFS-17369) Add uuid into datanode info for NameNodeMXBean Shilun Fan (Jira)
• [jira] [Created] (HDFS-17371) Implement vectored io api Jie Han (Jira)
• [jira] [Created] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17369) Add uuid into datanode info for NameNodeMXBean Haiyang Hu (Jira)
• Discussion about NameNode Fine-grained locking Zengqiang XU
  • Re: Discussion about NameNode Fine-grained locking Hui Fei
  • Re: Discussion about NameNode Fine-grained locking Brahma Reddy Battula
  • Re: Discussion about NameNode Fine-grained locking haiyang hu
  • Re: Discussion about NameNode Fine-grained locking ZanderXu
  • Re: Discussion about NameNode Fine-grained locking Yuanbo Liu
  • Re: Discussion about NameNode Fine-grained locking Xiaoqiao He
  • Re: Discussion about NameNode Fine-grained locking Hui Fei
  • Re: Discussion about NameNode Fine-grained locking Yuanbo Liu
  • Re: Discussion about NameNode Fine-grained locking Takanobu Asanuma
  • Re: Discussion about NameNode Fine-grained locking Yuanbo Liu
  • Re: Discussion about NameNode Fine-grained locking Takanobu Asanuma
  • Re: Discussion about NameNode Fine-grained locking Xiaoqiao He
  • Fwd: Discussion about NameNode Fine-grained locking ZanderXu
  • Re: Discussion about NameNode Fine-grained locking ZanderXu
  • Re: Discussion about NameNode Fine-grained locking Xiaoqiao He
  • Re: Discussion about NameNode Fine-grained locking slfan1989
  • Re: Discussion about NameNode Fine-grained locking Zengqiang XU
  • Re: Discussion about NameNode Fine-grained locking ZanderXu
  • Re: Discussion about NameNode Fine-grained locking Hui Fei
  • Re: Discussion about NameNode Fine-grained locking Xiaoqiao He
  • Re: Discussion about NameNode Fine-grained locking Ayush Saxena
  • Re: Discussion about NameNode Fine-grained locking ZanderXu
  • Re: Discussion about NameNode Fine-grained locking Hui Fei
  • Re: Discussion about NameNode Fine-grained locking Hui Fei
  • Re: Discussion about NameNode Fine-grained locking ZanderXu
  • Re: Discussion about NameNode Fine-grained locking ZanderXu
  • Re: Discussion about NameNode Fine-grained locking Hui Fei
  • Re: Discussion about NameNode Fine-grained locking Ayush Saxena
  • Re: Discussion about NameNode Fine-grained locking haiyang hu
  • Discussion about NameNode Fine-grained locking Zhanghaobo
  • Re: Discussion about NameNode Fine-grained locking Xiaoqiao He
  • Re: Discussion about NameNode Fine-grained locking ZanderXu
• [jira] [Resolved] (HDFS-17359) EC: recheck failed streamers should only after flushing all packets. Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17368) HA: Standy should exit safemode when resources are from low available Zilong Zhu (Jira)
• [jira] [Created] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX Hualong Zhang (Jira)
• [jira] [Created] (HDFS-17366) NameNode Fine-Grained Locking via Namespace Tree ZanderXu (Jira)
• [jira] [Created] (HDFS-17365) Add extra redunency configuration in checkStreamerFailures to prevent data loss. farmmamba (Jira)
• [jira] [Created] (HDFS-17364) Use WeakReferencedElasticByteBufferPool in DFSStripedInputStream Bryan Beaudreault (Jira)
• [jira] [Reopened] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped Takanobu Asanuma (Jira)
• [jira] [Resolved] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped farmmamba (Jira)
  • [jira] [Resolved] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped Takanobu Asanuma (Jira)
• [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 slfan1989
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 Xiaoqiao He
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 slfan1989
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 Xiaoqiao He
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 Ayush Saxena
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 slfan1989
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 Takanobu Asanuma
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 slfan1989
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 Shuyan Zhang
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.2.0 RC0 slfan1989
• [VOTE] Release Apache Hadoop 3.4.0 (RC1) slfan1989
  • Re: [VOTE] Release Apache Hadoop 3.4.0 (RC1) slfan1989
  • Re: [VOTE] Release Apache Hadoop 3.4.0 (RC1) Steve Loughran
  • Re: [VOTE] Release Apache Hadoop 3.4.0 (RC1) slfan1989
• [jira] [Resolved] (HDFS-17363) Avoid initializing unnecessary objects in method getBlockRecoveryCommand farmmamba (Jira)
• [jira] [Created] (HDFS-17363) Avoid initializing unnecessary objects in method getBlockRecoveryCommand farmmamba (Jira)
• [jira] [Created] (HDFS-17362) RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17361) DiskBalancer: Query command support with multiple nodes Haiyang Hu (Jira)
• [jira] [Created] (HDFS-17360) Record the number of times a block is read during a certain time period. huangzhaobo (Jira)
• [jira] [Created] (HDFS-17359) EC: recheck failed streamers should only after flushing all packets. farmmamba (Jira)
• [jira] [Created] (HDFS-17358) EC: infinite lease recovery farmmamba (Jira)
• [jira] [Created] (HDFS-17357) NioInetPeer.close() should close socket connection. liuguanghua (Jira)
• [jira] [Created] (HDFS-17356) RBF Add Configuration dfs.federation.router.ns.name Optimization wangzhihui (Jira)
• [jira] [Resolved] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17355) Restart NameNode then cause client throw EOFException chaijunjie (Jira)
• [jira] [Resolved] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt. Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17354) Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up lei w (Jira)
• [jira] [Created] (HDFS-17353) Fix failing RBF module tests Alexander Bogdanov (Jira)
• [jira] [Created] (HDFS-17352) Add configuration to control whether DN delete this replica from disk when client requests a missing block Haiyang Hu (Jira)
• [jira] [Created] (HDFS-17351) Add S3 Access Grants Support in S3A Jason Han (Jira)
• [jira] [Created] (HDFS-17350) update AWS SDK to support S3 Access Grants in S3A Jason Han (Jira)
• [jira] [Created] (HDFS-17349) evictWriters command does not seem to work effectively Srinivasu Majeti (Jira)
• [jira] [Created] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped farmmamba (Jira)
• [jira] [Created] (HDFS-17347) EC: Limit recovery worker counts to prevent holding two many network connections. farmmamba (Jira)
• [jira] [Resolved] (HDFS-17293) First packet data + checksum size will be set to 516 bytes when writing to a new block. Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17346) Fix DirectoryScanner check mark the normal blocks as corrupt. Haiyang Hu (Jira)
• [jira] [Created] (HDFS-17345) Add a metrics to record block report generating cost time farmmamba (Jira)
• [jira] [Resolved] (HDFS-17311) RBF: ConnectionManager creatorQueue should offer a pool that is not already in creatorQueue. Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-17343) Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException Chris Trezzo (Jira)
• [jira] [Created] (HDFS-17344) Last packet will be splited into two parts when write block farmmamba (Jira)
• [INFO] Hadoop-3.4 Release Update Xiaoqiao He
  • Re: [INFO] Hadoop-3.4 Release Update slfan1989
  • Re: [INFO] Hadoop-3.4 Release Update Takanobu Asanuma
  • Re: [INFO] Hadoop-3.4 Release Update Masatake Iwasaki
  • Re: [INFO] Hadoop-3.4 Release Update Xiaoqiao He
  • Re: [INFO] Hadoop-3.4 Release Update slfan1989
  • Re: [INFO] Hadoop-3.4 Release Update Xiaoqiao He
  • Re: [INFO] Hadoop-3.4 Release Update slfan1989
  • Re: [INFO] Hadoop-3.4 Release Update Brahma Reddy Battula
  • Re: [INFO] Hadoop-3.4 Release Update slfan1989
  • Re: [INFO] Hadoop-3.4 Release Update Xiaoqiao He
  • Re: [INFO] Hadoop-3.4 Release Update slfan1989
• [jira] [Resolved] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html Shuyan Zhang (Jira)
• [jira] [Resolved] (HDFS-17334) FSEditLogAsync#enqueueEdit does not synchronized this before invoke wait method farmmamba (Jira)
• [jira] [Created] (HDFS-17343) Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-16016) BPServiceActor add a new thread to handle IBR Shilun Fan (Jira)
• [jira] [Created] (HDFS-17342) Fix DataNode may invalidates normal block causing missing block Haiyang Hu (Jira)
• [jira] [Resolved] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync. Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17341) Support dedicated user queues in Namenode FairCallQueue Lei Yang (Jira)
• [jira] [Reopened] (HDFS-16016) BPServiceActor add a new thread to handle IBR Shilun Fan (Jira)
• [jira] [Created] (HDFS-17340) transaction lag issue between aNN and oNN causing HDFS_DELEGATION_TOKEN can't be found in cache in oNN Rohan Nimmagadda (Jira)
• [jira] [Resolved] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue Shilun Fan (Jira)
• [jira] [Created] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode lei w (Jira)
• [jira] [Resolved] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations. Shuyan Zhang (Jira)
• [jira] [Resolved] (HDFS-17289) Considering the size of non-lastBlocks equals to complete block size can cause append failure. Shuyan Zhang (Jira)
• [jira] [Resolved] (HDFS-17128) RBF: SQLDelegationTokenSecretManager should use version of tokens updated by other routers Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-17312) packetsReceived metric should ignore heartbeat packet Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17338) Improve the doc related to permissions. huangzhaobo (Jira)
• [jira] [Created] (HDFS-17337) RPC RESPONSE time seems not exactly accurate when using FSEditLogAsync. farmmamba (Jira)
• [jira] [Created] (HDFS-17336) Provide an option to enable/disable considering space used by .Trash folder for user quota compuation Srinivasu Majeti (Jira)
• [VOTE] Release Apache Hadoop 3.4.0 RC0 slfan1989
  • Re: [VOTE] Release Apache Hadoop 3.4.0 RC0 Masatake Iwasaki
  • Re: [VOTE] Release Apache Hadoop 3.4.0 RC0 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop 3.4.0 RC0 slfan1989
  • Re: [VOTE] Release Apache Hadoop 3.4.0 RC0 Ayush Saxena
  • Re: [VOTE] Release Apache Hadoop 3.4.0 RC0 slfan1989
  • Fwd: Fw:Re: [VOTE] Release Apache Hadoop 3.4.0 RC0 slfan1989
  • Re: Fw:Re: [VOTE] Release Apache Hadoop 3.4.0 RC0 Steve Loughran
  • Re: Fw:Re: [VOTE] Release Apache Hadoop 3.4.0 RC0 slfan1989
• [jira] [Created] (HDFS-17335) Add metrics for syncWaitQ in FSEditLogAsync farmmamba (Jira)
• [jira] [Created] (HDFS-17334) FSEditLogAsync#enqueueEdit does not synchronized this before invoke wait method farmmamba (Jira)
• [jira] [Created] (HDFS-17333) Support lazy resolve host->ip Jian Zhang (Jira)
• [jira] [Created] (HDFS-17332) DFSInputStream: avoid logging stacktrace until when we really need to fail a read request with a MissingBlockException Xing Lin (Jira)
• [jira] [Created] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html lei w (Jira)
• [jira] [Resolved] (HDFS-17330) CachingGetSpaceUsed#used should use LongAdder after DN splits lock farmmamba (Jira)
• [jira] [Created] (HDFS-17330) CachingGetSpaceUsed#used should use LongAdder after DN splits lock farmmamba (Jira)
• [jira] [Created] (HDFS-17329) org.apache.hadoop.hdfs.server.diskbalancer.datamodel.DiskBalancerCluster#nodesToProcess farmmamba (Jira)
• [jira] [Created] (HDFS-17328) DiskBalancer should not computeNodeDensity every time when addVolume farmmamba (Jira)
• [jira] [Resolved] (HDFS-17317) DebugAdmin metaOut not need multiple close Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17327) Fix reconfig disk balancer parameters for datanode. huangzhaobo (Jira)
• [jira] [Resolved] (HDFS-17313) dfsadmin -reconfig option to start/query reconfig on all live namenodes. huangzhaobo (Jira)
• [jira] [Reopened] (HDFS-17313) dfsadmin -reconfig option to start/query reconfig on all live namenodes. huangzhaobo (Jira)
• [jira] [Resolved] (HDFS-17326) Fix NameNode Spotbug Shilun Fan (Jira)
• [jira] [Created] (HDFS-17326) Fix NameNode Spotbugs Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes Konstantin Shvachko (Jira)
• [jira] [Resolved] (HDFS-17315) Optimize the namenode format code logic. Takanobu Asanuma (Jira)
• [jira] [Resolved] (HDFS-17325) Doc: Fix the documentation of fs expunge command in FileSystemShell.md Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-17309) RBF: Fix Router Safemode check contidition error Shilun Fan (Jira)
• [jira] [Created] (HDFS-17325) Doc: Fix the documentation of fs expunge command in FileSystemShell.md liuguanghua (Jira)
• [jira] [Created] (HDFS-17324) RBF: Router should not return nameservices that not enable observer read in RpcResponseHeaderProto liuguanghua (Jira)
• [jira] [Resolved] (HDFS-17322) RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-17306) RBF:Router should not return nameservices that does not enable observer nodes in RpcResponseHeaderProto Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17323) Uncontrolled fsimage size due to snapshot diff meta for file deletions Srinivasu Majeti (Jira)
• [jira] [Resolved] (HDFS-15807) RefreshVolume fails when replacing DISK/ARCHIVE vol on same mount Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-17023) RBF: Record proxy time when call invokeConcurrent method. Shilun Fan (Jira)
• [jira] [Created] (HDFS-17322) RetryCache#MAX_CAPACITY seems to be MIN_CAPACITY farmmamba (Jira)
• [jira] [Resolved] (HDFS-17310) DiskBalancer: Enhance the log message for submitPlan Shilun Fan (Jira)
• [jira] [Created] (HDFS-17321) RBF: Add RouterAutoMsyncService for auto msync in Router liuguanghua (Jira)
• [jira] [Resolved] (HDFS-17182) DataSetLockManager.lockLeakCheck() is not thread-safe. Xiaoqiao He (Jira)
• [jira] [Created] (HDFS-17320) seekToNewSource uses ignoredNodes to get a new node other than the current node. Jian Zhang (Jira)
• Re: [DISCUSS] Release Hadoop 3.4.0 Xiaoqiao He
  • Re: [DISCUSS] Release Hadoop 3.4.0 Mukund Madhav Thakur
  • Re: Re: [DISCUSS] Release Hadoop 3.4.0 slfan1989
  • Re: Re: [DISCUSS] Release Hadoop 3.4.0 Ayush Saxena
  • Re: Re: [DISCUSS] Release Hadoop 3.4.0 slfan1989
  • Re: [DISCUSS] Release Hadoop 3.4.0 slfan1989
• [ANNOUNCE] Hadoop 3.3.7-aws preview release Ahmar Suhail
• [jira] [Created] (HDFS-17319) Downgrade noisy InvalidToken log in ShortCircuitCache Bryan Beaudreault (Jira)
• [jira] [Created] (HDFS-17318) MountTableResolver#locationCache supports multi policies farmmamba (Jira)
• [jira] [Created] (HDFS-17317) DebugAdmin metaOut not need multiple close xy (Jira)
• [jira] [Created] (HDFS-17316) Compatibility Benchmark over HCFS Implementations Han Liu (Jira)
• [jira] [Created] (HDFS-17315) Optimize the namenode format code logic. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17314) Add a metrics to record congestion backoff counts. farmmamba (Jira)
• [jira] [Created] (HDFS-17313) dfsadmin -reconfig option to start/query reconfig on all live namenodes. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17312) packetsReceived metric should ignore heartbeat packet farmmamba (Jira)
• [jira] [Resolved] (HDFS-17277) Delete invalid code logic in namenode format Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17311) RBF: ConnectionManager creatorQueue should offer a pool that is not already in creatorQueue. liuguanghua (Jira)
• [jira] [Created] (HDFS-17310) DiskBalancer: Enhance the log message Haiyang Hu (Jira)
• [jira] [Created] (HDFS-17309) Fix Router Safemode check contidition error liuguanghua (Jira)
• [jira] [Resolved] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode. Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17308) docker-compose.yaml sets namenode directory wrong causing datanode failures on restart Matthew Rossi (Jira)
• [jira] [Resolved] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted. Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17307) docker-compose.yaml sets namenode directory wrong causing datanode failures on restart Matthew Rossi (Jira)
• [jira] [Created] (HDFS-17306) RBF:Router should not return nameservices that does not enable observer nodes in RpcResponseHeaderProto liuguanghua (Jira)
• [jira] [Created] (HDFS-17305) Add avoid datanode reason count related metrics to namenode. huangzhaobo99 (Jira)
• [jira] [Resolved] (HDFS-17284) Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17304) Update fsck -blockId to display slownode status of blocks. huangzhaobo99 (Jira)
• [jira] [Resolved] (HDFS-17275) Judge whether the block has been deleted in the block report Shuyan Zhang (Jira)

• Earlier messages
• Later messages