hdfs-dev  

Messages by Thread

• Add secrets for apache/hadoop repo to publish images to DockerHub Wei-Chiu Chuang
• [jira] [Created] (HDFS-17806) Increase EC file getFileChecksum timeout liuguanghua (Jira)
• [jira] [Created] (HDFS-17805) A more detailed flushOrSync Warn Log Jiandan Yang (Jira)
• [jira] [Resolved] (HDFS-17804) Recover test for hadoop-hdfs-native-client Shilun Fan (Jira)
• [jira] [Created] (HDFS-17804) Recover test for hadoop-hdfs-native-client Cheng Pan (Jira)
• [jira] [Resolved] (HDFS-17006) Compute correct checksum type when file is empty/ file length is 0 Chayanika Bhandary (Jira)
• [jira] [Created] (HDFS-17803) Compute correct checksum type when file is empty/ file length is 0 Chayanika Bhandary (Jira)
• [jira] [Resolved] (HDFS-17802) New Requirement Chris Nauroth (Jira)
• [jira] [Created] (HDFS-17802) New Requirement Anurag Bisen (Jira)
• [jira] [Created] (HDFS-17801) EC: Reading support retryCurrentNode to avoid transient errors cause application level failures farmmamba (Jira)
• [jira] [Created] (HDFS-17800) Observer node can return partial blocks for erasure coded files Adam Binford (Jira)
• [jira] [Created] (HDFS-17799) datanode report from cache reload thread not close when shutdown zeekling (Jira)
• [jira] [Created] (HDFS-17798) The problem that bad replicas in the mini cluster cannot be automatically replicated kuper (Jira)
• [jira] [Created] (HDFS-17797) Record the counts of different read types in DataNode farmmamba (Jira)
• [jira] [Resolved] (HDFS-17783) [ARR] Optimize the debug log of method asyncIpcClient to print concrete call info farmmamba (Jira)
• [jira] [Created] (HDFS-17796) File write via WebHDFS when required space not available doesn't give appropriate error on failing Atin Arora (Jira)
• Running NameNodes with ZGC Siyao Meng
• [jira] [Reopened] (HDFS-17795) Test Issue Steve Loughran (Jira)
• [jira] [Resolved] (HDFS-17371) Implement vectored io api Jie Han (Jira)
• Hadoop 3.5.0/Java 17 Release Planning Chris Nauroth
• Re Hadoop 3.5.0/Java 17 Release Planning slfan1989
  • [DISCUSS] Future Release and Support Strategy for Hadoop slfan1989
  • Re: [DISCUSS] Future Release and Support Strategy for Hadoop Ayush Saxena
• [jira] [Resolved] (HDFS-17795) Test Issue Anurag Bisen (Jira)
  • [jira] [Resolved] (HDFS-17795) Test Issue Steve Loughran (Jira)
• [jira] [Created] (HDFS-17795) Test Issue Anurag Bisen (Jira)
• [jira] [Resolved] (HDFS-17637) Fix spotbugs in HttpFSFileSystem#getXAttr Masatake Iwasaki (Jira)
• [VOTE] Release Apache Hadoop 3.4.2 Ahmar Suhail
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Mukund Madhav Thakur
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Masatake Iwasaki
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Masatake Iwasaki
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Suhail, Ahmar
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Wei-Chiu Chuang
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Masatake Iwasaki
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Suhail, Ahmar
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Steve Loughran
  • [VOTE] Release Apache Hadoop 3.4.2 Ahmar Suhail
  • Re: [VOTE] Release Apache Hadoop 3.4.2 Xiaoqiao He
• [jira] [Resolved] (HDFS-17788) [ARR] getFileInfo not handle exception rightly which may cause FileNotFoundException in DistributedFileSystem Jian Zhang (Jira)
• [jira] [Created] (HDFS-17794) Document the property dfs.datanode.synconclose Jim Halfpenny (Jira)
• [jira] [Created] (HDFS-17793) RBF: Enable the router asynchronous RPC feature to handle getDelegationToken request errors Xiping Zhang (Jira)
• [jira] [Created] (HDFS-17792) Fix NNThroughputBenchmark execution failure in HA cluster. fuchaohong (Jira)
• [jira] [Resolved] (HDFS-17787) DFSAdmin supports setting the bandwidth for readThrottler. fuchaohong (Jira)
• [jira] [Resolved] (HDFS-17786) DFSAdmin supports setting the bandwidth for writeThrottler. fuchaohong (Jira)
• [jira] [Created] (HDFS-17791) libhdfs client error message for "file not found" includes lengthy, unneeded stack trace Carl Vuosalo (Jira)
• [jira] [Created] (HDFS-17790) Support pattern matching for YARN proxy addresses. SUYEON LEE (Jira)
• [jira] [Created] (HDFS-17788) [ARR] getFileInfo not handle exception rightly which may cause FileNotFoundException in DistributedFileSystem farmmamba (Jira)
• [jira] [Created] (HDFS-17787) DFSAdmin supports setting the bandwidth for readThrottler. fuchaohong (Jira)
• [jira] [Created] (HDFS-17786) DFSAdmin supports setting the bandwidth for writeThrottler. fuchaohong (Jira)
• [jira] [Created] (HDFS-17785) DFSAdmin supports setting the bandwidth for transferThrottler. fuchaohong (Jira)
• [jira] [Created] (HDFS-17784) Port conflict in TestBlockTokenWrappingQOP and TestMultipleNNPortQOP Istvan Toth (Jira)
• [jira] [Created] (HDFS-17783) Optimize the debug log of method asyncIpcClient to print concrete call info farmmamba (Jira)
• [jira] [Created] (HDFS-17782) The implementation of LowRedundancyBlocks can cause unexpected lock contentions, resulting in DN timeout Shangshu Qian (Jira)
• [jira] [Created] (HDFS-17781) WebImageViewer supports ec file's getcontentsummary return correct result. liuguanghua (Jira)
• [jira] [Created] (HDFS-17780) The retry logic in IncrementalBlockReport may bypass the configured IBR interval, causing contention on NameNode Shangshu Qian (Jira)
• [jira] [Created] (HDFS-17779) Container fails to launch with error :/bin/bash: ADD_OPENS: No such file or directory Ashok Kumar (Jira)
• [jira] [Created] (HDFS-17778) java.lang.UnsupportedOperationException: getSubject is not supported Gary D. Gregory (Jira)
• [jira] [Created] (HDFS-17777) Improve ExcessRedundancyMap locking semantics William Montaz (Jira)
• [jira] [Created] (HDFS-17776) // The validRequestors in GetJournalEditServlet do not need to be regenerated every time. fuchaohong (Jira)
• HDFS file creation does not support O_CREATE && O_EXCL in libhdfs Lin, Yiqun
• [jira] [Resolved] (HDFS-12431) Upgrade JUnit from 4 to 5 in hadoop-hdfs hdfs Tsz-wo Sze (Jira)
• Re: [DISCUSS] Optimize the invoke retry of async repsonder when some nameservices are slow Xiaoqiao He
  • [DISCUSS] Optimize the invoke retry of async repsonder when some nameservices are slow Zhanghaobo
  • [DISCUSS] Optimize the invoke retry of async repsonder when some nameservices are slow Zhanghaobo
• [jira] [Created] (HDFS-17775) Support for cluster-specific encryption-in-transit settings in DistCp and CLI Karthik Palanisamy (Jira)
• [jira] [Created] (HDFS-17774) Add authentication switch for WebHDFS. fuchaohong (Jira)
• [jira] [Resolved] (HDFS-17772) The JournaledEditsCache has an int overflow issue, causing the maximum capacity to always be Integer MAX_VALUE Xiaoqiao He (Jira)
• [jira] [Resolved] (HDFS-17773) Replace commons.logging by slf4j in hadoop-hdfs module farmmamba (Jira)
• [jira] [Created] (HDFS-17773) Replace commons.logging by slf4j in hadoop-hdfs module farmmamba (Jira)
• [jira] [Resolved] (HDFS-17768) Observer namenode network delay causing empty block location for getBatchedListing Wei-Chiu Chuang (Jira)
• upgrai Steve Loughran
• [jira] [Resolved] (HDFS-17770) TestRouterRpcSingleNS#testSaveNamespace should leave safemode after finishing Shilun Fan (Jira)
• [jira] [Created] (HDFS-17772) The JournaledEditsCache has an int overflow issue, causing the maximum capacity to always be Integer MAX_VALUE Guo Wei (Jira)
• Upgrading Avro on branch-3.4 to one that doesn't do RCEs Steve Loughran
• [jira] [Created] (HDFS-17771) Refactor some unit tests in rbf to improve the speed of pipeline building farmmamba (Jira)
• [jira] [Created] (HDFS-17770) TestRouterRpcSingleNS#testSaveNamespace should leave safemode after invoking farmmamba (Jira)
• [jira] [Created] (HDFS-17769) Allows client to actively retry to Active NameNode when the Observer NameNode is too far behind client state id. Guo Wei (Jira)
• NN fencing script for kubernetes managed clusters Rushabh Shah
• [jira] [Resolved] (HDFS-17760) Fix MoveToTrash throws ParentNotDirectoryException when there is a file inode with the same name in the trash Xiaoqiao He (Jira)
• [jira] [Resolved] (HDFS-17752) Host2DatanodeMap will not update when re-register a node with a different hostname Xiaoqiao He (Jira)
• [jira] [Created] (HDFS-17768) Observer namenode network delay causing empty block location for getBatchedListing Dimas Shidqi Parikesit (Jira)
• [jira] [Resolved] (HDFS-17718) Upgrade JUnit from 4 to 5 in hadoop-hdfs-client. Shilun Fan (Jira)
• [jira] [Resolved] (HDFS-17720) Upgrade JUnit from 4 to 5 in hadoop-hdfs-rbf. Chris Nauroth (Jira)
• [jira] [Resolved] (HDFS-17713) [ARR] Throtting asynchronous calls for each nameservice farmmamba (Jira)
• [jira] [Created] (HDFS-17765) Provide a mechanism for reordering datanode priority when reading Istvan Toth (Jira)
• [jira] [Created] (HDFS-17766) [ARR] Avoid initializing unused threadPool in RouterAsyncRpcClient farmmamba (Jira)
• [jira] [Resolved] (HDFS-17766) [ARR] Avoid initializing unused threadPool in RouterAsyncRpcClient farmmamba (Jira)
• [jira] [Resolved] (HDFS-17761) [ARR] RouterNetworkTopologyServlet adapts to async router rpc farmmamba (Jira)
• [jira] [Created] (HDFS-17767) Skip tests that depend on custom SecurityManager when Java doesn't support it Istvan Toth (Jira)
• [jira] [Resolved] (HDFS-17762) [ARR] Reset CallerContext information when async handler thread done farmmamba (Jira)
• [jira] [Resolved] (HDFS-15230) Sanity check should not assume key base name can be derived from version name Wei-Chiu Chuang (Jira)
• [jira] [Resolved] (HDFS-16644) java.io.IOException Invalid token in javax.security.sasl.qop Wei-Chiu Chuang (Jira)
• [jira] [Created] (HDFS-17764) Connection#stop is blocking when FileSystem#close yang yang (Jira)
• [jira] [Resolved] (HDFS-17159) Can't decode Identifier HDFS tokens with only the hdfs client jar Wei-Chiu Chuang (Jira)
• [jira] [Created] (HDFS-17763) backport HDFS-16547 to hadoop 3.3 feature to dissallow observer transition if namenode is in safemode Aditya Raj Verma (Jira)
• [ANNOUNCE] Apache Hadoop Thirdparty 1.4.0 release Steve Loughran
• Re: JDK 17 (or beyond) upgrade Chris Nauroth
• [jira] [Created] (HDFS-17762) [ARR] CallerContext information may be wrong due to the async handler executor farmmamba (Jira)
• [jira] [Created] (HDFS-17761) [ARR] RouterNetworkTopologyServlet adapts to async router rpc farmmamba (Jira)
• [jira] [Resolved] (HDFS-17749) [ARR] Fix wrong results due to the wrong usage of asyncComplete(null) Jian Zhang (Jira)
• [jira] [Reopened] (HDFS-17720) Upgrade JUnit from 4 to 5 in hadoop-hdfs-rbf. Chris Nauroth (Jira)
• [jira] [Resolved] (HDFS-17714) MockResolver#removeLocation should also remove src path farmmamba (Jira)
• [jira] [Resolved] (HDFS-17702) [ARR] RouterRpcClient doesn't handle AsyncCallLimitExceededException correctly. farmmamba (Jira)
• [jira] [Resolved] (HDFS-17758) Make method checkAsyncCall not throttle router async rpc request farmmamba (Jira)
• [jira] [Created] (HDFS-17760) Fix MoveToTrash throws ParentNotDirectoryException when there is a file inode with the same name in the trash liuguanghua (Jira)
• [jira] [Created] (HDFS-17759) Explicitly depend on jackson-core in hadoop-hdfs Istvan Toth (Jira)
• [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Wei-Chiu Chuang
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Wei-Chiu Chuang
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Chris Nauroth
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Chris Nauroth
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Ayush Saxena
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Wei-Chiu Chuang
  • [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Chris Nauroth
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Wei-Chiu Chuang
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Ayush Saxena
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Xiaoqiao He
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Steve Loughran
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Xiaoqiao He
  • Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0 Steve Loughran
• [jira] [Created] (HDFS-17758) Make method checkAsyncCall not throttle router async rpc request farmmamba (Jira)
• [jira] [Resolved] (HDFS-17735) [ARR] LocalResolver#getDatanodesSubcluster adapts to async rpc farmmamba (Jira)
• [jira] [Resolved] (HDFS-17740) The Kerberos authentication using ticket.cache.path does not automatically reload a new ticket after the existing ticket expires. Calvin Kirs (Jira)
• [jira] [Created] (HDFS-17757) An error is reported when append to file yang yang (Jira)
• Fw: Data copy from HDFS to MinIO regularly Arif Kamil Yilmaz
  • Re: Fw: Data copy from HDFS to MinIO regularly Steve Loughran
• [jira] [Resolved] (HDFS-17754) Add uriparser2 to notices Steve Loughran (Jira)
• [jira] [Resolved] (HDFS-17746) [ARR] The behavior of throwing exception in getListing should be consistent with sync mode. farmmamba (Jira)
• [jira] [Resolved] (HDFS-17750) [ARR] RouterWebHdfsMethods adapts to async rpc farmmamba (Jira)
• [jira] [Created] (HDFS-17756) Fix endlessLoop issue caused by ReplicaMap#mergeAll method. Zhaobo Huang (Jira)
• Re: Can not run HDFS balancer cause metrics already exists Zhanghaobo
  • Re: Can not run HDFS balancer cause metrics already exists Zhanghaobo
  • Re: Can not run HDFS balancer cause metrics already exists Zhanghaobo
• [jira] [Created] (HDFS-17755) Enhance refreshVolumes usability and code structure. Zhaobo Huang (Jira)
• [jira] [Created] (HDFS-17754) Add uriparser2 to notices Chris Nauroth (Jira)
• [jira] [Resolved] (HDFS-17744) [ARR] getEnclosingRoot RPC adapts to async rpc Xiaoqiao He (Jira)
• [jira] [Resolved] (HDFS-17753) Fix occasional failure of TestRouterHttpServerXFrame Shilun Fan (Jira)
• [jira] [Created] (HDFS-17753) Fix occasional failure of TestRouterHttpServerXFrame farmmamba (Jira)
• [jira] [Created] (HDFS-17752) Host2DatanodeMap will not update when re-register a node with a different hostname WenjingLiu (Jira)
• [jira] [Created] (HDFS-17751) [ARR] Add unit tests using asynchronous router rpc for all in org.apache.hadoop.hdfs.server.federation.router farmmamba (Jira)
• Fwd: Community Over Code Asia Travel Assistance Applications now open! Ayush Saxena
• [jira] [Resolved] (HDFS-17748) Fix javadoc problems caused by HDFS-17496 Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17750) [ARR] RouterWebHdfsMethods adapts to async rpc farmmamba (Jira)
• [jira] [Created] (HDFS-17749) [ARR] Fix wrong results due to the wrong usage of asyncComplete(null) farmmamba (Jira)
• [jira] [Created] (HDFS-17748) Fix javadoc problems caused by HDFS-17496 farmmamba (Jira)
• [jira] [Created] (HDFS-17747) Clock should not be used for measuring time duration Tsz-wo Sze (Jira)
• [jira] [Created] (HDFS-17746) [ARR] the behavior of throwing exception in getListing should be consistent with sync mode. farmmamba (Jira)
• [jira] [Resolved] (HDFS-17733) [ARR] Optimize isMultiDestDirectory method using AsyncUtil class farmmamba (Jira)
• [jira] [Resolved] (HDFS-17731) [ARR] Add unit test for async RouterAdminServer Xiaoqiao He (Jira)
• [jira] [Resolved] (HDFS-17745) TestRouterMountTable should reset defaultNSEnable to true after each test method. Xiaoqiao He (Jira)
• [jira] [Created] (HDFS-17745) TestRouterMountTable should reset defaultNSEnable to true after each test method. farmmamba (Jira)
• [jira] [Created] (HDFS-17744) [ARR] getEnclosingRoot RPC adapts to async rpc farmmamba (Jira)
• [jira] [Created] (HDFS-17743) Support random datanode ordering in getBlockLocations() Wei Song (Jira)
• [jira] [Created] (HDFS-17742) When NodeLabel is enabled for a YARN cluster, AM blacklist program does not work properly when label=no_label zeekling (Jira)
• [jira] [Resolved] (HDFS-17742) When NodeLabel is enabled for a YARN cluster, AM blacklist program does not work properly when label=no_label zeekling (Jira)
• [DISCUSS] Hadoop 3.4.2 release Ahmar Suhail
  • Re: [DISCUSS] Hadoop 3.4.2 release Chris Nauroth
  • Re: [DISCUSS] Hadoop 3.4.2 release Xiaoqiao He
  • Re: [DISCUSS] Hadoop 3.4.2 release Anuj Modi
  • Re: [DISCUSS] Hadoop 3.4.2 release Bhavik Patel
  • Re: [DISCUSS] Hadoop 3.4.2 release slfan1989
  • Re: [DISCUSS] Hadoop 3.4.2 release larry mccay
  • Re: [DISCUSS] Hadoop 3.4.2 release Chao Sun
  • Re: [DISCUSS] Hadoop 3.4.2 release Ayush Saxena
• [jira] [Resolved] (HDFS-17741) The old blocks should be added into MarkedDeleteQueue when create a file with overwrite liuguanghua (Jira)
• [jira] [Created] (HDFS-17741) The old blocks should be added into MarkedDeleteQueue when create a file with overwrite liuguanghua (Jira)
• [jira] [Created] (HDFS-17740) The Kerberos authentication using ticket.cache.path does not automatically reload a new ticket after the existing ticket expires. Calvin Kirs (Jira)
• [jira] [Created] (HDFS-17739) When zk switch acl.compare.shortName enabled the router start failed zeekling (Jira)
• [jira] [Resolved] (HDFS-17725) DataNodeVolumeMetrics and BalancerMetrics class add MetricTag. Shilun Fan (Jira)
• [jira] [Created] (HDFS-17738) When hedged read is enabled, input metric may be incorrect. Zhou Tong (Jira)
• [jira] [Resolved] (HDFS-17729) Inconsistent mtime in the results of -stat and -ls command due to different TimeZone Shilun Fan (Jira)
• [jira] [Created] (HDFS-17737) Implement Backoff Retry for ErasureCoding reads Danny Becker (Jira)
• [jira] [Created] (HDFS-17736) The WebHdfsHandler on the Datanode cannot properly handle paths containing Chinese characters. Xiping Zhang (Jira)
• [jira] [Created] (HDFS-17735) [ARR] LocalResolver#getDatanodesSubcluster adapts to async rpc farmmamba (Jira)
• [jira] [Created] (HDFS-17734) work cannot start John Doe (Jira)
• [jira] [Created] (HDFS-17733) [ARR] Optimize isMultiDestDirectory method using AsyncUtil class farmmamba (Jira)
• [jira] [Created] (HDFS-17732) addExpectedReplicasToPending should add EC block expectedStorages in PendingReconstructionBlocks liuguanghua (Jira)
• [jira] [Created] (HDFS-17731) [ARR] Add unit test for async RouterAdminServer farmmamba (Jira)
• [jira] [Reopened] (HDFS-17730) JVM GC Metrics supports Generational ZGC pause time chaijunjie (Jira)
• [jira] [Resolved] (HDFS-17730) JVM GC Metrics supports Generational ZGC pause time chaijunjie (Jira)
  • [jira] [Resolved] (HDFS-17730) JVM GC Metrics supports Generational ZGC pause time chaijunjie (Jira)
• [jira] [Created] (HDFS-17730) JVM GC Metrics supports Generational ZGC pause time and count chaijunjie (Jira)
• [jira] [Created] (HDFS-17729) Inconsistent mtime in the results of -stat and -ls command due to different TimeZone farmmamba (Jira)
• [jira] [Created] (HDFS-17728) TestDFSIO can use another name service except the default one Hui Fei (Jira)
• [jira] [Created] (HDFS-17727) Attempt to get connection after closing John Doe (Jira)
• [jira] [Created] (HDFS-17726) UnsupportedOperationException raised by race condition John Doe (Jira)
• [VOTE] Request to merge branch HDFS-17531 into trunk. jian zhang
  • Re: [VOTE] Request to merge branch HDFS-17531 into trunk. Hui Fei
  • Re: [VOTE] Request to merge branch HDFS-17531 into trunk. Ayush Saxena
  • Re: [VOTE] Request to merge branch HDFS-17531 into trunk. Xiaoqiao He
  • Re: [VOTE] Request to merge branch HDFS-17531 into trunk. Zhanghaobo

• Earlier messages