Looking for reviewer for HDFS-17181 (small one)

Hello everyone, would anyone volunteer to look at a PR of ours for HDFS-17181. - https://github.com/apache/hadoop/pull/6108 - https://issues.apache.org/jira/browse/HDFS-17181 Summary: WebHDFS will forward requests to DataNodes that are in maintenance - The fix has been running in production for

[jira] [Created] (HDFS-17181) WebHDFS not considering whether a DN is good when called from outside the cluster

Lars Francke created HDFS-17181: --- Summary: WebHDFS not considering whether a DN is good when called from outside the cluster Key: HDFS-17181 URL: https://issues.apache.org/jira/browse/HDFS-17181

Re: HDFS-16577 - Request for input - Let administrator override connection details when registering datanodes

es: > > > https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html > > Have you seen this? Does anything look helpful there? > > Chris Nauroth > > > On Fri, Jun 24, 2022 at 4:55 AM Lars Francke > wrote: > >> Hi everyone, >&g

HDFS-16577 - Request for input - Let administrator override connection details when registering datanodes

Hi everyone, we're trying to get HDFS running in Kubernetes using Kerberos. This has some challenges as you might expect. We have created an issue for that including a spike: https://issues.apache.org/jira/browse/HDFS-16577 Currently (as of 3.2.2, but reading through the release notes this doesn'

Re: Block capacity

case, it is not really a limit. > > Kihwal > > On Tue, Jun 25, 2019 at 2:17 AM Lars Francke > wrote: > >> Hi, >> >> I stumbled upon the "Block capacity" metric in HDFS and understand that >> it's the capacity of the internal block map and

Block capacity

Hi, I stumbled upon the "Block capacity" metric in HDFS and understand that it's the capacity of the internal block map and that it's somehow tied to the heap size (2%). I've looked at the code for LightWeightGSet (admittedly only briefly) and it says that it's using an array + linked lists for c

Re: [DISCUSS] A unified and open Hadoop community sync up schedule?

Just another thing you might be interested in: The Comdev project recently voted on creating an iot@apache (exact name and details still unclear) mailing list for cross-project collaboration. It's been on my list of things to do to propose the same for "bigdata" (I know the name sucks but i don't

Re: Running HDFS from source broken since HDFS-11596

doop-sanity-tests/config/insecure/ >3. test_env hdfs dfs -ls /tmp > > Thanks, > > On Wed, Jul 19, 2017 at 11:49 PM, Lars Francke > wrote: > >> I've already asked in <https://issues.apache.org/jira/browse/HDFS-11596> >> but haven't gotten

Running HDFS from source broken since HDFS-11596

I've already asked in but haven't gotten a reply so far so I thought I'd bump it here. The issue replaces the compile time dependency of the various HDFS projects to hdfs-client with a "provided" dependency. Unfortunately that means that HDFS can

Re: ASF OS X Build Infrastructure

> > Regarding lack of personal access to anything but Linux, I'll take this as > an opportunity to remind everyone that ASF committers (not just limited to > Hadoop committers) are entitled to a free MSDN license, which can get you > a Windows VM for validating Windows issues and any patches that t

[jira] [Created] (HDFS-9651) All web UIs should include a robots.txt file

Lars Francke created HDFS-9651: -- Summary: All web UIs should include a robots.txt file Key: HDFS-9651 URL: https://issues.apache.org/jira/browse/HDFS-9651 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-8279) Document how to specify storage types

Lars Francke created HDFS-8279: -- Summary: Document how to specify storage types Key: HDFS-8279 URL: https://issues.apache.org/jira/browse/HDFS-8279 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-7575) NameNode not handling heartbeats properly after HDFS-2832

Lars Francke created HDFS-7575: -- Summary: NameNode not handling heartbeats properly after HDFS-2832 Key: HDFS-7575 URL: https://issues.apache.org/jira/browse/HDFS-7575 Project: Hadoop HDFS