Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

[Apache Jenkins Server]

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/

No changes




-1 overall


The following subsystems voted -1:
hadolint mvnsite pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.fs.TestFileUtil 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   hadoop.hdfs.server.namenode.ha.TestHAAppend 
   hadoop.hdfs.TestMultipleNNPortQOP 
   
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat 
   hadoop.hdfs.server.federation.router.TestRouterQuota 
   hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver 
   hadoop.hdfs.server.federation.resolver.order.TestLocalResolver 
   hadoop.yarn.server.resourcemanager.TestClientRMService 
   
hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker
 
   hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter 
   hadoop.mapreduce.lib.input.TestLineRecordReader 
   hadoop.mapred.TestLineRecordReader 
   hadoop.mapreduce.v2.TestSpeculativeExecution 
   hadoop.mapreduce.v2.TestMRJobs 
   hadoop.mapred.TestJobCleanup 
   hadoop.mapreduce.v2.TestRMNMInfo 
   hadoop.mapreduce.v2.TestUberAM 
   hadoop.mapred.TestJobName 
   hadoop.mapreduce.v2.TestMRJobsWithHistoryService 
  

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/diff-compile-javac-root.txt
  [472K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/diff-checkstyle-root.txt
  [14M]

   hadolint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   mvnsite:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-mvnsite-root.txt
  [560K]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/diff-patch-pylint.txt
  [20K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/diff-patch-shellcheck.txt
  [72K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/whitespace-eol.txt
  [12M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-javadoc-root.txt
  [40K]

   unit:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [216K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [432K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt
  [12K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
  [36K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
  [20K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [112K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
  [104K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [136K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/646/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-m

Re: [DISCUSS] Hadoop on Windows

[Gautham Banasandra]

Hi Wei-Chiu,

I assume the milestone is still in a dev branch?

No, I've been merging them directly into the trunk branch. You may take a
look at my commits[1] if you would like to go over the list of PRs.

Is there a target version for this support?

If you're referring to the milestone that we just finished, all of them
have been merged to trunk. So, the next release which is cut from the trunk
branch will have this support. However, we still have some way to go before
the whole of Hadoop starts to build on Windows. I'm thinking it would still
take another 4-6 months if there are no obstacles.

[1]=https://github.com/apache/hadoop/commits?author=GauthamBanasandra

Thanks,
--Gautham

On Thu, 28 Apr 2022 at 23:57, Wei-Chiu Chuang  wrote:

> Great!
>
> Sorry I missed the earlier discussion thread. Is there a target version for
> this support? I assume the milestone is still in a dev branch?
>
> On Thu, Apr 28, 2022 at 8:26 AM Gautham Banasandra 
> wrote:
>
> > Hi Hadoop devs,
> >
> > I would like to announce that we recently reached a new milestone - we
> > recently finished all the tasks in item 3 under Phase 1. This implies
> that
> > all the HDFS native client tools[1] have become cross platform now. We're
> > inching closer towards making Hadoop cross platform. Watch this space for
> > more updates.
> >
> > [1] =
> >
> >
> https://github.com/apache/hadoop/tree/trunk/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/tools
> >
> > Thanks,
> > --Gautham
> >
> > On Mon, 21 Feb 2022 at 00:12, Gautham Banasandra 
> > wrote:
> >
> > > Hi all,
> > >
> > > I've been working on getting Hadoop to build on Windows for quite some
> > > time now. We're now at a stage where we can parallelize the effort and
> > > complete this sooner. I've outlined the parts that are remaining.
> Please
> > > get in touch with me if anyone wishes to join hands in realizing this
> > goal.
> > >
> > > *Why do we need Hadoop to run on Windows?*
> > > Windows has a very large user base. The modern alternative softwares to
> > > Hadoop (like Kubernetes) are cross platform by design. We have to
> > > acknowledge the fact it isn't easy to get Hadoop running on Windows.
> The
> > > reason why we haven't seen much adoption of Hadoop on Windows is
> probably
> > > because of issues like compilation, requiring work-arounds every step
> of
> > > the way etc. If we were to nail these issues, I believe it would
> > > tremendously expand the usage of Hadoop.
> > >
> > > I plan to complete this in 4 phases.
> > >
> > > *Phase 1 : Building Hadoop on Windows*
> > > 1. [HADOOP-17193] Compile Hadoop on Windows natively - ASF JIRA
> > > (apache.org) 
> > > The Hadoop build on Windows is currently broken because of the POSIX
> API
> > > calls made in the HDFS native client (libhdfspp). MinGW and Cygwin
> > > provide POSIX implementation on Windows. While it's possible to use
> these
> > > C++ compilers, it won't be the same as compiling Hadoop with Visual
> C++.
> > > The Visual C++ runtime is the native C++ runtime on Windows and
> provides
> > > much more capabilities (like core dumps etc.) than its alternatives.
> > Thus,
> > > it's essential to get Hadoop to compile with Visual Studio on Windows.
> > > We'll be using Visual Studio 2019.
> > >
> > > 2. [HDFS-15843] [libhdfs++] Make write cross platform - ASF JIRA
> > > (apache.org) 
> > > Until recently, Hadoop was being built with C++11. I upgraded the
> > compiler
> > > version to a level where it supports C++17 so that we've access to
> > > std::filesystem and a few other modern C++ APIs. However, there are
> some
> > > cases where the C++17 APIs don't suffice. Thus, I wrote the XPlatform
> > > library
> > > <
> >
> https://github.com/apache/hadoop/tree/trunk/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform
> > >,
> > > which is a collection of system call APIs implemented in a
> cross-platform
> > > friendly manner. The CMake build system will choose the appropriate
> > > platform implementation while building so that we can do away with all
> > the
> > > #ifdefs based on platform in the code. In summary, if you ever come
> > across
> > > a need to use system calls, please put them into the XPlatform library
> > and
> > > use its APIs.
> > >
> > > 3. [HDFS-16474] Make HDFS tail tool cross platform - ASF JIRA (
> > apache.org)
> > > 
> > > [HDFS-16473] Make HDFS stat tool cross platform - ASF JIRA
> > > (apache.org) 
> > > [HDFS-16472] Make HDFS setrep tool cross platform - ASF JIRA
> > > (apache.org) 
> > > [HDFS-16471] Make HDFS ls tool cross platform - ASF JIRA (
> apache.org
> > )
> > > 
> > > [HDFS-16470] Make HDFS find tool

Re: [DISCUSS] Hadoop on Windows

[Gautham Banasandra]

Hi Steve,

Yes, there won't be a need for winutils.exe once we provide a JNI
implementation under a common file system interface.

Thanks,
--Gautham

On Fri, 29 Apr 2022 at 00:54, Steve Loughran  wrote:

>
>
> On Sun, 20 Feb 2022 at 18:42, Gautham Banasandra 
> wrote:
>
>> Hi all,
>>
>> I've been working on getting Hadoop to build on Windows for quite some
>> time
>> now. We're now at a stage where we can parallelize the effort and complete
>> this sooner. I've outlined the parts that are remaining. Please get in
>> touch with me if anyone wishes to join hands in realizing this goal.
>>
>> *Why do we need Hadoop to run on Windows?*
>> Windows has a very large user base. The modern alternative softwares to
>> Hadoop (like Kubernetes) are cross platform by design. We have to
>> acknowledge the fact it isn't easy to get Hadoop running on Windows. The
>> reason why we haven't seen much adoption of Hadoop on Windows is probably
>> because of issues like compilation, requiring work-arounds every step of
>> the way etc. If we were to nail these issues, I believe it would
>> tremendously expand the usage of Hadoop.
>>
>>
>> *Phase 3 : Resolving systemic issues*
>> 1. [HADOOP-13223] winutils.exe is a bug nexus and should be killed with an
>> axe. - ASF JIRA (apache.org)
>> 
>> The Hadoop environment is modeled closer to that of Linux than Windows.
>> Thus, we see a lot of functional gaps between running Hadoop on Linux v/s
>> Windows, which have become the source of bugs when it comes to running
>> Hadoop on Windows. One such issue is that of winutils.exe. We can aim to
>> address issues like these in this phase. I plan to provide JNI
>> implementation for each platform and unify these under a common file
>> system
>> interface. So that we get stack traces for exceptions thrown in these
>> layers and mostly so that we don't have any disparity between the
>> platforms.
>>
>>
> i for one endorse this jira.
>
> given a lot of it is for fs permissions, maybe whatever you do can
> downgrade, so that running spark local on a windows laptop becomes easy.
> those people do not need the posix permissions model
>
>

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

[Apache Jenkins Server]

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/

[Apr 28, 2022 5:18:19 AM] (noreply) HADOOP-15983. Use jersey-json that is built 
to use jackson2 (#3988)
[Apr 28, 2022 5:24:37 PM] (noreply) HDFS-16540 Data locality is lost when 
DataNode pod restarts in kubernetes (#4170)
[Apr 28, 2022 5:26:46 PM] (Michael Stack) Revert "HDFS-16540 Data locality is 
lost when DataNode pod restarts in kubernetes (#4170)"
[Apr 28, 2022 5:28:01 PM] (Michael Stack) HDFS-16540. Data locality is lost 
when DataNode pod restarts in kubernetes (#4170)




-1 overall


The following subsystems voted -1:
blanks pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

Failed junit tests :

   hadoop.crypto.key.kms.server.TestKMSWithZK 
   hadoop.crypto.key.kms.server.TestKMS 
   
hadoop.yarn.server.timeline.security.TestTimelineAuthenticationFilterForV1 
   hadoop.yarn.server.timeline.webapp.TestTimelineWebServicesWithSSL 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   
hadoop.yarn.server.resourcemanager.metrics.TestCombinedSystemMetricsPublisher 
   
hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesDelegationTokenAuthentication
 
   hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher 
   hadoop.yarn.server.resourcemanager.webapp.TestRMWebappAuthentication 
   hadoop.yarn.webapp.TestRMWithXFSFilter 
   hadoop.yarn.server.resourcemanager.TestRMHA 
   hadoop.yarn.server.resourcemanager.TestClientRMService 
   hadoop.yarn.client.TestResourceManagerAdministrationProtocolPBClientImpl 
   hadoop.yarn.client.TestGetGroups 
   hadoop.mapred.TestLocalDistributedCacheManager 
   hadoop.hdfs.server.federation.security.TestRouterSecurityManager 
   hadoop.yarn.server.router.webapp.TestRouterWebServicesREST 
   hadoop.yarn.sls.nodemanager.TestNMSimulator 
   hadoop.yarn.sls.TestSLSRunner 
   hadoop.yarn.sls.TestSLSGenericSynth 
   hadoop.yarn.sls.TestSLSDagAMSimulator 
   hadoop.yarn.sls.TestSLSStreamAMSynth 
   hadoop.yarn.sls.appmaster.TestAMSimulator 
   hadoop.yarn.sls.TestReservationSystemInvariants 
  

   cc:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/results-compile-cc-root.txt
 [96K]

   javac:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/results-compile-javac-root.txt
 [340K]

   blanks:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/blanks-eol.txt
 [13M]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/blanks-tabs.txt
 [2.0M]

   checkstyle:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/results-checkstyle-root.txt
 [14M]

   pathlen:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/results-pathlen.txt
 [16K]

   pylint:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/results-pylint.txt
 [20K]

   shellcheck:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/results-shellcheck.txt
 [28K]

   xml:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/xml.txt
 [24K]

   javadoc:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/results-javadoc-javadoc-root.txt
 [400K]

   unit:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/patch-unit-hadoop-common-project_hadoop-kms.txt
 [428K]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/854/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-se

[jira] [Resolved] (HADOOP-18104) Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

[Mukund Thakur (Jira)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mukund Thakur resolved HADOOP-18104.

Resolution: Fixed

> Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads
> 
>
> Key: HADOOP-18104
> URL: https://issues.apache.org/jira/browse/HADOOP-18104
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: common, fs
>Reporter: Mukund Thakur
>Assignee: Mukund Thakur
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 3h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.7#820007)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

[Apache Jenkins Server]

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/295/

[Apr 27, 2022 6:42:30 AM] (noreply) HDFS-16539. RBF: Support 
refreshing/changing router fairness policy controller without rebooting router 
(#4168)
[Apr 28, 2022 5:18:19 AM] (noreply) HADOOP-15983. Use jersey-json that is built 
to use jackson2 (#3988)
[Apr 28, 2022 5:24:37 PM] (noreply) HDFS-16540 Data locality is lost when 
DataNode pod restarts in kubernetes (#4170)
[Apr 28, 2022 5:26:46 PM] (Michael Stack) Revert "HDFS-16540 Data locality is 
lost when DataNode pod restarts in kubernetes (#4170)"
[Apr 28, 2022 5:28:01 PM] (Michael Stack) HDFS-16540. Data locality is lost 
when DataNode pod restarts in kubernetes (#4170)




-1 overall


The following subsystems voted -1:
blanks pathlen shadedclient spotbugs unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

spotbugs :

   module:hadoop-hdfs-project/hadoop-hdfs 
   Redundant nullcheck of oldLock, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.DataStorage.isPreUpgradableLayout(Storage$StorageDirectory)
 Redundant null check at DataStorage.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.DataStorage.isPreUpgradableLayout(Storage$StorageDirectory)
 Redundant null check at DataStorage.java:[line 695] 
   Redundant nullcheck of metaChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MappableBlockLoader.verifyChecksum(long,
 FileInputStream, FileChannel, String) Redundant null check at 
MappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MappableBlockLoader.verifyChecksum(long,
 FileInputStream, FileChannel, String) Redundant null check at 
MappableBlockLoader.java:[line 138] 
   Redundant nullcheck of blockChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MemoryMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at MemoryMappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MemoryMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at MemoryMappableBlockLoader.java:[line 75] 
   Redundant nullcheck of blockChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at NativePmemMappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.load(long,
 FileInputStream, FileInputStream, String, ExtendedBlockId) Redundant null 
check at NativePmemMappableBlockLoader.java:[line 85] 
   Redundant nullcheck of metaChannel, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.verifyChecksumAndMapBlock(NativeIO$POSIX$PmemMappedRegion,
 long, FileInputStream, FileChannel, String) Redundant null check at 
NativePmemMappableBlockLoader.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader.verifyChecksumAndMapBlock(NativeIO$POSIX$PmemMappedRegion,
 long, FileInputStream, FileChannel, String) Redundant null check at 
NativePmemMappableBlockLoader.java:[line 130] 
   
org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager$UserCounts
 doesn't override java.util.ArrayList.equals(Object) At 
RollingWindowManager.java:At RollingWindowManager.java:[line 1] 

spotbugs :

   module:hadoop-yarn-project/hadoop-yarn 
   Redundant nullcheck of it, which is known to be non-null in 
org.apache.hadoop.yarn.