Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2017-11-23 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/48/

[Nov 21, 2017 7:08:27 PM] (haibochen) YARN-7390. All reservation related test 
cases failed when TestYarnClient




-1 overall


The following subsystems voted -1:
asflicense unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Unreaped Processes :

   hadoop-hdfs:20 
   bkjournal:5 
   hadoop-hdfs-nfs:1 
   hadoop-yarn-server-timelineservice:1 
   hadoop-yarn-client:5 
   hadoop-yarn-applications-distributedshell:1 
   hadoop-mapreduce-client-jobclient:10 
   hadoop-distcp:3 

Failed junit tests :

   
hadoop.yarn.applications.distributedshell.TestDistributedShellWithNodeLabels 
   hadoop.tools.TestIntegration 
   hadoop.tools.TestDistCpViewFs 
   hadoop.resourceestimator.solver.impl.TestLpSolver 
   hadoop.resourceestimator.service.TestResourceEstimatorService 

Timed out junit tests :

   org.apache.hadoop.hdfs.TestLeaseRecovery2 
   org.apache.hadoop.hdfs.TestRead 
   org.apache.hadoop.hdfs.web.TestWebHdfsTokens 
   org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream 
   org.apache.hadoop.hdfs.TestDatanodeLayoutUpgrade 
   org.apache.hadoop.hdfs.TestFileAppendRestart 
   org.apache.hadoop.hdfs.security.TestDelegationToken 
   org.apache.hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter 
   org.apache.hadoop.hdfs.TestDFSMkdirs 
   org.apache.hadoop.hdfs.TestDFSOutputStream 
   org.apache.hadoop.security.TestRefreshUserMappings 
   org.apache.hadoop.hdfs.web.TestWebHDFS 
   org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs 
   org.apache.hadoop.hdfs.web.TestWebHDFSXAttr 
   org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes 
   org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs 
   org.apache.hadoop.hdfs.TestDistributedFileSystem 
   org.apache.hadoop.hdfs.web.TestWebHDFSForHA 
   org.apache.hadoop.hdfs.TestReplaceDatanodeFailureReplication 
   org.apache.hadoop.hdfs.TestDFSShell 
   org.apache.hadoop.contrib.bkjournal.TestBootstrapStandbyWithBKJM 
   org.apache.hadoop.contrib.bkjournal.TestBookKeeperJournalManager 
   org.apache.hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   org.apache.hadoop.contrib.bkjournal.TestBookKeeperAsHASharedDir 
   org.apache.hadoop.contrib.bkjournal.TestBookKeeperSpeculativeRead 
   org.apache.hadoop.hdfs.nfs.nfs3.TestWrites 
   
org.apache.hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServices
 
   org.apache.hadoop.yarn.client.TestRMFailover 
   org.apache.hadoop.yarn.client.TestApplicationMasterServiceProtocolOnHA 
   org.apache.hadoop.yarn.client.TestApplicationClientProtocolOnHA 
   org.apache.hadoop.yarn.client.api.impl.TestYarnClientWithReservation 
   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient 
   
org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell 
   org.apache.hadoop.mapreduce.TestMRJobClient 
   org.apache.hadoop.mapreduce.v2.TestUberAM 
   org.apache.hadoop.mapreduce.v2.TestSpeculativeExecution 
   org.apache.hadoop.mapred.TestMRTimelineEventHandling 
   org.apache.hadoop.mapreduce.v2.TestMRAppWithCombiner 
   org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler 
   org.apache.hadoop.mapreduce.lib.output.TestJobOutputCommitter 
   org.apache.hadoop.mapreduce.TestMapReduceLazyOutput 
   org.apache.hadoop.mapreduce.v2.TestRMNMInfo 
   org.apache.hadoop.mapreduce.v2.TestMRJobsWithHistoryService 
   org.apache.hadoop.mapreduce.v2.TestMiniMRProxyUser 
   org.apache.hadoop.tools.TestDistCpSync 
   org.apache.hadoop.tools.TestDistCpSyncReverseFromTarget 
   org.apache.hadoop.tools.TestDistCpSyncReverseFromSource 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/48/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/48/artifact/out/diff-compile-javac-root.txt
  [324K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/48/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/48/artifact/out/diff-patch-pylint.txt
  [20K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/48/artifact/out/diff-patch-shellcheck.txt
  [72K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/48/artifact/out/diff-patch-shelldocs.txt
  [8.0K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-branc

[jira] [Created] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15069:
---

 Summary: support git-secrets commit hook to keep AWS secrets out 
of git
 Key: HADOOP-15069
 URL: https://issues.apache.org/jira/browse/HADOOP-15069
 Project: Hadoop Common
  Issue Type: Improvement
  Components: build
Affects Versions: 3.0.0
Reporter: Steve Loughran
Assignee: Steve Loughran
Priority: Minor


The latest Uber breach looks like it involved AWS keys in git repos.

Nobody wants that, which is why amazon provide 
[git-secrets|https://github.com/awslabs/git-secrets]; a script you can use to 
scan a repo and its history, *and* add as an automated check.

Anyone can set this up, but there are a few false positives in the scan, mostly 
from longs and a few all-upper-case constants. These can all be added to a 
.gitignore file.

Also: mention git-secrets in the aws testing docs; say "use it"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org