It would have been nice if MSDN had a windows image that I could spin up on my favorite Linux distro :-) But I haven't been able to find it yet :(
On Thu, Aug 3, 2017 at 3:23 AM, Steve Loughran <ste...@hortonworks.com> wrote: > wow, a lot of failures. > > some appear to be test timeouts, some native library availability ( > https://builds.apache.org/job/hadoop-trunk-win/146/ > testReport/junit/org.apache.hadoop.util/TestNativeCodeLoader/ > testNativeCodeLoaded/), but I think many (most?) are due to them getting > paths wrong once there's a drive prefix there, e.g. > https://builds.apache.org/job/hadoop-trunk-win/146/ > testReport/junit/org.apache.hadoop.fs/TestFsShellList/testList/ > > including those which think that file:// + file.getAbsolutePath is a valid > URI > > https://builds.apache.org/job/hadoop-trunk-win/146/ > testReport/junit/org.apache.hadoop.conf/TestConfiguration/ > > I think the way to deal with this is going to be some form of bug bash. > Who out there wants to spend a day doing windows builds? It's not *too* > bad...setting up the VM is the hard part. > > > On 3 Aug 2017, at 05:45, Allen Wittenauer <a...@effectivemachines.com< > mailto:a...@effectivemachines.com>> wrote: > > For more details, see https://builds.apache.org/job/hadoop-trunk-win/146/ > > [Aug 2, 2017 4:25:19 PM] (yufei) YARN-6895. [FairScheduler] Preemption > reservation may cause regular > > > > > -1 overall > > > The following subsystems voted -1: > unit > > > The following subsystems are considered long running: > (runtime bigger than 1h 00m 00s) > unit > > > Specific tests: > > Failed CTEST tests : > > test_test_libhdfs_threaded_hdfs_static > > Failed junit tests : > > hadoop.conf.TestConfiguration > hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec > hadoop.fs.contract.rawlocal.TestRawlocalContractAppend > hadoop.fs.TestFsShellCopy > hadoop.fs.TestFsShellList > hadoop.fs.TestLocalFileSystem > hadoop.io.nativeio.TestNativeIO > hadoop.io.TestSequenceFileAppend > hadoop.ipc.TestIPC > hadoop.ipc.TestSocketFactory > hadoop.metrics2.impl.TestStatsDMetrics > hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal > hadoop.security.TestShellBasedUnixGroupsMapping > hadoop.security.token.TestDtUtilShell > hadoop.util.TestNativeCodeLoader > hadoop.fs.TestWebHdfsFileContextMainOperations > hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy > hadoop.hdfs.qjournal.client.TestQuorumJournalManager > hadoop.hdfs.security.TestDelegationTokenForProxyUser > hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean > hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages > hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl > hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles > hadoop.hdfs.server.datanode.fsdataset.impl. > TestLazyPersistLockedMemory > hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy > hadoop.hdfs.server.datanode.fsdataset.impl. > TestLazyPersistReplicaPlacement > hadoop.hdfs.server.datanode.fsdataset.impl. > TestLazyPersistReplicaRecovery > hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter > hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica > hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage > hadoop.hdfs.server.datanode.TestBlockScanner > hadoop.hdfs.server.datanode.TestDataNodeFaultInjector > hadoop.hdfs.server.datanode.TestDataNodeUUID > hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure > hadoop.hdfs.server.datanode.TestDirectoryScanner > hadoop.hdfs.server.datanode.TestHSync > hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame > hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand > hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC > hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA > hadoop.hdfs.server.namenode.ha.TestHAAppend > hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints > hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics > hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength > hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands > hadoop.hdfs.server.namenode.TestEditLogRace > hadoop.hdfs.server.namenode.TestFileTruncate > hadoop.hdfs.server.namenode.TestFsck > hadoop.hdfs.server.namenode.TestNameNodeMXBean > hadoop.hdfs.server.namenode.TestNestedEncryptionZones > hadoop.hdfs.server.namenode.TestQuotaByStorageType > hadoop.hdfs.server.namenode.TestStartup > hadoop.hdfs.TestBlockStoragePolicy > hadoop.hdfs.TestDatanodeRegistration > hadoop.hdfs.TestDFSOutputStream > hadoop.hdfs.TestDFSShell > hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy > hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030 > hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050 > hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080 > hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100 > hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140 > hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 > hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy > hadoop.hdfs.TestFetchImage > hadoop.hdfs.TestFileAppend > hadoop.hdfs.TestFileCreation > hadoop.hdfs.TestHDFSFileSystemContract > hadoop.hdfs.TestHDFSServerPorts > hadoop.hdfs.TestHDFSTrash > hadoop.hdfs.TestLocalDFS > hadoop.hdfs.TestMiniDFSCluster > hadoop.hdfs.TestQuota > hadoop.hdfs.TestReadStripedFileWithMissingBlocks > hadoop.hdfs.TestReconstructStripedFile > hadoop.hdfs.TestSecureEncryptionZoneWithKMS > hadoop.hdfs.TestTrashWithSecureEncryptionZones > hadoop.hdfs.tools.TestDebugAdmin > hadoop.hdfs.tools.TestDFSAdmin > hadoop.hdfs.web.TestWebHdfsFileSystemContract > hadoop.fs.http.server.TestHttpFSServerWebServer > hadoop.yarn.logaggregation.TestAggregatedLogFormat > hadoop.yarn.server.nodemanager.containermanager. > launcher.TestContainerLaunch > hadoop.yarn.server.nodemanager.containermanager.linux.privileged. > TestPrivilegedOperationExecutor > hadoop.yarn.server.nodemanager.containermanager.linux.resources. > TestCGroupsHandlerImpl > hadoop.yarn.server.nodemanager.containermanager.linux.runtime. > TestDockerContainerRuntime > hadoop.yarn.server.nodemanager.containermanager.linux.runtime. > TestJavaSandboxLinuxContainerRuntime > hadoop.yarn.server.nodemanager.containermanager.logaggregation. > TestAppLogAggregatorImpl > hadoop.yarn.server.nodemanager.containermanager.logaggregation. > TestLogAggregationService > hadoop.yarn.server.nodemanager.containermanager. > monitor.TestContainersMonitor > hadoop.yarn.server.nodemanager.containermanager.TestContainerManager > hadoop.yarn.server.nodemanager.containermanager. > TestContainerManagerRecovery > hadoop.yarn.server.nodemanager.nodelabels. > TestScriptBasedNodeLabelsProvider > hadoop.yarn.server.nodemanager.recovery. > TestNMLeveldbStateStoreService > hadoop.yarn.server.nodemanager.TestContainerExecutor > hadoop.yarn.server.nodemanager.TestLocalDirsHandlerService > hadoop.yarn.server.nodemanager.TestNodeManagerResync > hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore > hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore > hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore > hadoop.yarn.server.resourcemanager.TestResourceTrackerService > hadoop.yarn.server.resourcemanager.TestRMAdminService > hadoop.yarn.client.api.impl.TestAMRMClient > hadoop.yarn.client.api.impl.TestNMClient > hadoop.yarn.client.cli.TestLogsCLI > hadoop.yarn.client.TestFederationRMFailoverProxyProvider > hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore > hadoop.yarn.server.timeline.TestLogInfo > hadoop.yarn.server.timelineservice.reader. > TestTimelineReaderWebServicesHBaseStorage > hadoop.yarn.server.timelineservice.storage.flow. > TestHBaseStorageFlowActivity > hadoop.yarn.server.timelineservice.storage.flow. > TestHBaseStorageFlowRun > hadoop.yarn.server.timelineservice.storage.flow. > TestHBaseStorageFlowRunCompaction > hadoop.yarn.server.timelineservice.storage. > TestHBaseTimelineStorageApps > hadoop.yarn.server.timelineservice.storage. > TestHBaseTimelineStorageEntities > hadoop.yarn.server.router.webapp.TestRouterWebServicesREST > hadoop.yarn.applications.distributedshell.TestDistributedShell > hadoop.mapreduce.filecache.TestClientDistributedCacheManager > hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter > hadoop.mapreduce.lib.output.TestFileOutputCommitter > hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler > hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler > hadoop.mapreduce.v2.app.job.impl.TestJobImpl > hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM > hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider > hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt > hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest > hadoop.mapreduce.v2.app.launcher.TestContainerLauncher > hadoop.mapreduce.v2.app.rm.TestRMContainerAllocator > hadoop.mapreduce.v2.app.TestAMInfos > hadoop.mapreduce.v2.app.TestFail > hadoop.mapreduce.v2.app.TestFetchFailure > hadoop.mapreduce.v2.app.TestJobEndNotifier > hadoop.mapreduce.v2.app.TestKill > hadoop.mapreduce.v2.app.TestMRApp > hadoop.mapreduce.v2.app.TestMRAppComponentDependencies > hadoop.mapreduce.v2.app.TestMRAppMaster > hadoop.mapreduce.v2.app.TestMRClientService > hadoop.mapreduce.v2.app.TestRecovery > hadoop.mapreduce.v2.app.TestStagingCleanup > hadoop.mapreduce.v2.app.webapp.TestAMWebApp > hadoop.mapreduce.v2.hs.TestHistoryServerFileSystemStateStoreService > hadoop.mapreduce.v2.hs.TestJobHistoryEntities > hadoop.mapreduce.v2.hs.TestJobHistoryEvents > hadoop.mapreduce.v2.hs.TestJobHistoryParsing > hadoop.mapreduce.v2.hs.TestJobHistoryServer > hadoop.mapreduce.v2.hs.TestUnnecessaryBlockingOnHistoryFileInfo > hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo > hadoop.mapreduce.v2.hs.webapp.TestHSWebApp > hadoop.conf.TestNoDefaultsJobConf > hadoop.fs.TestDFSIO > hadoop.mapred.join.TestDatamerge > hadoop.mapred.lib.TestDelegatingInputFormat > hadoop.mapred.TestClusterMapReduceTestCase > hadoop.mapred.TestJavaSerialization > hadoop.mapred.TestJobName > hadoop.mapred.TestJobSysDirWithDFS > hadoop.mapred.TestLazyOutput > hadoop.mapred.TestLocalJobSubmission > hadoop.mapred.TestMerge > hadoop.mapred.TestMiniMRChildTask > hadoop.mapred.TestMiniMRClasspath > hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers > hadoop.mapred.TestMRCJCFileInputFormat > hadoop.mapred.TestMRIntermediateDataEncryption > hadoop.mapred.TestMROpportunisticMaps > hadoop.mapred.TestMRTimelineEventHandling > hadoop.mapred.TestReduceFetch > hadoop.mapred.TestReduceFetchFromPartialMem > hadoop.mapred.TestSpecialCharactersInOutputPath > hadoop.mapreduce.lib.input.TestCombineFileInputFormat > hadoop.mapreduce.lib.input.TestDelegatingInputFormat > hadoop.mapreduce.lib.join.TestJoinDatamerge > hadoop.mapreduce.lib.join.TestJoinProperties > hadoop.mapreduce.security.ssl.TestEncryptedShuffle > hadoop.mapreduce.security.TestBinaryTokenFile > hadoop.mapreduce.security.TestMRCredentials > hadoop.mapreduce.TestMapReduceLazyOutput > hadoop.mapreduce.TestMRJobClient > hadoop.mapreduce.v2.TestMiniMRProxyUser > hadoop.mapreduce.v2.TestMRJobs > hadoop.mapreduce.v2.TestNonExistentJob > hadoop.mapreduce.v2.TestUberAM > hadoop.mapred.nativetask.handlers.TestNativeCollectorOnlyHandler > hadoop.tools.TestDistCpSystem > hadoop.tools.TestDistCpViewFs > hadoop.tools.TestIntegration > hadoop.tools.TestHadoopArchiveLogs > hadoop.yarn.sls.TestReservationSystemInvariants > hadoop.yarn.sls.TestSLSRunner > hadoop.fs.adl.TestGetFileStatus > > Timed out junit tests : > > org.apache.hadoop.hdfs.tools.offlineImageViewer. > TestOfflineImageViewer > org.apache.hadoop.mapreduce.v2.hs.TestJobHistory > org.apache.hadoop.mapred.pipes.TestPipeApplication > > > CTEST: > > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt [28K] > > unit: > > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-common-project_hadoop-common.txt [268K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [1.6M] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt [88K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt [16K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt > [36K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop- > yarn-server_hadoop-yarn-server-nodemanager.txt [160K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop- > yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [36K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop- > yarn-server_hadoop-yarn-server-resourcemanager.txt [80K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt > [24K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop- > yarn-server_hadoop-yarn-server-timeline-pluginstorage.txt [20K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop- > yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt [12K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop- > yarn-server_hadoop-yarn-server-router.txt [456K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop- > yarn-applications_hadoop-yarn-applications-distributedshell.txt [464K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop- > mapreduce-client-core.txt [112K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop- > mapreduce-client-app.txt [348K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop- > mapreduce-client-hs.txt [564K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop- > mapreduce-client-jobclient.txt [228K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop- > mapreduce-client-nativetask.txt [12K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-tools_hadoop-distcp.txt [32K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-tools_hadoop-archive-logs.txt [16K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-tools_hadoop-aws.txt [20K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-tools_hadoop-sls.txt [12K] > https://builds.apache.org/job/hadoop-trunk-win/146/artifact/ > out/patch-unit-hadoop-tools_hadoop-azure-datalake.txt [16K] > > Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org > --------------------------------------------------------------------- > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org<mailto: > common-dev-unsubscr...@hadoop.apache.org> > For additional commands, e-mail: common-dev-h...@hadoop.apache.org<mailto: > common-dev-h...@hadoop.apache.org> > > >
