On 3 Aug 2017, at 20:05, Ravi Prakash <ravihad...@gmail.com<mailto:ravihad...@gmail.com>> wrote:
It would have been nice if MSDN had a windows image that I could spin up on my favorite Linux distro :-) But I haven't been able to find it yet :( did you try these https://developer.microsoft.com/en-us/microsoft-edge/tools/vms/ On Thu, Aug 3, 2017 at 3:23 AM, Steve Loughran <ste...@hortonworks.com<mailto:ste...@hortonworks.com>> wrote: wow, a lot of failures. some appear to be test timeouts, some native library availability (https://builds.apache.org/job/hadoop-trunk-win/146/testReport/junit/org.apache.hadoop.util/TestNativeCodeLoader/testNativeCodeLoaded/), but I think many (most?) are due to them getting paths wrong once there's a drive prefix there, e.g. https://builds.apache.org/job/hadoop-trunk-win/146/testReport/junit/org.apache.hadoop.fs/TestFsShellList/testList/ including those which think that file:// + file.getAbsolutePath is a valid URI https://builds.apache.org/job/hadoop-trunk-win/146/testReport/junit/org.apache.hadoop.conf/TestConfiguration/ I think the way to deal with this is going to be some form of bug bash. Who out there wants to spend a day doing windows builds? It's not *too* bad...setting up the VM is the hard part. On 3 Aug 2017, at 05:45, Allen Wittenauer <a...@effectivemachines.com<mailto:a...@effectivemachines.com><mailto:a...@effectivemachines.com<mailto:a...@effectivemachines.com>>> wrote: For more details, see https://builds.apache.org/job/hadoop-trunk-win/146/ [Aug 2, 2017 4:25:19 PM] (yufei) YARN-6895. [FairScheduler] Preemption reservation may cause regular -1 overall The following subsystems voted -1: unit The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed CTEST tests : test_test_libhdfs_threaded_hdfs_static Failed junit tests : hadoop.conf.TestConfiguration hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.contract.rawlocal.TestRawlocalContractAppend hadoop.fs.TestFsShellCopy hadoop.fs.TestFsShellList hadoop.fs.TestLocalFileSystem hadoop.io.nativeio.TestNativeIO hadoop.io<http://hadoop.io/>.TestSequenceFileAppend hadoop.ipc.TestIPC hadoop.ipc.TestSocketFactory hadoop.metrics2.impl.TestStatsDMetrics hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal hadoop.security.TestShellBasedUnixGroupsMapping hadoop.security.token.TestDtUtilShell hadoop.util.TestNativeCodeLoader hadoop.fs.TestWebHdfsFileContextMainOperations hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy hadoop.hdfs.qjournal.client.TestQuorumJournalManager hadoop.hdfs.security.TestDelegationTokenForProxyUser hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage hadoop.hdfs.server.datanode.TestBlockScanner hadoop.hdfs.server.datanode.TestDataNodeFaultInjector hadoop.hdfs.server.datanode.TestDataNodeUUID hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.datanode.TestHSync hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.ha.TestHAAppend hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands hadoop.hdfs.server.namenode.TestEditLogRace hadoop.hdfs.server.namenode.TestFileTruncate hadoop.hdfs.server.namenode.TestFsck hadoop.hdfs.server.namenode.TestNameNodeMXBean hadoop.hdfs.server.namenode.TestNestedEncryptionZones hadoop.hdfs.server.namenode.TestQuotaByStorageType hadoop.hdfs.server.namenode.TestStartup hadoop.hdfs.TestBlockStoragePolicy hadoop.hdfs.TestDatanodeRegistration hadoop.hdfs.TestDFSOutputStream hadoop.hdfs.TestDFSShell hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030 hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050 hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080 hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100 hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140 hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.TestFetchImage hadoop.hdfs.TestFileAppend hadoop.hdfs.TestFileCreation hadoop.hdfs.TestHDFSFileSystemContract hadoop.hdfs.TestHDFSServerPorts hadoop.hdfs.TestHDFSTrash hadoop.hdfs.TestLocalDFS hadoop.hdfs.TestMiniDFSCluster hadoop.hdfs.TestQuota hadoop.hdfs.TestReadStripedFileWithMissingBlocks hadoop.hdfs.TestReconstructStripedFile hadoop.hdfs.TestSecureEncryptionZoneWithKMS hadoop.hdfs.TestTrashWithSecureEncryptionZones hadoop.hdfs.tools.TestDebugAdmin hadoop.hdfs.tools.TestDFSAdmin hadoop.hdfs.web.TestWebHdfsFileSystemContract hadoop.fs.http.server.TestHttpFSServerWebServer hadoop.yarn.logaggregation.TestAggregatedLogFormat hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch hadoop.yarn.server.nodemanager.containermanager.linux.privileged.TestPrivilegedOperationExecutor hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestCGroupsHandlerImpl hadoop.yarn.server.nodemanager.containermanager.linux.runtime.TestDockerContainerRuntime hadoop.yarn.server.nodemanager.containermanager.linux.runtime.TestJavaSandboxLinuxContainerRuntime hadoop.yarn.server.nodemanager.containermanager.logaggregation.TestAppLogAggregatorImpl hadoop.yarn.server.nodemanager.containermanager.logaggregation.TestLogAggregationService hadoop.yarn.server.nodemanager.containermanager.monitor.TestContainersMonitor hadoop.yarn.server.nodemanager.containermanager.TestContainerManager hadoop.yarn.server.nodemanager.containermanager.TestContainerManagerRecovery hadoop.yarn.server.nodemanager.nodelabels.TestScriptBasedNodeLabelsProvider hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestContainerExecutor hadoop.yarn.server.nodemanager.TestLocalDirsHandlerService hadoop.yarn.server.nodemanager.TestNodeManagerResync hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.resourcemanager.TestRMAdminService hadoop.yarn.client.api.impl.TestAMRMClient hadoop.yarn.client.api.impl.TestNMClient hadoop.yarn.client.cli.TestLogsCLI hadoop.yarn.client.TestFederationRMFailoverProxyProvider hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.server.timeline.TestLogInfo hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities hadoop.yarn.server.router.webapp.TestRouterWebServicesREST hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapreduce.filecache.TestClientDistributedCacheManager hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter hadoop.mapreduce.lib.output.TestFileOutputCommitter hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler hadoop.mapreduce.v2.app.job.impl.TestJobImpl hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest hadoop.mapreduce.v2.app.launcher.TestContainerLauncher hadoop.mapreduce.v2.app.rm.TestRMContainerAllocator hadoop.mapreduce.v2.app.TestAMInfos hadoop.mapreduce.v2.app.TestFail hadoop.mapreduce.v2.app.TestFetchFailure hadoop.mapreduce.v2.app.TestJobEndNotifier hadoop.mapreduce.v2.app.TestKill hadoop.mapreduce.v2.app.TestMRApp hadoop.mapreduce.v2.app.TestMRAppComponentDependencies hadoop.mapreduce.v2.app.TestMRAppMaster hadoop.mapreduce.v2.app.TestMRClientService hadoop.mapreduce.v2.app.TestRecovery hadoop.mapreduce.v2.app.TestStagingCleanup hadoop.mapreduce.v2.app.webapp.TestAMWebApp hadoop.mapreduce.v2.hs.TestHistoryServerFileSystemStateStoreService hadoop.mapreduce.v2.hs.TestJobHistoryEntities hadoop.mapreduce.v2.hs.TestJobHistoryEvents hadoop.mapreduce.v2.hs.TestJobHistoryParsing hadoop.mapreduce.v2.hs.TestJobHistoryServer hadoop.mapreduce.v2.hs.TestUnnecessaryBlockingOnHistoryFileInfo hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo hadoop.mapreduce.v2.hs.webapp.TestHSWebApp hadoop.conf.TestNoDefaultsJobConf hadoop.fs.TestDFSIO hadoop.mapred.join.TestDatamerge hadoop.mapred.lib.TestDelegatingInputFormat hadoop.mapred.TestClusterMapReduceTestCase hadoop.mapred.TestJavaSerialization hadoop.mapred.TestJobName hadoop.mapred.TestJobSysDirWithDFS hadoop.mapred.TestLazyOutput hadoop.mapred.TestLocalJobSubmission hadoop.mapred.TestMerge hadoop.mapred.TestMiniMRChildTask hadoop.mapred.TestMiniMRClasspath hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers hadoop.mapred.TestMRCJCFileInputFormat hadoop.mapred.TestMRIntermediateDataEncryption hadoop.mapred.TestMROpportunisticMaps hadoop.mapred.TestMRTimelineEventHandling hadoop.mapred.TestReduceFetch hadoop.mapred.TestReduceFetchFromPartialMem hadoop.mapred.TestSpecialCharactersInOutputPath hadoop.mapreduce.lib.input.TestCombineFileInputFormat hadoop.mapreduce.lib.input.TestDelegatingInputFormat hadoop.mapreduce.lib.join.TestJoinDatamerge hadoop.mapreduce.lib.join.TestJoinProperties hadoop.mapreduce.security.ssl.TestEncryptedShuffle hadoop.mapreduce.security.TestBinaryTokenFile hadoop.mapreduce.security.TestMRCredentials hadoop.mapreduce.TestMapReduceLazyOutput hadoop.mapreduce.TestMRJobClient hadoop.mapreduce.v2.TestMiniMRProxyUser hadoop.mapreduce.v2.TestMRJobs hadoop.mapreduce.v2.TestNonExistentJob hadoop.mapreduce.v2.TestUberAM hadoop.mapred.nativetask.handlers.TestNativeCollectorOnlyHandler hadoop.tools.TestDistCpSystem hadoop.tools.TestDistCpViewFs hadoop.tools.TestIntegration hadoop.tools.TestHadoopArchiveLogs hadoop.yarn.sls.TestReservationSystemInvariants hadoop.yarn.sls.TestSLSRunner hadoop.fs.adl.TestGetFileStatus Timed out junit tests : org.apache.hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer org.apache.hadoop.mapreduce.v2.hs.TestJobHistory org.apache.hadoop.mapred.pipes.TestPipeApplication CTEST: https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt [28K] unit: https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [268K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [1.6M] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt [88K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt [16K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt [36K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [160K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [36K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [80K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [24K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timeline-pluginstorage.txt [20K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt [12K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-router.txt [456K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt [464K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [112K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt [348K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-hs.txt [564K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [228K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [12K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-tools_hadoop-distcp.txt [32K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-tools_hadoop-archive-logs.txt [16K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-tools_hadoop-aws.txt [20K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-tools_hadoop-sls.txt [12K] https://builds.apache.org/job/hadoop-trunk-win/146/artifact/out/patch-unit-hadoop-tools_hadoop-azure-datalake.txt [16K] Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org<http://yetus.apache.org/> --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org<mailto:common-dev-unsubscr...@hadoop.apache.org><mailto:common-dev-unsubscr...@hadoop.apache.org<mailto:common-dev-unsubscr...@hadoop.apache.org>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org<mailto:common-dev-h...@hadoop.apache.org><mailto:common-dev-h...@hadoop.apache.org<mailto:common-dev-h...@hadoop.apache.org>>
