[jira] Lantao Jin shared "HDFS-11111: Delete something in .Trash using "rm" should be forbidden without safety option " with you
Lantao Jin shared an issue with you
---
> Delete something in .Trash using "rm" should be forbidden without safety
> option
> -
>
> Key: HDFS-1
> URL: https://issues.apache.org/jira/browse/HDFS-1
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs
>Affects Versions: 2.7.2
>Reporter: Lantao Jin
>
> As we discussed in HDFS-11102, double confirmation does not seem to be a
> graceful solution for users. Deleting files in .Trash accidentally is still
> an issue though. The behaviour of users I'm worried about is {{rm}} ing
> something in .Trash (without explicitly understanding that those files will
> not be recoverable). This is in contrast to {{rm}} ing something with
> "-skipTrash" option (That's a very purposeful action).
> So it is not the same case as HADOOP-12358. The solution is throwing an
> exception and remind user to add "-trash" option to delete dirs in trash for
> safely:
> {code}
> Can not delete somehing trash directly! Please add "-trash" or "-T" in "rm"
> command to do that.
> {code}
Also shared with
hdfs-...@hadoop.apache.org
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/ [Nov 11, 2016 6:42:59 AM] (yzhang) HADOOP-13720. Add more info to the msgs printed in [Nov 11, 2016 2:38:15 PM] (brahma) HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by [Nov 11, 2016 3:18:31 PM] (naganarasimha_gr) YARN-5545. Fix issues related to Max App in capacity scheduler. [Nov 11, 2016 6:58:50 PM] (wangda) YARN-5868. Update npm to latest version in Dockerfile to avoid random [Nov 11, 2016 7:15:07 PM] (cdouglas) HADOOP-13037. Refactor Azure Data Lake Store as an independent [Nov 11, 2016 8:29:47 PM] (liuml07) HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. [Nov 11, 2016 9:34:56 PM] (wangda) YARN-5552. Add Builder methods for common yarn API records. (Tao Jie via [Nov 11, 2016 10:31:23 PM] (xyao) HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. [Nov 11, 2016 11:02:52 PM] (arp) HDFS-9. Support for parallel checking of StorageLocations on [Nov 11, 2016 11:16:21 PM] (jianhe) YARN-5825. ProportionalPreemptionalPolicy should use readLock over [Nov 12, 2016 6:12:27 AM] (liuml07) HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. -1 overall The following subsystems voted -1: asflicense findbugs unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.crypto.key.kms.server.TestKMS hadoop.hdfs.tools.TestDelegationTokenFetcher hadoop.mapred.pipes.TestPipeApplication hadoop.yarn.server.resourcemanager.TestTokenClientRMService hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/diff-compile-javac-root.txt [164K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/diff-patch-shellcheck.txt [28K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/whitespace-eol.txt [11M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/whitespace-tabs.txt [1.3M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [4.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/patch-unit-hadoop-common-project_hadoop-kms.txt [24K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [164K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [92K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [72K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [316K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/223/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/153/ [Nov 11, 2016 2:38:15 PM] (brahma) HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by [Nov 11, 2016 3:18:31 PM] (naganarasimha_gr) YARN-5545. Fix issues related to Max App in capacity scheduler. [Nov 11, 2016 6:58:50 PM] (wangda) YARN-5868. Update npm to latest version in Dockerfile to avoid random [Nov 11, 2016 7:15:07 PM] (cdouglas) HADOOP-13037. Refactor Azure Data Lake Store as an independent [Nov 11, 2016 8:29:47 PM] (liuml07) HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. [Nov 11, 2016 9:34:56 PM] (wangda) YARN-5552. Add Builder methods for common yarn API records. (Tao Jie via [Nov 11, 2016 10:31:23 PM] (xyao) HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. [Nov 11, 2016 11:02:52 PM] (arp) HDFS-9. Support for parallel checking of StorageLocations on [Nov 11, 2016 11:16:21 PM] (jianhe) YARN-5825. ProportionalPreemptionalPolicy should use readLock over [Nov 12, 2016 6:12:27 AM] (liuml07) HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. -1 overall The following subsystems voted -1: compile unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.crypto.key.kms.server.TestKMS hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer hadoop.hdfs.TestFileAppend3 hadoop.hdfs.tools.TestDelegationTokenFetcher hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService hadoop.mapred.pipes.TestPipeApplication hadoop.mapred.TestShuffleHandler hadoop.mapred.gridmix.TestResourceUsageEmulators hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.yarn.client.TestApplicationClientProtocolOnHA hadoop.yarn.server.timeline.TestRollingLevelDB hadoop.yarn.server.timeline.TestTimelineDataManager hadoop.yarn.server.timeline.TestLeveldbTimelineStore hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestNodeManagerShutdown hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestTokenClientRMService hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.server.timelineservice.storage.common.TestRowKeys hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters hadoop.yarn.server.timelineservice.storage.common.TestSeparator hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity Timed out junit tests : org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.mapred.TestMRIntermediateDataEncryption compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/153/artifact/out/patch-compile-root.txt [168K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/153/artifact/out/patch-compile-root.txt [168K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/153/artifact/out/patch-compile-root.txt [168K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/153/artifact/out/patch-unit-hadoop-common-project_hadoop-kms.txt [24K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/153/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [212K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/153/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-map
Re: Multiple node Hadoop cluster on Docker for test and debugging
Roman, Zhe Thanks for the response! I was not familiar with Apache BigTop. I also try to use it. Thanks! Kai Sasaki > On 2016 Nov 10, at 9:07, Roman Shaposhnik wrote: > > On Wed, Nov 9, 2016 at 9:30 AM, Zhe Zhang > wrote: >> Nice work Kai! Quick comment: have you considered Bigtop? It allows >> creating a multi-node docker cluster too. But I'm not sure if Bigtop takes >> a custom built Hadoop (from the instructions I read, it builds from a >> certain git branch; I'm not sure if that customizable). > > That's perfectly customizable. What's cool about Bigtop is that it allows > you to provision not just Hadoop but tons of other big data projects since > it is all driven by the set of Puppet recipes. The very same set of Puppet > recipes that also drive Canonical's Juju: >https://jujucharms.com/big-data > > Thanks, > Roman. > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
