[jira] [Created] (HDFS-11358) DiskBalancer: Report command supports reading nodes from host file
Yiqun Lin created HDFS-11358:
Summary: DiskBalancer: Report command supports reading nodes from
host file
Key: HDFS-11358
URL: https://issues.apache.org/jira/browse/HDFS-11358
Project: Hadoop HDFS
Issue Type: Improvement
Components: diskbalancer
Affects Versions: 3.0.0-alpha2
Reporter: Yiqun Lin
Assignee: Yiqun Lin
This is a improvement of JIRA HDFS-10821. In HDFS-10821, it supports the
{{diskbalancer report}} command can be executed with multiple nodes. But the
multiple nodes are read from a nodes string. It will be not good to use when
the cluster is big enough. A better way we can do is making that can be read
from a host file as that has been done in many places in HDFS(ex.
decommission, balancer). This JIRA focus on this point, and will makes this
done in diskbalancer.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/ [Jan 21, 2017 8:31:20 AM] (aajisaka) HADOOP-13858. TestGridmixMemoryEmulation and TestResourceUsageEmulators [Jan 21, 2017 11:43:18 PM] (eyang) HADOOP-13119. Add ability to secure log servlet using proxy users. -1 overall The following subsystems voted -1: asflicense unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.yarn.client.api.impl.TestAMRMProxy hadoop.yarn.server.timeline.webapp.TestTimelineWebServices hadoop.yarn.server.TestDiskFailures hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/diff-compile-javac-root.txt [160K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/diff-patch-shellcheck.txt [24K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/whitespace-eol.txt [11M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [324K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/294/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0
Thanks for the validation John. Do we feel the L&N issue is enough to sink the RC? On Fri, Jan 20, 2017 at 6:47 PM, John Zhuge wrote: > Discovered 1 missing license using the script verify-license-notice.sh. > > Missing LICENSE! ./../hadoop-dist/target/hadoop-3.0.0-alpha2/share/ > hadoop/client/hadoop-client-api-3.0.0-alpha2.jar > - Verified checksums and signatures of the tarballs > - Built source with Java 1.8.0_66 on Mac > - Deployed a pseudo cluster, passed the following sanity tests in both > insecure > and SSL mode: > > - basic dfs, distcp, ACL commands > > - KMS and HttpFS tests > > - MapReduce wordcount example > - balancer start/stop > > > John Zhuge > Software Engineer, Cloudera > > On Fri, Jan 20, 2017 at 2:36 PM, Andrew Wang > wrote: > >> Hi all, >> >> With heartfelt thanks to many contributors, the RC0 for 3.0.0-alpha2 is >> ready. >> >> 3.0.0-alpha2 is the second alpha in the planned 3.0.0 release line leading >> up to a 3.0.0 GA. It comprises 857 fixes, improvements, and new features >> since alpha1 was released on September 3rd, 2016. >> >> More information about the 3.0.0 release plan can be found here: >> >> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+release >> >> The artifacts can be found here: >> >> http://home.apache.org/~wang/3.0.0-alpha2-RC0/ >> >> This vote will run 5 days, ending on 01/25/2017 at 2PM pacific. >> >> I ran basic validation with a local pseudo cluster and a Pi job. RAT >> output >> was clean. >> >> My +1 to start. >> >> Thanks, >> Andrew >> > >
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0
> On Jan 20, 2017, at 2:36 PM, Andrew Wang wrote: > > http://home.apache.org/~wang/3.0.0-alpha2-RC0/ There are quite a few JIRA issues that need release notes. - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0
> On Jan 22, 2017, at 9:05 PM, Allen Wittenauer > wrote: > > > > > >> On Jan 20, 2017, at 2:36 PM, Andrew Wang wrote: >> >> http://home.apache.org/~wang/3.0.0-alpha2-RC0/ > > There are quite a few JIRA issues that need release notes. > One other thing, before I forget... I'm not sure the hadoop-client-minicluster jar is getting built properly. If you look inside, you'll find a real mishmash of things, including files and directories with the same names but different cases. This means it won't extract properly on OS X. (jar xf on that jar file literally stack traces on my El Capitan machine. Neat!) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
