[jira] [Created] (HDFS-10888) dfshealth.html#tab-datanode
Alexey Ivanchin created HDFS-10888: -- Summary: dfshealth.html#tab-datanode Key: HDFS-10888 URL: https://issues.apache.org/jira/browse/HDFS-10888 Project: Hadoop HDFS Issue Type: Bug Components: ui Affects Versions: 2.7.3 Reporter: Alexey Ivanchin When you click on the tab NN:50070/dfshealth.html#tab-overview i see live datanode and other info. When you click on the tab NN:50070/dfshealth.html#tab-datanode wrote I see a blank page. How to fix? -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/ [Sep 22, 2016 1:30:11 AM] (kasha) MAPREDUCE-6740. Enforce mapreduce.task.timeout to be at least -1 overall The following subsystems voted -1: asflicense unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.client.api.impl.TestNMClient cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/diff-compile-javac-root.txt [168K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/whitespace-eol.txt [11M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/172/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10889) Remove Fault Injection Framework documentaion
Brahma Reddy Battula created HDFS-10889: --- Summary: Remove Fault Injection Framework documentaion Key: HDFS-10889 URL: https://issues.apache.org/jira/browse/HDFS-10889 Project: Hadoop HDFS Issue Type: Bug Components: documentation Reporter: Brahma Reddy Battula Assignee: Brahma Reddy Battula Fault Injection Framework was introduced in HDFS-435..But later related code was removed but documenation was not removed.. I feel, we can remove this stale doc.. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/ [Sep 22, 2016 1:30:11 AM] (kasha) MAPREDUCE-6740. Enforce mapreduce.task.timeout to be at least -1 overall The following subsystems voted -1: compile unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestNodeManagerShutdown hadoop.yarn.server.timeline.TestRollingLevelDB hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices hadoop.yarn.server.timeline.TestTimelineDataManager hadoop.yarn.server.timeline.TestLeveldbTimelineStore hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.timelineservice.storage.common.TestRowKeys hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters hadoop.yarn.server.timelineservice.storage.common.TestSeparator hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapred.TestShuffleHandler hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers Timed out junit tests : org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.mapred.TestMRIntermediateDataEncryption org.apache.hadoop.mapred.TestMROpportunisticMaps compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-compile-root.txt [308K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-compile-root.txt [308K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-compile-root.txt [308K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [240K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt [20K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [72K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timeline-pluginstorage.txt [28K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/102/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt [16K] h
[jira] [Created] (HDFS-10890) Math error in AbstractContractDistCpTest
Aaron Fabbri created HDFS-10890:
---
Summary: Math error in AbstractContractDistCpTest
Key: HDFS-10890
URL: https://issues.apache.org/jira/browse/HDFS-10890
Project: Hadoop HDFS
Issue Type: Bug
Components: distcp
Affects Versions: 2.8.0
Reporter: Aaron Fabbri
Assignee: Aaron Fabbri
Priority: Minor
There is a minor math error in AbstractContractDistCpTest when calculating file
size:
{code}
int fileSizeMb = fileSizeKb * 1024;
{code}
This should be division, not multiplication.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10891) Über-jira: Test Improvement by adding missing test cases for existing code
Mingliang Liu created HDFS-10891: Summary: Über-jira: Test Improvement by adding missing test cases for existing code Key: HDFS-10891 URL: https://issues.apache.org/jira/browse/HDFS-10891 Project: Hadoop HDFS Issue Type: Improvement Components: test Reporter: Mingliang Liu Assignee: Mingliang Liu We have covered some test cases in our nightly run and we'd like to backport those test cases to the community code branch. This work includes the efforts but not limited to: # Add more *meaningful* test cases for existing code so it's hard to break it as stability and compatibility should always be guarded if possible # Refactor existing tests that share common code snippet (e.g. helper methods) and/or logic (e.g. set up a MiniDFSCluster). One approach that is not popular (which it should) is @Parameterized tests # Reduce unnecessary overhead in unit tests (e.g. long interval sleep, build MiniDFSCluster multiple times instead of reusing the same one) This is not a long-term work to cover all future improvement in unit tests. We'll be happy to resolve this after our internal test cases (will file separate JIRAs for that) are mostly addressed/considered. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail'
Mingliang Liu created HDFS-10892:
Summary: Add unit tests for HDFS command 'dfs -tail'
Key: HDFS-10892
URL: https://issues.apache.org/jira/browse/HDFS-10892
Project: Hadoop HDFS
Issue Type: Sub-task
Components: hdfs
Reporter: Mingliang Liu
Assignee: Mingliang Liu
I did not find unit test for HDFS command 'dfs -tail' in {{trunk}} code. I
think it still merits to have one though the command itself has been used there
for years.
It also happens to 'dfs -test'. Perhaps we can consolidate the patches here.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test
Mingliang Liu created HDFS-10893: Summary: Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test Key: HDFS-10893 URL: https://issues.apache.org/jira/browse/HDFS-10893 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Mingliang Liu Assignee: Mingliang Liu Priority: Minor This is a minor change. It seems that setting up MiniDFSCluser once for all commands test will reduce the total time. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10894) Remove the redundant charactors for command -saveNamespace in HDFSCommands.md
Yiqun Lin created HDFS-10894:
Summary: Remove the redundant charactors for command
-saveNamespace in HDFSCommands.md
Key: HDFS-10894
URL: https://issues.apache.org/jira/browse/HDFS-10894
Project: Hadoop HDFS
Issue Type: Bug
Components: documentation
Affects Versions: 3.0.0-alpha1
Reporter: Yiqun Lin
Assignee: Yiqun Lin
Priority: Trivial
There twp redundant charactors for command {{hdfs dfsadmin -saveNamespace}}.
The introduction of this command in HDFSCommands.md
{code}
-saveNamespace \[-beforeShutdown\] Save current namespace into storage
directories and reset edits log
{code}
Here the charactior '\' is no need, it makes this look incorrect. This is a
link page for this document:
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSCommands.html#dfsadmin
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10895) Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec
SammiChen created HDFS-10895: Summary: Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec Key: HDFS-10895 URL: https://issues.apache.org/jira/browse/HDFS-10895 Project: Hadoop HDFS Issue Type: Task Reporter: SammiChen Assignee: SammiChen Recently, native ISA-L library support is added into HDFS erasure code RS codec. With ISA-L, the performance of erasure code RS encode/decode will be significantly improved. This task is to add the deploy process into the HDFS Erasure Code Document, make it easy for HDFS user to use ISA-L enabled erasure code policy. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
