[jira] [Created] (HADOOP-17037) WordMedian example has a logical error

2020-05-12 Thread nihileon (Jira)
nihileon created HADOOP-17037: - Summary: WordMedian example has a logical error Key: HADOOP-17037 URL: https://issues.apache.org/jira/browse/HADOOP-17037 Project: Hadoop Common Issue Type: Bug

Apache Hadoop qbt Report: branch2.10+JDK7 on Linux/x86

2020-05-12 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/683/ [May 11, 2020 5:07:35 PM] (ericp) YARN-9444. YARN API ResourceUtils's getRequestedResourcesFromConfig -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit

why is a hadoop dist taking so long to build

2020-05-12 Thread Steve Loughran
every week or so I do a -Pdist build of hadoop, so I can have an up to date command line. Today I kicked off the build with -Pdist -DskipTests -Dmaven.javadoc.skip=true And it took half an hour to complete -with 1/3 of that time just shading the minicluster [INFO] Apache Hadoop Main

Re: why is a hadoop dist taking so long to build

2020-05-12 Thread Ayush Saxena
Hi Steve, Just tried building with -DskipShade, It worked for me. Executed *mvn clean install -DskipTests -DskipShade -Pdist -Dmaven.javadoc.skip=true* Sharing the result : [INFO] [INFO] Reactor Summary for Apache Hadoop Mai

Re: why is a hadoop dist taking so long to build

2020-05-12 Thread Ayush Saxena
Sorry, didn't see the first question. Attached the Build_Details for reference. With -DskipShade 5:18 Without -DskipShade : 12:52 -Ayush On Tue, 12 May 2020 at 19:51, Ayush Saxena wrote: > Hi Steve, > Just tried building with -DskipShade, It worked for me. > Executed *mvn clean install -DskipTe

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

2020-05-12 Thread Mukund Madhav Thakur
I compiled and ran s3 tests using mvn clean verify -Ds3guard -Ddynamo -Dauth. I see some failures. I ran these separately as well but it still fails for me. Also I am trying to run the abfs tests but all tests are getting skipped even if I think I have right auth-keys.xml. I will debug this and

[jira] [Resolved] (HADOOP-17035) Trivial typo(s) which are 'timout', 'interruped' in comment, LOG and documents

2020-05-12 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HADOOP-17035. - Hadoop Flags: Reviewed Resolution: Fixed Thanks for the patch. I've added you to the Hado

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-05-12 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/138/ [May 11, 2020 5:44:18 AM] (noreply) HADOOP-16768. SnappyCompressor test cases wrongly assume that the compressed data is always smaller than the input data. (#2003) [May 11, 2020 11:18:34 AM] (Ayush

[jira] [Created] (HADOOP-17038) Support positional read in AbfsInputStream

2020-05-12 Thread Anoop Sam John (Jira)
Anoop Sam John created HADOOP-17038: --- Summary: Support positional read in AbfsInputStream Key: HADOOP-17038 URL: https://issues.apache.org/jira/browse/HADOOP-17038 Project: Hadoop Common Is

[jira] [Created] (HADOOP-17039) Change scope of InternalDirOfViewFs and InodeTree to make ViewFileSystem extendable outside common package

2020-05-12 Thread Abhishek Das (Jira)
Abhishek Das created HADOOP-17039: - Summary: Change scope of InternalDirOfViewFs and InodeTree to make ViewFileSystem extendable outside common package Key: HADOOP-17039 URL: https://issues.apache.org/jira/browse/

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-05-12 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/139/ [May 12, 2020 2:04:03 PM] (noreply) HDFS-15350. Set dfs.client.failover.random.order to true as default. (#2008) [May 12, 2020 2:07:51 PM] (Stephen O'Donnell) HDFS-15255. Consider StorageType when Da

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

2020-05-12 Thread Masatake Iwasaki
Also I am trying to run the abfs tests but all tests are getting skipped even if I think I have right auth-keys.xml. I will debug this and update. hadoop-azure expects azure-auth-keys.xml instead of auth-keys.xml? I think it should be consistent with other FS modules.. Masatake Iwasaki On 2020

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

2020-05-12 Thread Mukund Madhav Thakur
Yes , I have azure-auth-keys only. And abfs tests work fine in the current trunk branch with my same azure-auth-keys.xml file. Fyi: I am running mvn -T 1C -Dparallel-tests=abfs clean verify *One thing I noticed here is , in this branch there are no ABFS related classes.* @Gabor Bota I did the