[jira] [Created] (HADOOP-17147) Dead link in hadoop-kms/index.md.vm
Akira Ajisaka created HADOOP-17147: -- Summary: Dead link in hadoop-kms/index.md.vm Key: HADOOP-17147 URL: https://issues.apache.org/jira/browse/HADOOP-17147 Project: Hadoop Common Issue Type: Improvement Components: documentation, kms Reporter: Akira Ajisaka There is a dead link (https://hadoop.apache.org/hadoop-project-dist/hadoop-common/CredentialProviderAPI.html) in https://hadoop.apache.org/docs/r3.3.0/hadoop-kms/index.html#KMS_over_HTTPS_.28SSL.29 The link should be https://hadoop.apache.org/docs/r3.3.0/hadoop-project-dist/hadoop-common/CredentialProviderAPI.html -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17148) Javadoc for TimelineReaderAuthenticationFilterInitializer is broken
Xieming Li created HADOOP-17148:
---
Summary: Javadoc for TimelineReaderAuthenticationFilterInitializer
is broken
Key: HADOOP-17148
URL: https://issues.apache.org/jira/browse/HADOOP-17148
Project: Hadoop Common
Issue Type: Bug
Components: documentation
Reporter: Xieming Li
Assignee: Xieming Li
mvn javadoc:javadoc fails for TimelineReaderAuthenticationFilterInitializer.java
{code:java}
[ERROR]
/Users/sri/projects/hadoop-mirror/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/main/java/org/apache/hadoop/yarn/server/timelineservice/reader/security/TimelineReaderAuthenticationFilterInitializer.java:39:
error: value does not refer to a constant
[ERROR]* {@value TimelineAuthenticationFilterInitializer#PREFIX}.
[ERROR] ^
[ERROR]
/Users/sri/projects/hadoop-mirror/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/main/java/org/apache/hadoop/yarn/server/timelineservice/reader/security/TimelineReaderAuthenticationFilterInitializer.java:39:
error: reference not found
[ERROR]* {@value TimelineAuthenticationFilterInitializer#PREFIX}.
{code}
This issue seems to be caused by changes in YARN-10339
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: branch2.10+JDK7 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/755/ [Jul 21, 2020 1:02:41 PM] (iwasakims) YARN-6515. Fix warnings from Spotbugs in hadoop-yarn-server-nodemanager. -1 overall The following subsystems voted -1: asflicense findbugs hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/empty-configuration.xml hadoop-tools/hadoop-azure/src/config/checkstyle-suppressions.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/public/crossdomain.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml findbugs : module:hadoop-yarn-project/hadoop-yarn Boxed value is unboxed and then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:[line 335] org.apache.hadoop.yarn.state.StateMachineFactory.generateStateGraph(String) makes inefficient use of keySet iterator instead of entrySet iterator At StateMachineFactory.java:keySet iterator instead of entrySet iterator At StateMachineFactory.java:[line 505] findbugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common org.apache.hadoop.yarn.state.StateMachineFactory.generateStateGraph(String) makes inefficient use of keySet iterator instead of entrySet iterator At StateMachineFactory.java:keySet iterator instead of entrySet iterator At StateMachineFactory.java:[line 505] findbugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server Boxed value is unboxed and then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:[line 335] findbugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase Boxed value is unboxed and then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:[line 335] findbugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client Boxed value is unboxed and then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:[line 335] findbugs : module:hadoop-yarn-project Boxed value is unboxed and then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:[line 335] org.apache.hadoop.yarn.state.StateMachineFactory.generateStateGraph(String) makes inefficient use of keySet iterator instead of entrySet iterator At StateMachineFactory.java:keySet iterator instead of entrySet iterator At StateMachineFactory.java:[line 505] findbugs : module:hadoop-mapreduce-project/hadoop-mapreduce-client Primitive is boxed to call Long.compareTo(Long):Long.compareTo(Long): use Long.compare(long, long) instead At JVMId.java
Re: Progress
+CC: common-dev@hadoop Hi Gavin, Thank you for the reminder. I have one question. When ARM servers will be moved to ci-hadoop? Hadoop and HBase have daily jobs that run on ARM servers. I'll migrate the other Hadoop Jenkins jobs to ci-hadoop this weekend. Regards, Akira On Wed, Jul 22, 2020 at 8:39 PM Gavin McDonald wrote: > Hi All, > > Seems there is still not much happening in the way of migrating to > ci-hadoop > > Do you need any more information from me, and help needed? > > The cut off date is 15th August and builds.a.o will be turned off on that > date. > > -- > > *Gavin McDonald* > Systems Administrator > ASF Infrastructure Team >
[jira] [Resolved] (HADOOP-17113) Adding ReadAhead Counters in ABFS
[ https://issues.apache.org/jira/browse/HADOOP-17113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17113. - Fix Version/s: 3.4.0 Resolution: Fixed > Adding ReadAhead Counters in ABFS > - > > Key: HADOOP-17113 > URL: https://issues.apache.org/jira/browse/HADOOP-17113 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/azure >Affects Versions: 3.3.0 >Reporter: Mehakmeet Singh >Assignee: Mehakmeet Singh >Priority: Major > Fix For: 3.4.0 > > > Adding ReadAheads Counters in ABFS to track the behavior of the ReadAhead > feature in ABFS. This would include 2 counters: > |READ_AHEAD_BYTES_READ|number of bytes read by readAhead| > |READ_AHEAD_REMOTE_BYTES_READ|number of bytes not used after readAhead was > used| -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: Progress
Hi , On Wed, Jul 22, 2020 at 7:00 PM Akira Ajisaka wrote: > +CC: common-dev@hadoop > > Hi Gavin, > > Thank you for the reminder. > I have one question. When ARM servers will be moved to ci-hadoop? Hadoop > and HBase have daily jobs that run on ARM servers. > > I'll migrate the other Hadoop Jenkins jobs to ci-hadoop this weekend. > Thanks. I'll move 2 of the ARM nodes tomorrow HTH > > Regards, > Akira > > On Wed, Jul 22, 2020 at 8:39 PM Gavin McDonald > wrote: > > > Hi All, > > > > Seems there is still not much happening in the way of migrating to > > ci-hadoop > > > > Do you need any more information from me, and help needed? > > > > The cut off date is 15th August and builds.a.o will be turned off on that > > date. > > > > -- > > > > *Gavin McDonald* > > Systems Administrator > > ASF Infrastructure Team > > > -- *Gavin McDonald* Systems Administrator ASF Infrastructure Team
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/211/ [Jul 21, 2020 5:43:05 AM] (Shashikant Banerjee) HDFS-15470. Added more unit tests to validate rename behaviour across snapshots. Contributed by Shashikant Banerjee. [Jul 21, 2020 6:06:24 AM] (noreply) HDFS-15479. Ordered snapshot deletion: make it a configurable feature (#2156) [Jul 21, 2020 4:00:07 PM] (Iñigo Goiri) HDFS-15246. ArrayIndexOfboundsException in BlockManager CreateLocatedBlock. Contributed by Hemanth Boyina. [Jul 21, 2020 4:18:54 PM] (noreply) HADOOP-17092. ABFS: Making AzureADAuthenticator.getToken() throw HttpException [Jul 21, 2020 4:22:38 PM] (noreply) Hadoop 17132. ABFS: Fix Rename and Delete Idempotency check trigger -1 overall The following subsystems voted -1: asflicense findbugs pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml findbugs : module:hadoop-common-project/hadoop-common Dead store to $L5 in org.apache.hadoop.ipc.Server$ConnectionManager.decrUserConnections(String) At Server.java:org.apache.hadoop.ipc.Server$ConnectionManager.decrUserConnections(String) At Server.java:[line 3729] Dead store to $L5 in org.apache.hadoop.ipc.Server$ConnectionManager.incrUserConnections(String) At Server.java:org.apache.hadoop.ipc.Server$ConnectionManager.incrUserConnections(String) At Server.java:[line 3717] findbugs : module:hadoop-common-project Dead store to $L5 in org.apache.hadoop.ipc.Server$ConnectionManager.decrUserConnections(String) At Server.java:org.apache.hadoop.ipc.Server$ConnectionManager.decrUserConnections(String) At Server.java:[line 3729] Dead store to $L5 in org.apache.hadoop.ipc.Server$ConnectionManager.incrUserConnections(String) At Server.java:org.apache.hadoop.ipc.Server$ConnectionManager.incrUserConnections(String) At Server.java:[line 3717] findbugs : module:hadoop-hdfs-project/hadoop-hdfs Method org.apache.hadoop.hdfs.server.datanode.checker.DatasetVolumeChecker$ResultHandler.onSuccess(Object) overrides the nullness annotation of parameter $L1 in an incompatible way At DatasetVolumeChecker.java:annotation of parameter $L1 in an incompatible way At DatasetVolumeChecker.java:[line 322] Method org.apache.hadoop.hdfs.server.datanode.checker.DatasetVolumeChecker$ResultHandler.onSuccess(VolumeCheckResult) overrides the nullness annotation of parameter result in an incompatible way At DatasetVolumeChecker.java:annotation of parameter result in an incompatible way At DatasetVolumeChecker.java:[lines 358-376] Method org.apache.hadoop.hdfs.server.datanode.checker.ThrottledAsyncChecker$2.onSuccess(Object) overrides the nullness annotation of parameter result in an incompatible way At ThrottledAsyncChecker.java:annotation of parameter result in an incompatible way At ThrottledAsyncChecker.java:[lines 170-175] Dead store to $L8 in org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader.incrOpCount(FSEditLogOpCodes, EnumMap, Step, StartupProgress$Counter) At FSEditLogLoader.java:org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader.incrOpCount(FSEditLogOpCodes, EnumMap, Step, StartupProgress$Counter) At FSEditLogLoader.java:[line 1241] findbugs : module:hadoop-hdfs-project Method org.apache.hadoop.hdfs.server.datanode.checker.DatasetVolumeChecker$ResultHandler.onSuccess(Object) overrides the nullness annotation of parameter $L1 in an incompatible way At DatasetVolumeChecker.java:annotation of parameter $L1 in an incompatible way At DatasetVolumeChecker.java:[line 322] Method org.apache.hadoop.hdfs.server.datanode.checker.DatasetVolumeChecker$ResultHandler.onSuccess(VolumeCheckResult) overrides the nullness annotation of parameter result in an incompatible way At DatasetVolume
[ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena
Hi all, I am very glad to announce that Ayush Saxena was voted to join Apache Hadoop PMC. Congratulations Ayush! Well deserved and thank you for your dedication to the project. Please keep up the good work. Thanks, -Vinay
Re: [ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena
Congratulations Ayush. Regards Quiyan On Wed, Jul 22, 2020 at 11:52 PM Vinayakumar B wrote: > Hi all, > > I am very glad to announce that Ayush Saxena was voted to join Apache > Hadoop PMC. > > Congratulations Ayush! Well deserved and thank you for your dedication to > the project. Please keep up the good work. > > Thanks, > -Vinay >
[ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena
Hi all, I am very glad to announce that Ayush Saxena was voted to join Apache Hadoop PMC. Congratulations Ayush! Well deserved and thank you for your dedication to the project. Please keep up the good work. Thanks, -Vinay
Re: [ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena
Congrats On Thu, Jul 23, 2020 at 1:10 AM Vinayakumar B wrote: > Hi all, > > I am very glad to announce that Ayush Saxena was voted to join Apache > Hadoop PMC. > > Congratulations Ayush! Well deserved and thank you for your dedication to > the project. Please keep up the good work. > > Thanks, > -Vinay >
Re: [ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena
Congratulations, Ayush.Keep up the good work. Thank you./Sree On Wednesday, July 22, 2020, 12:48:55 PM PDT, Team AMR wrote: Congrats On Thu, Jul 23, 2020 at 1:10 AM Vinayakumar B wrote: > Hi all, > > I am very glad to announce that Ayush Saxena was voted to join Apache > Hadoop PMC. > > Congratulations Ayush! Well deserved and thank you for your dedication to > the project. Please keep up the good work. > > Thanks, > -Vinay >
Re: [ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena
Congrats, and thanks for your help. Sree Vaddi 于2020年7月23日周四 上午3:59写道： > Congratulations, Ayush.Keep up the good work. > > > Thank you./Sree > > > > On Wednesday, July 22, 2020, 12:48:55 PM PDT, Team AMR < > teamamr.apa...@gmail.com> wrote: > > Congrats > > > On Thu, Jul 23, 2020 at 1:10 AM Vinayakumar B > wrote: > > > Hi all, > > > > I am very glad to announce that Ayush Saxena was voted to join Apache > > Hadoop PMC. > > > > Congratulations Ayush! Well deserved and thank you for your dedication to > > the project. Please keep up the good work. > > > > Thanks, > > -Vinay > > >
Re: Progress
Thanks for doing this, I was going to post in the JIRA about this yesterday but was disturbed by something, please help us migrate the ARM nodes. BR, On Thu, Jul 23, 2020 at 1:40 AM Gavin McDonald wrote: > Hi , > > On Wed, Jul 22, 2020 at 7:00 PM Akira Ajisaka wrote: > > > +CC: common-dev@hadoop > > > > Hi Gavin, > > > > Thank you for the reminder. > > I have one question. When ARM servers will be moved to ci-hadoop? Hadoop > > and HBase have daily jobs that run on ARM servers. > > > > I'll migrate the other Hadoop Jenkins jobs to ci-hadoop this weekend. > > > > Thanks. > > I'll move 2 of the ARM nodes tomorrow > > HTH > > > > > > Regards, > > Akira > > > > On Wed, Jul 22, 2020 at 8:39 PM Gavin McDonald > > wrote: > > > > > Hi All, > > > > > > Seems there is still not much happening in the way of migrating to > > > ci-hadoop > > > > > > Do you need any more information from me, and help needed? > > > > > > The cut off date is 15th August and builds.a.o will be turned off on > that > > > date. > > > > > > -- > > > > > > *Gavin McDonald* > > > Systems Administrator > > > ASF Infrastructure Team > > > > > > > > -- > > *Gavin McDonald* > Systems Administrator > ASF Infrastructure Team >
Re: [ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena
Congratulations Ayush! Regards, He Xiaoqiao On Thu, Jul 23, 2020 at 9:18 AM Sheng Liu wrote: > Congrats, and thanks for your help. > > Sree Vaddi 于2020年7月23日周四 上午3:59写道： > > > Congratulations, Ayush.Keep up the good work. > > > > > > Thank you./Sree > > > > > > > > On Wednesday, July 22, 2020, 12:48:55 PM PDT, Team AMR < > > teamamr.apa...@gmail.com> wrote: > > > > Congrats > > > > > > On Thu, Jul 23, 2020 at 1:10 AM Vinayakumar B > > wrote: > > > > > Hi all, > > > > > > I am very glad to announce that Ayush Saxena was voted to join Apache > > > Hadoop PMC. > > > > > > Congratulations Ayush! Well deserved and thank you for your dedication > to > > > the project. Please keep up the good work. > > > > > > Thanks, > > > -Vinay > > > > > >
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/212/ [Jul 22, 2020 4:40:20 AM] (noreply) HADOOP-17138. Fix spotbugs warnings surfaced after upgrade to 4.0.6. (#2155) [Jul 22, 2020 6:29:10 AM] (noreply) HDFS-15478: When Empty mount points, we are assigning fallback link to self. But it should not use full URI for target fs. (#2160). Contributed by Uma Maheswara Rao G. [Jul 22, 2020 3:39:49 PM] (Akira Ajisaka) HADOOP-17147. Dead link in hadoop-kms/index.md.vm. Contributed by Xieming Li. [Jul 22, 2020 5:22:30 PM] (noreply) HADOOP-17113. Adding ReadAhead Counters in ABFS (#2154) [Jul 22, 2020 11:16:27 PM] (noreply) HDFS-15480. Ordered snapshot deletion: record snapshot deletion in XAttr (#2163) [Error replacing 'FILE' - Workspace is not accessible] - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
