[jira] [Created] (HDFS-14383) Compute datanode load based on StoragePolicy

2019-03-19 Thread Karthik Palanisamy (JIRA)
Karthik Palanisamy created HDFS-14383: - Summary: Compute datanode load based on StoragePolicy Key: HDFS-14383 URL: https://issues.apache.org/jira/browse/HDFS-14383 Project: Hadoop HDFS Is

[jira] [Resolved] (HDDS-747) Update MiniOzoneCluster to work with security protocol from SCM

2019-03-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-747. - Resolution: Invalid This won't work with different components require separate Kerberos login of different

Re: [DISCUSS] Docker build process

2019-03-19 Thread Eric Yang
Hi Jonathan, Thank you for your input. There are 15,300 matches for querying Google: dockerfile-maven-plugin site:github.com and 377 matches for query apache hosted projects. I see that many projects opt in to use profile to work around building docker images all the time while others stay tr

Re: [DISCUSS] Docker build process

2019-03-19 Thread Eric Yang
Hi Arpit, On Docker Hub, Hadoop tagged with version number that looks like: docker-hadoop-runner-latest, or jdk11. It is hard to tell if jdk11 image is Hadoop 3 or Hadoop 2 because there is no consistency in tag format usage. This is my reasoning against tag as your heart desired because flex

[jira] [Created] (HDDS-1312) Add more unit tests to verify BlockOutputStream functionalities

2019-03-19 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDDS-1312: - Summary: Add more unit tests to verify BlockOutputStream functionalities Key: HDDS-1312 URL: https://issues.apache.org/jira/browse/HDDS-1312 Project: Hadoop

Re: [DISCUSS] Docker build process

2019-03-19 Thread Arpit Agarwal
Hi Eric, > Dockerfile is most likely to change to apply the security fix. I am not sure this is always. Marton’s point about revising docker images independent of Hadoop versions is valid. > When maven release is automated through Jenkins, this is a breeze > of clicking a button. Jenkins eve

Re: [DISCUSS] Docker build process

2019-03-19 Thread Jonathan Eagles
This email discussion thread is the result of failing to reach consensus in the JIRA. If you participate in this discussion thread, please recognize that a considerable effort has been made by contributors on this JIRA. On the other hand, contributors to this JIRA need to listen carefully to the co

[jira] [Created] (HDDS-1311) Make Install Snapshot option configurable

2019-03-19 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-1311: Summary: Make Install Snapshot option configurable Key: HDDS-1311 URL: https://issues.apache.org/jira/browse/HDDS-1311 Project: Hadoop Distributed Data Store

Re: [DISCUSS] Docker build process

2019-03-19 Thread Jim Brennan
I agree with Steve and Marton. I am ok with having the docker build as an option, but I don't want it to be the default. Jim On Tue, Mar 19, 2019 at 12:19 PM Eric Yang wrote: > Hi Marton, > > Thank you for your input. I agree with most of what you said with a few > exceptions. Security fix

Re: [DISCUSS] Docker build process

2019-03-19 Thread Eric Yang
Hi Marton, Thank you for your input. I agree with most of what you said with a few exceptions. Security fix should result in a different version of the image instead of replace of a certain version. Dockerfile is most likely to change to apply the security fix. If it did not change, the sou

[jira] [Created] (HDFS-14382) The hdfs fsck command docs do not explain the meaning of the reported fields

2019-03-19 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-14382: --- Summary: The hdfs fsck command docs do not explain the meaning of the reported fields Key: HDFS-14382 URL: https://issues.apache.org/jira/browse/HDFS-14382 Proj

[jira] [Created] (HDFS-14381) Add option to hdfs dfs -cat to ignore corrupt blocks

2019-03-19 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-14381: --- Summary: Add option to hdfs dfs -cat to ignore corrupt blocks Key: HDFS-14381 URL: https://issues.apache.org/jira/browse/HDFS-14381 Project: Hadoop HDFS

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-03-19 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1080/ [Mar 17, 2019 9:08:29 AM] (sammichen) HDDS-699. Detect Ozone Network topology. Contributed by Sammi Chen. [Mar 18, 2019 11:45:01 AM] (templedf) MAPREDUCE-7188. [Clean-up] Remove NULL check before instance

[jira] [Created] (HDDS-1310) In datanode once a container becomes unhealthy, datanode restart fails.

2019-03-19 Thread Sandeep Nemuri (JIRA)
Sandeep Nemuri created HDDS-1310: Summary: In datanode once a container becomes unhealthy, datanode restart fails. Key: HDDS-1310 URL: https://issues.apache.org/jira/browse/HDDS-1310 Project: Hadoop D

[jira] [Created] (HDFS-14380) webhdfs failover append to stand-by namenode fails

2019-03-19 Thread gael URBAUER (JIRA)
gael URBAUER created HDFS-14380: --- Summary: webhdfs failover append to stand-by namenode fails Key: HDFS-14380 URL: https://issues.apache.org/jira/browse/HDFS-14380 Project: Hadoop HDFS Issue Ty

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-03-19 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/265/ [Mar 18, 2019 4:00:40 PM] (xkrogen) HADOOP-16192. Fix CallQueue backoff bugs: perform backoff when add() is -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen uni

[jira] [Created] (HDFS-14379) WebHdfsFileSystem.toUrl double encodes characters

2019-03-19 Thread Boris Vulikh (JIRA)
Boris Vulikh created HDFS-14379: --- Summary: WebHdfsFileSystem.toUrl double encodes characters Key: HDFS-14379 URL: https://issues.apache.org/jira/browse/HDFS-14379 Project: Hadoop HDFS Issue Typ

Re: [DISCUSS] Docker build process

2019-03-19 Thread Elek, Marton
Thank you Eric to describe the problem. I have multiple small comments, trying to separate them. I. separated vs in-build container image creation > The disadvantages are: > > 1. Require developer to have access to docker. > 2. Default build takes longer. These are not the only disadvanta