Re: Hadoop Windows Build

> On May 3, 2024, at 9:04 AM, Gavin McDonald wrote: > > Build times are in the order of days, not hours, how is the caching helping > here? It won’t help for full builds but for PRs where it only does parts of the tree it can be dramatic. (Remember: this is running Yetus which will

Re: Hadoop Windows Build

> On Apr 26, 2024, at 9:42 AM, Cesar Hernandez wrote: > > My two cents is to use cleanWs() instead of deleteDir() as > documented in: https://plugins.jenkins.io/ws-cleanup/ If this was a generic, run of the mill build, that could be an option. Definitely don’t want to do that for Ha

Re: ${!var} In Scripts

> On Mar 4, 2019, at 10:00 AM, Daniel Templeton wrote: > > Do you want to file a JIRA for it, or shall I? Given I haven’t done any Hadoop work in months and months … - To unsubscribe, e-mail: common-dev-unsubscr...

Re: ${!var} In Scripts

> On Mar 4, 2019, at 9:33 AM, Daniel Templeton wrote: > > Thanks! That's not even close to what the docs suggest it does--no idea > what's up with that. It does. Here’s the paragraph: "If the first character of parameter is an exclamation point (!), a level of variable indirection

Re: ${!var} In Scripts

> On Mar 1, 2019, at 3:04 PM, Daniel Templeton wrote: > > There are a bunch of uses of the bash syntax, "${!var}", in the Hadoop > scripts. Can anyone explain to me what that syntax was supposed to achieve? #!/usr/bin/env bash j="hi" m="bye" k=j echo ${!k} k=m echo ${!k}

[jira] [Resolved] (HADOOP-16035) Jenkinsfile for Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-16035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-16035. --- Resolution: Fixed Fix Version/s: 3.3.0 > Jenkinsfile for Had

[jira] [Created] (HADOOP-16035) test yetus master

Allen Wittenauer created HADOOP-16035: - Summary: test yetus master Key: HADOOP-16035 URL: https://issues.apache.org/jira/browse/HADOOP-16035 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-11688) Implement a native library version of IdMappingServiceProvider

[ https://issues.apache.org/jira/browse/HADOOP-11688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11688. --- Resolution: Won't Fix > Implement a native library ve

[jira] [Resolved] (HADOOP-9522) web interfaces are not logged until after opening

[ https://issues.apache.org/jira/browse/HADOOP-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-9522. -- Resolution: Won't Fix > web interfaces are not logged until after

[jira] [Resolved] (HADOOP-10807) GenericOptionsParser needs updating for Hadoop 2.x+

[ https://issues.apache.org/jira/browse/HADOOP-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-10807. --- Resolution: Won't Fix > GenericOptionsParser needs updating for Ha

[jira] [Resolved] (HADOOP-10878) Hadoop servlets need ACLs

[ https://issues.apache.org/jira/browse/HADOOP-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-10878. --- Resolution: Won't Fix > Hadoop servlets n

[jira] [Resolved] (HADOOP-9874) hadoop.security.logger output goes to both logs

[ https://issues.apache.org/jira/browse/HADOOP-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-9874. -- Resolution: Won't Fix > hadoop.security.logger output goes to b

[jira] [Resolved] (HADOOP-10901) provide un-camelCased versions of shell commands

[ https://issues.apache.org/jira/browse/HADOOP-10901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-10901. --- Resolution: Won't Fix > provide un-camelCased versions of shell

[jira] [Resolved] (HADOOP-11027) HADOOP_SECURE_COMMAND catch-all

[ https://issues.apache.org/jira/browse/HADOOP-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11027. --- Resolution: Won't Fix > HADOOP_SECURE_COMMAND c

[jira] [Resolved] (HADOOP-11131) getUsersForNetgroupCommand doesn't work for OS X

[ https://issues.apache.org/jira/browse/HADOOP-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11131. --- Resolution: Won't Fix > getUsersForNetgroupCommand doesn't

[jira] [Resolved] (HADOOP-11137) put up guard rails around pid and log file handling

[ https://issues.apache.org/jira/browse/HADOOP-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11137. --- Resolution: Won't Fix > put up guard rails around pid and log file

[jira] [Resolved] (HADOOP-11121) native libraries guide is extremely out of date

[ https://issues.apache.org/jira/browse/HADOOP-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11121. --- Resolution: Won't Fix > native libraries guide is extremely out

[jira] [Resolved] (HADOOP-11696) update compatibility documentation to reflect only API changes matter

[ https://issues.apache.org/jira/browse/HADOOP-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11696. --- Resolution: Won't Fix > update compatibility documentation to reflect

[jira] [Resolved] (HADOOP-11689) Code reduction: ShellBasedIdMapping vs. ShellBasedUnixGroupsMapping

[ https://issues.apache.org/jira/browse/HADOOP-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11689. --- Resolution: Won't Fix > Code reduction: ShellBasedIdMa

[jira] [Resolved] (HADOOP-11690) Groups vs. IdMappingServiceProvider

[ https://issues.apache.org/jira/browse/HADOOP-11690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11690. --- Resolution: Won't Fix > Groups vs. IdMappingService

[jira] [Resolved] (HADOOP-11882) Audit all of the findbugs excludes

[ https://issues.apache.org/jira/browse/HADOOP-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11882. --- Resolution: Won't Fix > Audit all of the findbugs

[jira] [Resolved] (HADOOP-11964) determine-flaky-tests makes invalid test assumptions

[ https://issues.apache.org/jira/browse/HADOOP-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11964. --- Resolution: Won't Fix > determine-flaky-tests makes invalid test ass

[jira] [Resolved] (HADOOP-12389) allow self-impersonation

[ https://issues.apache.org/jira/browse/HADOOP-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12389. --- Resolution: Won't Fix Target Version/s: (was: ) > al

[jira] [Resolved] (HADOOP-12558) distcp documentation is woefully out of date

[ https://issues.apache.org/jira/browse/HADOOP-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12558. --- Resolution: Won't Fix > distcp documentation is woefully out

[jira] [Resolved] (HADOOP-12578) Update hadoop_env_checks.sh to track changes from boot2docker to docker-machine

[ https://issues.apache.org/jira/browse/HADOOP-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12578. --- Resolution: Won't Fix > Update hadoop_env_checks.sh to track chan

[jira] [Resolved] (HADOOP-12606) OS X native unit tests fail due to libjvm link errors

[ https://issues.apache.org/jira/browse/HADOOP-12606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12606. --- Resolution: Won't Fix > OS X native unit tests fail due to libjvm lin

[jira] [Resolved] (HADOOP-12650) Document all of the secret env vars

[ https://issues.apache.org/jira/browse/HADOOP-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12650. --- Resolution: Won't Fix > Document all of the secret

[jira] [Resolved] (HADOOP-12865) hadoop-datajoin should be documented or dropped

[ https://issues.apache.org/jira/browse/HADOOP-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12865. --- Resolution: Won't Fix Target Version/s: (was: ) > hadoop-

[jira] [Resolved] (HADOOP-12867) clean up how rumen and sls are executed

[ https://issues.apache.org/jira/browse/HADOOP-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12867. --- Resolution: Won't Fix Target Version/s: (was: ) > clean up h

[jira] [Resolved] (HADOOP-13176) testDanglingLink fails on OS X

[ https://issues.apache.org/jira/browse/HADOOP-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13176. --- Resolution: Won't Fix > testDanglingLink fails

[jira] [Resolved] (HADOOP-13250) jdiff and dependency reports aren't linked in site web pages

[ https://issues.apache.org/jira/browse/HADOOP-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13250. --- Resolution: Won't Fix > jdiff and dependency reports aren't linke

[jira] [Resolved] (HADOOP-13495) create-release should allow a user-supplied Dockerfile

[ https://issues.apache.org/jira/browse/HADOOP-13495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13495. --- Resolution: Won't Fix > create-release should allow a user-supplied Do

[jira] [Resolved] (HADOOP-13490) create-release should not fail rat checks unless --asfrelease is used

[ https://issues.apache.org/jira/browse/HADOOP-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13490. --- Resolution: Won't Fix > create-release should not fail rat check

[jira] [Resolved] (HADOOP-13957) prevent bad PATHs

[ https://issues.apache.org/jira/browse/HADOOP-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13957. --- Resolution: Won't Fix > prevent b

[jira] [Resolved] (HADOOP-14011) fix the remaining shelldoc errors

[ https://issues.apache.org/jira/browse/HADOOP-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14011. --- Resolution: Won't Fix > fix the remaining shelldo

[jira] [Resolved] (HADOOP-14016) add license and notice verifaction to create-release

[ https://issues.apache.org/jira/browse/HADOOP-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14016. --- Resolution: Won't Fix > add license and notice verifaction to create

[jira] [Resolved] (HADOOP-14378) Upgrade to maven-site-plugin 3.6

[ https://issues.apache.org/jira/browse/HADOOP-14378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14378. --- Resolution: Won't Fix > Upgrade to maven-site-pl

[jira] [Resolved] (HADOOP-14664) TestCodec's sequenceFileCodecTest doesn't use correct directory

[ https://issues.apache.org/jira/browse/HADOOP-14664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14664. --- Resolution: Won't Fix > TestCodec's sequenceFileCodecTest doesn&

[jira] [Resolved] (HADOOP-15617) Reduce node.js and npm package loading in the Dockerfile

[ https://issues.apache.org/jira/browse/HADOOP-15617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-15617. --- Resolution: Won't Fix > Reduce node.js and npm package loading in the Do

[jira] [Resolved] (HADOOP-15309) default maven in path under start-build-env.sh is the wrong one

[ https://issues.apache.org/jira/browse/HADOOP-15309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-15309. --- Resolution: Won't Fix > default maven in path under start-build-env.s

[jira] [Resolved] (HADOOP-14009) dev-support/bin should use hadoop-functions.sh

[ https://issues.apache.org/jira/browse/HADOOP-14009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14009. --- Resolution: Won't Fix > dev-support/bin should use hadoop-func

[jira] [Resolved] (HADOOP-14224) add dnsutils to Dockerfile to aid in debugging maven repo failures

[ https://issues.apache.org/jira/browse/HADOOP-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14224. --- Resolution: Won't Fix > add dnsutils to Dockerfile to aid in debugging ma

[jira] [Resolved] (HADOOP-14724) Get a daily QBT run for Windows

[ https://issues.apache.org/jira/browse/HADOOP-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14724. --- Resolution: Fixed Was fixed for quite a while, now appears to be broken again. Oh

[jira] [Resolved] (HADOOP-14830) Write some non-Docker-based instructions on how to build on Mac OS X

[ https://issues.apache.org/jira/browse/HADOOP-14830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14830. --- Resolution: Won't Fix > Write some non-Docker-based instructions on how

Re: Checkstyle shows false positive report

> On Aug 15, 2018, at 4:49 AM, Kitti Nánási > wrote: > > Hi All, > > We noticed that the checkstyle run by the pre commit job started to show > false positive reports, so I created HADOOP-15665 > . > > Until that is fixed, keep in mind to r

Re: [DISCUSS] Alpha Release of Ozone

> On Aug 8, 2018, at 12:56 PM, Anu Engineer wrote: > >> Has anyone verified that a Hadoop release doesn't have _any_ of the extra >> ozone bits that are sprinkled outside the maven modules? > As far as I know that is the state, we have had multiple Hadoop releases > after ozone has been merg

Re: [DISCUSS] Alpha Release of Ozone

Given that there are some Ozone components spread out past the core maven modules, is the plan to release a Hadoop Trunk + Ozone tar ball or is more work going to go into segregating the Ozone components prior to release? Has anyone verified that a Hadoop release doesn't have _any_ of the extr

[jira] [Resolved] (HADOOP-15653) Please add OWASP Dependency Check to the build (pom.xml)

[ https://issues.apache.org/jira/browse/HADOOP-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-15653. --- Resolution: Implemented Closing this as implemented. > Please add OW

[jira] [Created] (HADOOP-15647) dependency checker test

Allen Wittenauer created HADOOP-15647: - Summary: dependency checker test Key: HADOOP-15647 URL: https://issues.apache.org/jira/browse/HADOOP-15647 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-15617) Reduce node.js and npm package loading in the Dockerfile

Allen Wittenauer created HADOOP-15617: - Summary: Reduce node.js and npm package loading in the Dockerfile Key: HADOOP-15617 URL: https://issues.apache.org/jira/browse/HADOOP-15617 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

> On Jun 7, 2018, at 11:47 AM, Steve Loughran wrote: > > Actually, Yongjun has been really good at helping me get set up for a 2.7.7 > release, including "things you need to do to get GPG working in the docker > image” *shrugs* I use a different release script after some changes broke

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

> On Jun 7, 2018, at 3:46 AM, Lokesh Jain wrote: > > Hi Yongjun > > I followed Nanda’s steps and I see the same issues as reported by Nanda. This situation is looking like an excellent opportunity for PMC members to mentor people on how the build works since it’s apparent that three days la

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

> On May 15, 2018, at 10:16 AM, Chris Douglas wrote: > > They've been failing for a long time. It can't install bats, and > that's fatal? -C The bats error is new and causes the build to fail enough that it produces the email output. For the past few months, it hasn’t been producing

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

FYI: I’m going to disable the branch-2 nightly jobs. - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [NOTIFICATION] Hadoop trunk rebased

Did the patch that fixes the mountain of maven warnings get missed? > On Apr 26, 2018, at 11:52 PM, Akira Ajisaka wrote: > > + common-dev and mapreduce-dev > > On 2018/04/27 6:23, Owen O'Malley wrote: >> As we discussed in hdfs-dev@hadoop, I did a force push to Hadoop's trunk to >> replace the

Fwd: Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

For my part of the HDFS bug bash, I’ve gotten the ASF Windows build working again. Starting tomorrow, results will be sent to the *-dev lists. A few notes: * It only runs the unit tests. There’s not much point in running the other Yetus plugins since those are covered by the Linux one

[jira] [Created] (HADOOP-15309) default maven in path under start-build-env.sh is the wrong one

Allen Wittenauer created HADOOP-15309: - Summary: default maven in path under start-build-env.sh is the wrong one Key: HADOOP-15309 URL: https://issues.apache.org/jira/browse/HADOOP-15309 Project

[jira] [Created] (HADOOP-15279) increase maven heap size recommendations

Allen Wittenauer created HADOOP-15279: - Summary: increase maven heap size recommendations Key: HADOOP-15279 URL: https://issues.apache.org/jira/browse/HADOOP-15279 Project: Hadoop Common

[jira] [Resolved] (HADOOP-9085) start namenode failure,bacause pid of namenode pid file is other process pid or thread id before start namenode

[ https://issues.apache.org/jira/browse/HADOOP-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-9085. -- Resolution: Duplicate Target Version/s: 2.0.2-alpha, 2.0.1-alpha (was: 2.0.1

Switched PreCommit-Admin over to Apache Yetus

bcc: bui...@apache.org, d...@hbase.apache.org, d...@hive.apache.org, common-dev@hadoop.apache.org, d...@phoenix.apache.org, d...@oozie.apache.org (These are all of the projects that had pending issues. This is not all of the groups that actually rely upon this code...) The rece

Re: PreCommit-Admin fails to fetch issue list from jira

> On Jan 16, 2018, at 1:41 PM, Vihang Karajgaonkar wrote: > > yes, thats correct. I had created > https://issues.apache.org/jira/browse/INFRA-15849 to get that fixed. But > looks like based on the comment there we need to modify that job to use REST > instead of SOAP? I think there

Re: PreCommit-Admin fails to fetch issue list from jira

> On Jan 16, 2018, at 1:27 PM, Vihang Karajgaonkar wrote: > > Hive pre-commit jobs are broken as well since the JIRA upgrade. Did you have > to make any changes to hadoop-precommit job to make it work? Any pointers > will help us fix ours as well. Until precommit-admin gets fixed, no

Re: PreCommit-Admin fails to fetch issue list from jira

FWIW, the new JIRA has broken a few things thus far. Akira fixed an issue with test-patch and I’ve got a fix for precommit-admin as part of YETUS-594. As soon as it and YETUS-592 gets a review+commit, I’ll start the 0.7.0 release process. Also, as a reminder, Apache Yetus uses +1’s from cont

Re: [ANNOUNCE] Apache Hadoop 3.0.0 GA is released

It’s significantly more concerning that 3.0.0-beta1 doesn’t show up here: http://hadoop.apache.org/docs/r3.0.0/hadoop-project-dist/hadoop-common/release/index.html It looks like they are missing from the source tag too. I wonder what else is missing. > On Dec 18, 2017, at 11:15 AM, Andrew Wa

Re: Same jenkins build running on 2 patches.

> On Dec 1, 2017, at 1:36 PM, Jason Lowe wrote: > I thought the admin precommit build was kicking off the project-specific > precommit build with an attachment ID argument so the project precommit can > be consistent with the admin precommit build on what triggered the precommit > process.

Re: Same jenkins build running on 2 patches.

> On Dec 1, 2017, at 12:18 PM, Rushabh Shah wrote: > Can someone explain me what happened ? Yetus downloaded the patch to make sure it applied before bothering to do anything else to make sure it wasn’t going to burn cycles on the build boxes for no reason. Docker mode was active so i

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

> On Nov 30, 2017, at 1:07 AM, Rohith Sharma K S > wrote: > > > >. If ATSv1 isn’t replaced by ATSv2, then why is it marked deprecated? > Ideally it should not be. Can you point out where it is marked as deprecated? > If it is in historyserver daemon start, that change made very long back when

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

> On Nov 21, 2017, at 2:16 PM, Vinod Kumar Vavilapalli > wrote: > >>> - $HADOOP_YARN_HOME/sbin/yarn-daemon.sh start historyserver doesn't even >>> work. Not just deprecated in favor of timelineserver as was advertised. >> >> This works for me in trunk and the bash code doesn’t appear to

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

The original release script and instructions broke the build up into three or so steps. When I rewrote it, I kept that same model. It’s probably time to re-think that. In particular, it should probably be one big step that even does the maven deploy. There’s really no harm in doing th

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/599/ [Nov 19, 2017 8:39:37 PM] (aw) HADOOP-13514. Upgrade maven surefire plugin to 2.20.1 -1 overall The following subsystems voted -1: asflicense findbugs unit The following subsystems voted -1 but w

[jira] [Resolved] (HADOOP-7410) Mavenize common RPM/DEB

[ https://issues.apache.org/jira/browse/HADOOP-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-7410. -- Resolution: Won't Fix > Mavenize common

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

> On Nov 3, 2017, at 12:08 PM, Stack wrote: > > On Sat, Oct 28, 2017 at 2:00 PM, Konstantin Shvachko > wrote: > >> It is an interesting question whether Ozone should be a part of Hadoop. > > I don't see a direct answer to this question. Is there one? Pardon me if > I've not seen it but I'm in

[jira] [Created] (HADOOP-15010) hadoop-resourceestimator's assembly buries it

Allen Wittenauer created HADOOP-15010: - Summary: hadoop-resourceestimator's assembly buries it Key: HADOOP-15010 URL: https://issues.apache.org/jira/browse/HADOOP-15010 Project: Hadoop C

[jira] [Created] (HADOOP-15009) hadoop-resourceestimator's shell scripts are a mess

Allen Wittenauer created HADOOP-15009: - Summary: hadoop-resourceestimator's shell scripts are a mess Key: HADOOP-15009 URL: https://issues.apache.org/jira/browse/HADOOP-15009 Project: H

FYI: While JIRA is down...

… I’m going to rework the precommit jobs to use the branch of Yetus with the process and memory limit protections. - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-

[jira] [Created] (HADOOP-14977) Xenial dockerfile needs ant

Allen Wittenauer created HADOOP-14977: - Summary: Xenial dockerfile needs ant Key: HADOOP-14977 URL: https://issues.apache.org/jira/browse/HADOOP-14977 Project: Hadoop Common Issue Type

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

> On Oct 24, 2017, at 4:10 PM, Andrew Wang wrote: > > FWIW we've been running branch-3.0 unit tests successfully internally, though > we have separate jobs for Common, HDFS, YARN, and MR. The failures here are > probably a property of running everything in the same JVM, which I've found > pro

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

t tell which daemons/components of HDFS consumes unexpected high >> memory. Don't sounds like a solid bug report to me. >> >> >> >> Thanks,? >> >> >> Junping >> >> >> >> From: Sean Bus

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

> On Oct 23, 2017, at 12:50 PM, Allen Wittenauer > wrote: > > > > With no other information or access to go on, my current hunch is that one of > the HDFS unit tests is ballooning in memory size. The easiest way to kill a > Linux machine is to eat all of the RAM,

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

. > > Thanks, > Subru > > On Mon, Oct 23, 2017 at 11:26 AM, Vrushali C wrote: > Hi Allen, > > I have filed https://issues.apache.org/jira/browse/YARN-7380 for the > timeline service findbugs warnings. > > thanks > Vrushali > > > On Mon, Oct 23, 2017

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

I’m really confused why this causes the Yahoo! QA boxes to go catatonic (!?!) during the run. As in, never come back online, probably in a kernel panic. It’s pretty consistently in hadoop-hdfs, so something is going wrong there… is branch-2 hdfs behaving badly? Someone needs to run the hadoop

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

To whoever set this up: There was a job config problem where the Jenkins branch parameter wasn’t passed to Yetus. Therefore both of these reports have been against trunk. I’ve fixed this job (as well as the other jobs) to honor that parameter. I’ve kicked off a new run with these changes.

[jira] [Resolved] (HADOOP-14961) Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed

[ https://issues.apache.org/jira/browse/HADOOP-14961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14961. --- Resolution: Fixed > Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8

[jira] [Created] (HADOOP-14945) create-release should work on jenkins

Allen Wittenauer created HADOOP-14945: - Summary: create-release should work on jenkins Key: HADOOP-14945 URL: https://issues.apache.org/jira/browse/HADOOP-14945 Project: Hadoop Common

YARN native services Re: 2017-10-06 Hadoop 3 release status update

> On Oct 6, 2017, at 5:51 PM, Eric Yang wrote: > yarn application -deploy –f spec.json > yarn application -stop > yarn application -restart > yarn application -remove > > and > > yarn application –list will display both application list from RM as well as > docker services?

Re: 2017-10-06 Hadoop 3 release status update

> On Oct 6, 2017, at 1:31 PM, Andrew Wang wrote: > > - Still waiting on Allen to review YARN native services feature. Fake news. I’m still -1 on it, at least prior to a patch that posted late yesterday. I’ll probably have a chance to play with it early next week. Key pro

[jira] [Created] (HADOOP-14908) CrossOriginFilter should trigger regex on more input

Allen Wittenauer created HADOOP-14908: - Summary: CrossOriginFilter should trigger regex on more input Key: HADOOP-14908 URL: https://issues.apache.org/jira/browse/HADOOP-14908 Project: Hadoop

[jira] [Resolved] (HADOOP-14874) Secure NFS and DataNode related environment variable need to be added as hadoop_deprecate_envvar in hdfs_config.sh

[ https://issues.apache.org/jira/browse/HADOOP-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14874. --- Resolution: Invalid I'm going to close this as invalid since deprecation war

Re: Trunk fails

> On Sep 19, 2017, at 6:48 AM, Brahma Reddy Battula > wrote: > > Can we run "mvn install" and "compile" for all the modules after applying the > patch(we can skip shadeclients) We need to get over this idea that precommit is going to find all problems every time. Committers actually

Re: qbt is failiing///RE: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

> On Sep 19, 2017, at 6:35 AM, Brahma Reddy Battula > wrote: > > qbt is failing from two days with following errors, any idea on this..? Nothing to be too concerned about. This is what it looks like when a build server gets bounced or crashed. INFRA team knows our jobs take

[jira] [Created] (HADOOP-14873) CentOS 6.6 + gcc 4.4 + cmake 3.1 don't get C99

Allen Wittenauer created HADOOP-14873: - Summary: CentOS 6.6 + gcc 4.4 + cmake 3.1 don't get C99 Key: HADOOP-14873 URL: https://issues.apache.org/jira/browse/HADOOP-14873 Project: Hadoop C

Re: [DISCUSS] Can we make our precommit test robust to dependency changes while staying usable?

> On Sep 14, 2017, at 11:01 AM, Sean Busbey wrote: > >> Committers MUST check the qbt output after a commit. They MUST make sure > their commit didn’t break something new. > > How do we make this easier / more likely to happen? > > For example, I don't see any notice on HADOOP-14654 that the

Re: [DISCUSS] Can we make our precommit test robust to dependency changes while staying usable?

> On Sep 14, 2017, at 8:03 AM, Sean Busbey wrote: > > * HADOOP-14654 updated commons-httplient to a new patch release in > hadoop-project > * Precommit checked the modules that changed (i.e. not many) > * nightly had Azure support break due to a change in behavior. OK, so it worked as c

Re: [VOTE] Merge yarn-native-services branch into trunk

> On Sep 8, 2017, at 9:25 AM, Jian He wrote: > > Hi Allen, > The documentations are committed. Please check QuickStart.md and others in > the same folder. > YarnCommands.md doc is updated to include new commands. > DNS default port is also documented. > Would you like to give a look and see if

Patch testing on Windows [BETA]

I’m a little hesitant to share this because it’s really Not Quite Ready for primetime, but I figured others might want to play with it early anyway. https://builds.apache.org/view/H-L/view/Hadoop/job/Precommit-hadoop-win/ Will let you test patches on Wi

Fwd: Moving Java Forward Faster

> Begin forwarded message: > > From: "Rory O'Donnell" > Subject: Moving Java Forward Faster > Date: September 7, 2017 at 2:12:45 AM PDT > To: "strub...@yahoo.de >> Mark Struberg" > Cc: rory.odonn...@oracle.com, abdul.kolarku...@oracle.com, > balchandra.vai...@oracle.com, dalibor.to...@oracle.

Re: [VOTE] Merge yarn-native-services branch into trunk

> On Sep 5, 2017, at 6:23 PM, Jian He wrote: > >> If it doesn’t have all the bells and whistles, then it shouldn’t be on >> port 53 by default. > Sure, I’ll change the default port to not use 53 and document it. >> *how* is it getting launched on a privileged port? It sounds like the

Re: why the doxia-snapshot dependency

> On Sep 6, 2017, at 9:53 AM, Steve Loughran wrote: > > Well, it turns out not to like depth-4 MD tags, of the form : DOXIA-533 > , though that looks like a long-standing issue, not a regression Yup. > workaround: don't use level4 titles. And do check locally before bothering to

Re: why the doxia-snapshot dependency

> On Sep 6, 2017, at 7:20 AM, Steve Loughran wrote: > > > Every morning my laptop downloads the doxia 1.8 snapshot for its build > > …. > This implies that the build isn't reproducible, which isn't that bad for a > short-lived dev branch, but not what we want for any releases Thi

Re: [VOTE] Merge yarn-native-services branch into trunk

> On Sep 5, 2017, at 3:12 PM, Gour Saha wrote: > > 2) Lots of markdown problems in the NativeServicesDiscovery.md document. > This includes things like Œyarnsite.xml¹ (missing a dash.) > > The md patch uploaded to YARN-5244 had some special chars. I fixed those > in YARN-7161. It’s a

  1   2   3   4   5   6   7   8   9   10   >