Re: HBase nightly job failing forever

2018-07-25 Thread Allen Wittenauer
> On Jul 25, 2018, at 10:48 AM, Chris Lambertus wrote: > > On-demand resources are certainly being considered (and we had these in the > past,) but I will point out that ephemeral (“on-demand”) cloud builds are in > direct opposition to some of the points brought up by Allen in the other > j

Re: HBase nightly job failing forever

2018-07-25 Thread Chris Lambertus
> On Jul 25, 2018, at 10:34 AM, Andrew Purtell wrote: > > public clouds instead. I'm not sure if the ASF is set up to manage on > demand billing for test resources but this could be advantageous. It would > track actual usage not fixed costs. To avoid budget overrun there would be > caps and l

Re: HBase nightly job failing forever

2018-07-25 Thread Andrew Purtell
l" > To: ipv6g...@gmail.com > Cc: "Andrew Purtell" , "dev" , > builds@apache.org > Sent: Wednesday, July 25, 2018 12:22:08 PM > Subject: Re: HBase nightly job failing forever > > How does a targeted hardware donation work? I was under the impression that > ta

Re: HBase nightly job failing forever

2018-07-25 Thread Joan Touzet
.org Sent: Wednesday, July 25, 2018 12:22:08 PM Subject: Re: HBase nightly job failing forever How does a targeted hardware donation work? I was under the impression that targeted donations are not accepted by the ASF. Maybe it is different in infrastructure, but this is the first time I've he

Re: HBase nightly job failing forever

2018-07-25 Thread Bertrand Delacretaz
Hi, On Wed, Jul 25, 2018 at 6:22 PM Andrew Purtell wrote: > ...How does a targeted hardware donation work? I was under the impression that > targeted donations are not accepted by the ASF This has changed, last year IIRC - there's a bit of information at https://www.apache.org/foundation/con

Re: HBase nightly job failing forever

2018-07-25 Thread Andrew Purtell
How does a targeted hardware donation work? I was under the impression that targeted donations are not accepted by the ASF. Maybe it is different in infrastructure, but this is the first time I've heard of it. Who does the donation on those projects? DataStax for Cassandra? Who for CouchDB? Google

Re: HBase nightly job failing forever

2018-07-25 Thread Greg Stein
On Wed, Jul 25, 2018 at 2:36 AM Robert Munteanu wrote: > Hi, > > On Wed, 2018-07-25 at 09:27 +1000, Gav wrote: > > Disk space issues , yes, not on most of the Hadoop and related > > projects > > nodes - H0-H12 do not have disk space issues. As a Hadoop related > > project > > HBase should really

Re: HBase nightly job failing forever

2018-07-25 Thread Robert Munteanu
Hi, On Wed, 2018-07-25 at 09:27 +1000, Gav wrote: > Disk space issues , yes, not on most of the Hadoop and related > projects > nodes - H0-H12 do not have disk space issues. As a Hadoop related > project > HBase should really be concentrating its builds there. A suggestion from the sidelines. We

Re: HBase nightly job failing forever

2018-07-24 Thread Gav
Hi Andrew, On Wed, Jul 25, 2018 at 3:21 AM Andrew Purtell wrote: > Thanks for this note. > > I'm release managing the 1.4 release. I have been running the unit test > suite on reasonably endowed EC2 instances and there are no observed always > failing tests. A few can be flaky. In comparison the

Re: HBase nightly job failing forever

2018-07-24 Thread Andrew Purtell
Thanks for this note. I'm release managing the 1.4 release. I have been running the unit test suite on reasonably endowed EC2 instances and there are no observed always failing tests. A few can be flaky. In comparison the Apache test resources have been heavily resource constrained for years and f

Re: HBase nightly job failing forever

2018-07-24 Thread Allen Wittenauer
I suspect the bigger issue is that the hbase tests are running on the ‘ubuntu’ machines. Since they only have ~300GB for workspaces, the hbase tests are eating a significant majority of it and likely could be dying randomly due to space issues. [All the hbase workspace directories + the

Re: HBase nightly job failing forever

2018-07-24 Thread Josh Elser
Yep, sadly this is a very long tent-pole for us. There are many involved who have invested countless hours in making this better. Specific to that job you linked earlier, 3 test failures out of our total 4958 tests (0.06% failure rate) is all but "green" in my mind. I would ask that you keep t

Re: HBase nightly job failing forever

2018-07-24 Thread Gav
Ok, good enough, will wait, please also note 'master' branch and a few others have been failing for over a month also. I will check in again next month to see how things are progressing Thanks Gav... On Tue, Jul 24, 2018 at 1:19 AM Josh Elser wrote: > Hi Gav, > > Looking at the most recent r

Re: HBase nightly job failing forever

2018-07-23 Thread Josh Elser
Hi Gav, Looking at the most recent results, I see that the job failed because of two unit test failures. These are something that will be looked at prior to the next 1.4.x release which is about to get off the ground. I'd kindly request that you not disable the job. Thanks for trying to find

HBase nightly job failing forever

2018-07-22 Thread Gavin McDonald
https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/ can someone take a look into this, the job isnt much good if it is failing all the time and even worse if it is being ignored. Otherwise I'll disable the job in a dew days to release these wasted resources to builds that matter. --