Re: [vpp-dev] build queue backed up a bit foo

2018-09-10 Thread Ed Kern via Lists.Fd.Io
after a couple hours of testing on the sandbox and getting good builds I went with option 1 for now. (Should be getting merged as I type). If we run into any more issues Ill remove the job from the main gerrit trigger so builds will only be started via comment. Ed On Sep 10, 2018, at 12:48

Re: [vpp-dev] build queue backed up a bit foo

2018-09-10 Thread Florin Coras
If 1 makes the arm jobs pass and supposedly run much faster, I’d be fine with that as well. Florin > On Sep 10, 2018, at 7:48 AM, Marco Varlese wrote: > > On Mon, 2018-09-10 at 14:29 +, Ed Kern (ejk) wrote: >> At least three different possible actions to take at this point: (outside >>

Re: [vpp-dev] build queue backed up a bit foo

2018-09-10 Thread Marco Varlese
Obviously I meant "does NOT add any meaningful insight..." On Mon, 2018-09-10 at 16:48 +0200, Marco Varlese wrote: > On Mon, 2018-09-10 at 14:29 +, Ed Kern (ejk) wrote: > > At least three different possible actions to take at this point: (outside > > of fixing the issue) > > > > > > > > >

Re: [vpp-dev] build queue backed up a bit foo

2018-09-10 Thread Marco Varlese
On Mon, 2018-09-10 at 14:29 +, Ed Kern (ejk) wrote: > At least three different possible actions to take at this point: (outside of > fixing the issue) > > > > > 1. remove make test attempt from arm build (return it to the way it was before > a week ago). > > 2. lower timeout further my fi

Re: [vpp-dev] build queue backed up a bit foo

2018-09-10 Thread Ed Kern via Lists.Fd.Io
At least three different possible actions to take at this point: (outside of fixing the issue) 1. remove make test attempt from arm build (return it to the way it was before a week ago). 2. lower timeout further my first thought would be in the 75 minute range (from 120) 3. remove job altogeth

Re: [vpp-dev] build queue backed up a bit foo

2018-09-10 Thread Marco Varlese
Last example (today) can be found here 10:47:06 Not running extended tests (some tests will be skipped) 10:47:06 Perform 4 attempts to pass the suite... 10:47:10 *** Error in `python': double free or corruption (out): 0x75d483f0 *** 12:27:54 Build timed out (after 120 minutes). Marking the

Re: [vpp-dev] build queue backed up a bit foo

2018-09-07 Thread Ole Troan
At least for Arm it would be nice with a quite short timeout. Ole > On 7 Sep 2018, at 21:04, Florin Coras wrote: > > ARM jobs have not been working for some days now. That’s why their result is > skipped. Timeout is 2h but probably we should drop that even further … > > Florin > >> On Sep

Re: [vpp-dev] build queue backed up a bit foo

2018-09-07 Thread Florin Coras
ARM jobs have not been working for some days now. That’s why their result is skipped. Timeout is 2h but probably we should drop that even further … Florin > On Sep 7, 2018, at 11:59 AM, Ole Troan wrote: > > Trying out a change in: > https://gerrit.fd.io/r/#/c/14732/

Re: [vpp-dev] build queue backed up a bit foo

2018-09-07 Thread Ole Troan
Trying out a change in: https://gerrit.fd.io/r/#/c/14732/ All others succeed but ARM this doesn’t look too good. Stuck apparently. https://jenkins.fd.io/job/vpp-arm-verify-master-ubuntu1604/2157/console 20:16:04 == 20:1

Re: [vpp-dev] build queue backed up a bit foo

2018-09-07 Thread Ole Troan
Ed, Let me take a closer look at these. It appears if VPP is slow to start it might not have created the socket yet. Let me try to put in a retry loop and see if that fixes verify. Cheers Ole > On 7 Sep 2018, at 18:06, Ed Kern via Lists.Fd.Io > wrote: > > make test failures due to the belo

[vpp-dev] build queue backed up a bit foo

2018-09-07 Thread Ed Kern via Lists.Fd.Io
make test failures due to the below causing pretty consistent failures. Note: For whatever reason the failures are not 100%. The failures and with the retries on nonconcurrent merge jobs may lead to long build queues. These are not infra issues but ill be keeping an eye on it. Ed 13:08