Hello Marco, Regarding failure of vpp-csit-verify-virl-master job - the issue is not the TC mentioned by you below. "TC02: DUT reports packet flow for traffic with local destination address" is also marked as non-critical as it is expected to fail now. You can see it in the console log too:
08:00:53 TC02: DUT reports packet flow for traffic with local destination address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | FAIL | 08:00:53 Traffic script execution failed 08:00:53 ---------------------------------------------------------------------------------------------------------------------------------------- 08:01:22 TC03: DUT reports packet flow for traffic with remote destination address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure ... | PASS | 08:01:22 ---------------------------------------------------------------------------------------------------------------------------------------- 08:01:22 Tests.Vpp.Func.Telemetry.Eth2P-Ethip6-Ip6Base-Ip6Ipfixbase-Func :: *IPFIX ipv6 test cases* | PASS | 08:01:22 0 critical tests, 0 passed, 0 failed 08:01:22 3 tests total, 2 passed, 1 failed => there is no critical test failure (only critical tests can block the verification) The failed test is " Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func .TC01: VPP policer 2R3C Color-aware marks packet": 08:07:42 TC01: VPP policer 2R3C Color-aware marks packet :: [Top] TG=DUT1. [ WARN ] Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - TC01: VPP policer 2R3C Color-aware marks packet 08:07:42 The VPP PIDs are not equal! 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792} 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 6792} 08:07:42 Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - TC01: VPP policer 2R3C Color-aware marks packet 08:07:42 The VPP PIDs are not equal! 08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792} 08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 6792} 08:07:42 | FAIL | 08:07:42 Teardown failed: 08:07:42 SSHTimeout: Timeout exception. 08:07:42 Current contents of stdout buffer: 08:07:42 Current contents of stderr buffer: It seems that there was VPP restart during execution of this test. Regards, Jan -----Original Message----- From: Marco Varlese [mailto:marco.varl...@suse.com] Sent: Wednesday, October 11, 2017 10:49 To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) <jgel...@cisco.com>; Ed Kern (ejk) <e...@cisco.com> Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io Subject: Re: [vpp-dev] Test failing Today I can't get a build +1 Verified. Different sort of errors and completely random... https://jenkins.fd.io/job/vpp-verify-master-centos7/7520/console 07:11:39 make[2]: Leaving directory `/w/workspace/vpp-verify-master- centos7/dpdk' 07:11:39 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm 07:11:39 ######################################## 07:11:39 package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer than vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed 07:11:39 make[1]: *** [install-rpm] Error 2 07:11:39 make[1]: Leaving directory `/w/workspace/vpp-verify-master- centos7/dpdk' 07:11:39 make: *** [dpdk-install-dev] Error 2 07:11:39 Build step 'Execute shell' marked build as failure https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7533/console 08:29:44 08:00:53 TC02: DUT reports packet flow for traffic with local destination address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | FAIL | 08:29:44 08:00:53 Traffic script execution failed 08:29:44 ================================================================================ 08:29:44 Final result of all test loops: | FAIL | 08:29:44 1 critical test has failed. 08:29:44 ================================================================================ - Marco On Mon, 2017-10-09 at 07:26 +0000, Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) wrote: > Hello Marco, > > I had a look on the test case log > (https://jenkins.fd.io/job/vpp-csit-verify-v > irl-master/7480/robot/report/log.html) - it's always the best action > you can do to check what test case really caused the failure as there > are some tests expected to fail because of non-fixed issues in VPP - > and failed test is > > TEST TC01: Route IPv4 packet through LISP with Bridge Domain setup. > > Where no running VPP was detected (no VPP pid returned) during the > test case setup phase. > > Regards, > Jan > > -----Original Message----- > From: Marco Varlese [mailto:marco.varl...@suse.com] > Sent: Monday, October 09, 2017 09:04 > To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) > <jgel...@cisco.co > m>; Ed Kern (ejk) <e...@cisco.com> > Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io > Subject: Re: [vpp-dev] Test failing > > Please, take a look at this logs: > > https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7480/console > > After Ed and yourself mentioned it... maybe the cause of the failure > is linked to this failure instead? > 14:32:52 14:11:12 Tests.Vpp.Func.Ip4 Tunnels.Lisp.Eth2P-Ethip4Lisp- > L2Bdbasemaclrn-Func :: *ip4-lispgpe-ip4 encapsulation test > cases* | > FAIL | > 14:32:52 14:11:12 1 critical test, 0 passed, 1 failed > 14:32:52 14:11:12 1 test total, 0 passed, 1 failed > > > Cheers, > Marco > > On Fri, 2017-10-06 at 15:49 +0000, Jan Gelety -X (jgelety - PANTHEON > TECHNOLOGIES at Cisco) wrote: > > + csit-dev > > > > Hello Marco, > > > > The mentioned test case is not responsible for -1 in verification as > > this test case is marked as non-critical. Please, provide links to > > affected jobs to find which TC is really failing. > > > > Thanks, > > Jan > > > > -----Original Message----- > > From: vpp-dev-boun...@lists.fd.io > > [mailto:vpp-dev-boun...@lists.fd.io] > > On Behalf Of Ed Kern (ejk) > > Sent: Friday, October 06, 2017 17:07 > > To: Marco Varlese <marco.varl...@suse.com> > > Cc: vpp-dev@lists.fd.io > > Subject: Re: [vpp-dev] Test failing > > > > could you throw me some example jobs? > > > > thanks, > > > > Ed > > > > > > > On Oct 6, 2017, at 8:54 AM, Marco Varlese <marco.varl...@suse.com> wrote: > > > > > > Hi all, > > > > > > I have seen this many times these days... > > > I wonder if it's a infra hiccup or something is really broken? > > > > > > The "recheck" is becoming the norm to get a clean +1 Verified... > > > :( > > > > > > 14:32:52 14:00:32 TC04: VPP doesn't send DHCPv4 REQUEST after > > > OFFER with wrong > > > XID :: Configure DHCPv4 client on interface to TG. If server | FAIL > > > | > > > 14:32:52 14:00:32 Expected error 'DHCP REQUEST Rx timeout' but got > > > 'Traffic script execution failed'. > > > > > > > > > Cheers, > > > Marco > > > _______________________________________________ > > > vpp-dev mailing list > > > vpp-dev@lists.fd.io > > > https://lists.fd.io/mailman/listinfo/vpp-dev > > > > _______________________________________________ > > vpp-dev mailing list > > vpp-dev@lists.fd.io > > https://lists.fd.io/mailman/listinfo/vpp-dev > > _______________________________________________ vpp-dev mailing list vpp-dev@lists.fd.io https://lists.fd.io/mailman/listinfo/vpp-dev