Hello Marco,

Regarding failure of vpp-csit-verify-virl-master job - the issue is not the TC 
mentioned by you below. "TC02: DUT reports packet flow for traffic with local 
destination address" is also marked as non-critical as it is expected to fail 
now. You can see it in the console log too:

08:00:53 TC02: DUT reports packet flow for traffic with local destination 
address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | FAIL |
08:00:53 Traffic script execution failed
08:00:53 
----------------------------------------------------------------------------------------------------------------------------------------
08:01:22 TC03: DUT reports packet flow for traffic with remote destination 
address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure ... | PASS |
08:01:22 
----------------------------------------------------------------------------------------------------------------------------------------
08:01:22 Tests.Vpp.Func.Telemetry.Eth2P-Ethip6-Ip6Base-Ip6Ipfixbase-Func :: 
*IPFIX ipv6 test cases*                                      | PASS |
08:01:22 0 critical tests, 0 passed, 0 failed
08:01:22 3 tests total, 2 passed, 1 failed

=> there is no critical test failure (only critical tests can block the 
verification)


The failed test is " Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func .TC01: VPP 
policer 2R3C Color-aware marks packet":

08:07:42 TC01: VPP policer 2R3C Color-aware marks packet :: [Top] TG=DUT1.      
                                                       
[ WARN ] Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - TC01: 
VPP policer 2R3C Color-aware marks packet 
08:07:42 The VPP PIDs are not equal!
08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 6792}
08:07:42 Tests.Vpp.Func.Ip6.Eth2P-Ethip6-Ip6Base-Ipolicemarkbase-Func - TC01: 
VPP policer 2R3C Color-aware marks packet 
08:07:42 The VPP PIDs are not equal!
08:07:42 Test Setup VPP PIDs: {'10.30.52.214': 9591, '10.30.52.215': 6792}
08:07:42 Test Teardown VPP PIDs: {'10.30.52.214': 9863, '10.30.52.215': 6792}
08:07:42 | FAIL |
08:07:42 Teardown failed:
08:07:42 SSHTimeout: Timeout exception.
08:07:42 Current contents of stdout buffer: 
08:07:42 Current contents of stderr buffer:

It seems that there was VPP restart during execution of this test.

Regards,
Jan

-----Original Message-----
From: Marco Varlese [mailto:marco.varl...@suse.com] 
Sent: Wednesday, October 11, 2017 10:49
To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
<jgel...@cisco.com>; Ed Kern (ejk) <e...@cisco.com>
Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
Subject: Re: [vpp-dev] Test failing

Today I can't get a build +1 Verified.

Different sort of errors and completely random...

https://jenkins.fd.io/job/vpp-verify-master-centos7/7520/console
07:11:39 make[2]: Leaving directory `/w/workspace/vpp-verify-master- 
centos7/dpdk'
07:11:39 sudo rpm -Uih vpp-dpdk-devel-17.08-vpp1.x86_64.rpm
07:11:39 ########################################
07:11:39        package vpp-dpdk-devel-17.08-vpp2.x86_64 (which is newer than
vpp-dpdk-devel-17.08-vpp1.x86_64) is already installed
07:11:39 make[1]: *** [install-rpm] Error 2
07:11:39 make[1]: Leaving directory `/w/workspace/vpp-verify-master- 
centos7/dpdk'
07:11:39 make: *** [dpdk-install-dev] Error 2
07:11:39 Build step 'Execute shell' marked build as failure

https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7533/console
08:29:44 08:00:53 TC02: DUT reports packet flow for traffic with local 
destination address :: [Top] TG-DUT1-DUT2-TG. [Cfg] On DUT1 configure I... | 
FAIL |
08:29:44 08:00:53 Traffic script execution failed
08:29:44
================================================================================
08:29:44 Final result of all test
loops:                                                                          
                       | FAIL |
08:29:44 1 critical test has failed.
08:29:44
================================================================================


- Marco

On Mon, 2017-10-09 at 07:26 +0000, Jan Gelety -X (jgelety - PANTHEON 
TECHNOLOGIES at Cisco) wrote:
> Hello Marco,
> 
> I had a look on the test case log 
> (https://jenkins.fd.io/job/vpp-csit-verify-v
> irl-master/7480/robot/report/log.html) - it's always the best action 
> you can do to check what test case really caused the failure as there 
> are some tests expected to fail because of non-fixed issues in VPP - 
> and failed test is
> 
> TEST TC01: Route IPv4 packet through LISP with Bridge Domain setup.
> 
> Where no running VPP was detected (no VPP pid returned) during the 
> test case setup phase.
> 
> Regards,
> Jan
> 
> -----Original Message-----
> From: Marco Varlese [mailto:marco.varl...@suse.com]
> Sent: Monday, October 09, 2017 09:04
> To: Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco) 
> <jgel...@cisco.co
> m>; Ed Kern (ejk) <e...@cisco.com>
> Cc: vpp-dev@lists.fd.io; csit-...@lists.fd.io
> Subject: Re: [vpp-dev] Test failing
> 
> Please, take a look at this logs:
> 
> https://jenkins.fd.io/job/vpp-csit-verify-virl-master/7480/console
> 
> After Ed and yourself mentioned it... maybe the cause of the failure 
> is linked to this failure instead?
> 14:32:52 14:11:12 Tests.Vpp.Func.Ip4 Tunnels.Lisp.Eth2P-Ethip4Lisp- 
> L2Bdbasemaclrn-Func :: *ip4-lispgpe-ip4 encapsulation test
> cases*              |
> FAIL |
> 14:32:52 14:11:12 1 critical test, 0 passed, 1 failed
> 14:32:52 14:11:12 1 test total, 0 passed, 1 failed
> 
> 
> Cheers,
> Marco
> 
> On Fri, 2017-10-06 at 15:49 +0000, Jan Gelety -X (jgelety - PANTHEON 
> TECHNOLOGIES at Cisco) wrote:
> > + csit-dev
> > 
> > Hello Marco,
> > 
> > The mentioned test case is not responsible for -1 in verification as 
> > this test case is marked as non-critical. Please, provide links to 
> > affected jobs to find which TC is really failing.
> > 
> > Thanks,
> > Jan
> > 
> > -----Original Message-----
> > From: vpp-dev-boun...@lists.fd.io 
> > [mailto:vpp-dev-boun...@lists.fd.io]
> > On Behalf Of Ed Kern (ejk)
> > Sent: Friday, October 06, 2017 17:07
> > To: Marco Varlese <marco.varl...@suse.com>
> > Cc: vpp-dev@lists.fd.io
> > Subject: Re: [vpp-dev] Test failing
> > 
> > could you throw me some example jobs?
> > 
> > thanks,
> > 
> > Ed
> > 
> > 
> > > On Oct 6, 2017, at 8:54 AM, Marco Varlese <marco.varl...@suse.com> wrote:
> > > 
> > > Hi all,
> > > 
> > > I have seen this many times these days...
> > > I wonder if it's a infra hiccup or something is really broken?
> > > 
> > > The "recheck" is becoming the norm to get a clean +1 Verified... 
> > > :(
> > > 
> > > 14:32:52 14:00:32 TC04: VPP doesn't send DHCPv4 REQUEST after 
> > > OFFER with wrong
> > > XID :: Configure DHCPv4 client on interface to TG. If server       | FAIL
> > > |
> > > 14:32:52 14:00:32 Expected error 'DHCP REQUEST Rx timeout' but got 
> > > 'Traffic script execution failed'.
> > > 
> > > 
> > > Cheers,
> > > Marco
> > > _______________________________________________
> > > vpp-dev mailing list
> > > vpp-dev@lists.fd.io
> > > https://lists.fd.io/mailman/listinfo/vpp-dev
> > 
> > _______________________________________________
> > vpp-dev mailing list
> > vpp-dev@lists.fd.io
> > https://lists.fd.io/mailman/listinfo/vpp-dev
> > 
_______________________________________________
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev
  • [vpp-dev] Tes... Marco Varlese
    • Re: [vpp... Ed Kern (ejk)
      • Re: ... Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco)
        • ... Marco Varlese
          • ... Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco)
            • ... Marco Varlese
              • ... Jan Gelety -X (jgelety - PANTHEON TECHNOLOGIES at Cisco)
                • ... Marco Varlese
                • ... Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
                • ... Marco Varlese
                • ... Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
                • ... Dave Wallace

Reply via email to