[vpp-dev] Gerrit 3553 Update CSIT tests 161017 -> 161024 vpp-csit-verify-virl-master failure

[Dave Wallace]

Jan/Peter,

The jenkins job 1898 (vpp-csit-verify-virl-master for gerrit 3553) 
failed due to the dut_setup.sh timeout failure we were encountering on 
Friday.  I managed to download the output.xml file before it got rotated 
out of existence and I stashed it and the console log on github:

    git clone https://github.com/dwallacelf/fdio-logs.git

Search for "Timeout exception." in the output.xml file to find the 
error.  Unfortunately there doesn't seem to be any indication in the 
stdout buffer output why VPP failed to start:

----- %< -----
<msg timestamp="20161024 22:03:37.768" level="DEBUG">reusing ssh: 
&lt;paramiko.client.SSHClient object at 0x7f15044b4c10&gt;</msg>
<msg timestamp="20161024 22:03:37.768" level="DEBUG">Connect peer: 
('10.30.51.171', 22)</msg>
<msg timestamp="20161024 22:03:37.769" level="DEBUG">Connections: 
{-577570646841511367: &lt;paramiko.client.SSHClient object at 
0x7f15044b4c10&gt;, -3741746294258997084: &lt;paramiko.client.SSHClient 
object at 0x7f15044b4750&gt;, -6423245561903096018: 
&lt;paramiko.client.SSHClient object at 0x7f15044ae5d0&gt;}</msg>
<msg timestamp="20161024 22:03:37.769" level="DEBUG">[chan 699] Max 
packet in: 32768 bytes</msg>
<msg timestamp="20161024 22:03:37.773" level="TRACE">exec_command on 
('10.30.51.171', 22): sudo -Sn bash 
/tmp/openvpp-testing/resources/libraries/bash/dut_setup.sh</msg>
<msg timestamp="20161024 22:03:47.808" level="FAIL">timeout: Timeout 
exception.
Current contents of stdout buffer:
----- %< -----

It appears that the script ran for 10 seconds before the timeout was 
declared.  Subsequent calls to VAT in the teardown test also failed 
because VPP was not running.  There is no indication in the syslog why 
VPP did not start up.

Please take a look and see if you can see something that I missed.

Thanks,
-daw-

On 10/24/16 6:16 PM, fd.io JJB (Code Review) wrote:
fd.io JJB has posted comments on this change. ( https://gerrit.fd.io/r/3553 )

Change subject: Update CSIT tests 161017 -> 161024
......................................................................


Patch Set 1: Verified-1

Build Failed

https://jenkins.fd.io/job/vpp-csit-verify-virl-master/1898/ : FAILURE

https://jenkins.fd.io/job/vpp-lite-verify-master-ubuntu1604/1893/ : SUCCESS

https://jenkins.fd.io/job/vpp-verify-master-ubuntu1404/1898/ : SUCCESS

https://jenkins.fd.io/job/vpp-docs-verify-master/499/ : SUCCESS

https://jenkins.fd.io/job/vpp-lite-verify-master-centos7/1895/ : SUCCESS

https://jenkins.fd.io/job/vpp-verify-master-ubuntu1604/1894/ : SUCCESS

https://jenkins.fd.io/job/vpp-lite-verify-master-ubuntu1404/1898/ : SUCCESS

https://jenkins.fd.io/job/vpp-verify-master-centos7/1894/ : SUCCESS


_______________________________________________
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev