“make DEBUG=gdb TEST=test_XXX test-debug” # where test_xxx = actual name of test/test_which_breaks.py
This mode of operation runs a single test; pausing and printring vpp PID(s) which you can attach in gdb: # gdb (gdb) attach <pid-of-vpp> (gdb) continue Press return in the “make test” window. If/when vpp blows up, you’ll have it right where you want it… HTH… Dave From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Srikanth.Garnepalli Sent: Friday, April 27, 2018 9:21 AM To: vpp-dev@lists.fd.io Subject: [vpp-dev] On 18.01.1 vpp while running unittests facing VPP subprocess died unexpectedly with retunr code 127 VPP died shortly after startup is there any bug filed for this or know issue? While Running UnitTests,on 18.01.1 Vpp Process is getting died 17:07:49,859 VPP subprocess died unexpectedly with returncode 127 [unknown] 17:07:49,859 VPP died shortly after startup, check the output to standard error for possible cause Reference : 18.01.1 Branch failed logs : root@srikanth-ThinkPad-L470:/home/srikanth/stable-vpp/vpp# make test V=2 TEST=test_udp make -C /home/srikanth/stable-vpp/vpp/build-root PLATFORM=vpp TAG=vpp vpp-install make[1]: Entering directory '/home/srikanth/stable-vpp/vpp/build-root' @@@@ Arch for platform 'vpp' is native @@@@ @@@@ Finding source for dpdk @@@@ @@@@ Makefile fragment found in /home/srikanth/stable-vpp/vpp/build-data/packages/dpdk.mk<http://dpdk.mk> @@@@ @@@@ Source found in /home/srikanth/stable-vpp/vpp/dpdk @@@@ @@@@ Arch for platform 'vpp' is native @@@@ @@@@ Finding source for vpp @@@@ @@@@ Makefile fragment found in /home/srikanth/stable-vpp/vpp/build-data/packages/vpp.mk<http://vpp.mk> @@@@ @@@@ Source found in /home/srikanth/stable-vpp/vpp/src @@@@ @@@@ Configuring dpdk: nothing to do @@@@ @@@@ Building dpdk: nothing to do @@@@ @@@@ Installing dpdk: nothing to do @@@@ @@@@ Configuring vpp: nothing to do @@@@ @@@@ Building vpp: nothing to do @@@@ @@@@ Installing vpp: nothing to do @@@@ make[1]: Leaving directory '/home/srikanth/stable-vpp/vpp/build-root' make -C test TEST_DIR=/home/srikanth/stable-vpp/vpp/test VPP_TEST_BUILD_DIR=/home/srikanth/stable-vpp/vpp/build-root/build-vpp-native VPP_TEST_BIN=/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/bin/vpp VPP_TEST_PLUGIN_PATH=/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/lib/vpp_plugins:/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/lib64/vpp_plugins VPP_TEST_INSTALL_PATH=/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/ LD_LIBRARY_PATH=/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/lib/:/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/lib64/ EXTENDED_TESTS= PYTHON= OS_ID=ubuntu CACHE_OUTPUT= test make[1]: Entering directory '/home/srikanth/stable-vpp/vpp/test' make -C ext make[2]: Entering directory '/home/srikanth/stable-vpp/vpp/test/ext' make[2]: Nothing to be done for 'all'. make[2]: Leaving directory '/home/srikanth/stable-vpp/vpp/test/ext' 17:07:49,294 Temporary dir is /tmp/vpp-unittest-SanityTestCase-3veYsV, shm prefix is vpp-unittest-SanityTestCase-3veYsV 17:07:49,294 vpp_cmdline: ['/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/bin/vpp', 'unix', '{', 'nodaemon', '', 'full-coredump', 'coredump-size unlimited', '}', 'api-trace', '{', 'on', '}', 'api-segment', '{', 'prefix', 'vpp-unittest-SanityTestCase-3veYsV', '}', 'plugins', '{', 'plugin', 'dpdk_plugin.so', '{', 'disable', '}', '}', 'plugin_path', '/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/lib/vpp_plugins:/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/lib64/vpp_plugins'] 17:07:49,295 Spawned VPP with PID: 32113 17:07:49,759 Starting sleep for 0.1s (after vpp startup, before initial poll) 17:07:49,859 Finished sleep (after vpp startup, before initial poll) - slept 0.100173950195s (wanted 0.1s) 17:07:49,859 VPP subprocess died unexpectedly with returncode 127 [unknown] 17:07:49,859 VPP died shortly after startup, check the output to standard error for possible cause 17:07:49,860 Waiting for pump thread to stop 17:07:49,860 ------------------------------------------------------------------------------ 17:07:49,860 VPP output to stdout while running SanityTestCase: 17:07:49,860 ------------------------------------------------------------------------------ 17:07:49,860 17:07:49,860 ------------------------------------------------------------------------------ 17:07:49,860 ------------------------------------------------------------------------------ 17:07:49,860 VPP output to stderr while running SanityTestCase: 17:07:49,860 ------------------------------------------------------------------------------ 17:07:49,861 vlib_plugin_early_init:356: plugin path /home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/lib/vpp_plugins:/home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/lib64/vpp_plugins load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control Lists) load_one_plugin:103: Plugin disabled: dpdk_plugin.so load_one_plugin:184: Loaded plugin: flowprobe_plugin.so (Flow per Packet) load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator addressing for IPv6) load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) load_one_plugin:114: Plugin disabled (default): ixge_plugin.so load_one_plugin:184: Loaded plugin: kubeproxy_plugin.so (kube-proxy data plane) load_one_plugin:184: Loaded plugin: l2e_plugin.so (L2 Emulation) load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid Deployment on IPv4 Infrastructure (RFC5969)) load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory Interface (experimetal)) load_one_plugin:184: Loaded plugin: nat_plugin.so (Network Address Translation) load_one_plugin:184: Loaded plugin: pppoe_plugin.so (PPPoE) load_one_plugin:184: Loaded plugin: stn_plugin.so (VPP Steals the NIC for Container integration) /home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/bin/vpp[32113]: load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so /home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/bin/vpp[32113]: load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/cdp_test_plugin.so /home/srikanth/stable-vpp/vpp/build-root/install-vpp-native/vpp/bin/vpp: symbol lookup error: /usr/lib/vpp_api_test_plugins/lacp_test_plugin.so: undefined symbol: vl_msg_api_get_msg_index Latest Branch or Master Branch passed logs : root@srikanth-ThinkPad-L470:/home/srikanth/vpp/test# git branch * master root@srikanth-ThinkPad-L470:/home/srikanth/vpp/test# make test Makefile:7: *** VPP_PYTHON_PREFIX is not set. Stop. root@srikanth-ThinkPad-L470:/home/srikanth/vpp/test# cd .. root@srikanth-ThinkPad-L470:/home/srikanth/vpp# make test make -C /home/srikanth/vpp/build-root PLATFORM=vpp TAG=vpp vpp-install make[1]: Entering directory '/home/srikanth/vpp/build-root' @@@@ Arch for platform 'vpp' is native @@@@ @@@@ Finding source for dpdk @@@@ @@@@ Makefile fragment found in /home/srikanth/vpp/build-data/packages/dpdk.mk<http://dpdk.mk> @@@@ @@@@ Source found in /home/srikanth/vpp/dpdk @@@@ @@@@ Arch for platform 'vpp' is native @@@@ @@@@ Finding source for vpp @@@@ @@@@ Makefile fragment found in /home/srikanth/vpp/build-data/packages/vpp.mk<http://vpp.mk> @@@@ @@@@ Source found in /home/srikanth/vpp/src @@@@ @@@@ Configuring dpdk: nothing to do @@@@ @@@@ Building dpdk: nothing to do @@@@ @@@@ Installing dpdk: nothing to do @@@@ @@@@ Configuring vpp: nothing to do @@@@ @@@@ Building vpp: nothing to do @@@@ @@@@ Installing vpp: nothing to do @@@@ make[1]: Leaving directory '/home/srikanth/vpp/build-root' make -C test TEST_DIR=/home/srikanth/vpp/test VPP_TEST_BUILD_DIR=/home/srikanth/vpp/build-root/build-vpp-native VPP_TEST_BIN=/home/srikanth/vpp/build-root/install-vpp-native/vpp/bin/vpp VPP_TEST_PLUGIN_PATH=/home/srikanth/vpp/build-root/install-vpp-native/vpp/lib/vpp_plugins:/home/srikanth/vpp/build-root/install-vpp-native/vpp/lib64/vpp_plugins VPP_TEST_INSTALL_PATH=/home/srikanth/vpp/build-root/install-vpp-native/ LD_LIBRARY_PATH=/home/srikanth/vpp/build-root/install-vpp-native/vpp/lib/:/home/srikanth/vpp/build-root/install-vpp-native/vpp/lib64/ EXTENDED_TESTS= PYTHON= OS_ID=ubuntu CACHE_OUTPUT= test make[1]: Entering directory '/home/srikanth/vpp/test' make -C ext make[2]: Entering directory '/home/srikanth/vpp/test/ext' make[2]: Nothing to be done for 'all'. make[2]: Leaving directory '/home/srikanth/vpp/test/ext' Adding tests from directory tree /home/srikanth/vpp/test Running tests using custom test runner Active filters: file=None, class=None, function=None 709 out of 709 tests match specified filters Not running extended tests (some tests will be skipped) ============================================================================== Classifier Test Case ============================================================================== IP ACL test OK Output IP ACL test OK MAC ACL test OK IP PBR test OK ============================================================================== ACL on dot1q bridged subinterfaces Tests ==============================================================================