While looking at coverage jobs to enable them to allow use of constraints in post jobs (something which has just been introduced and needs some more testing before we take on the other jobs), I noticed that we have quite a few coverage jobs that are failing.
In general, I think coverage jobs should be run as check job so that you know how the coverage changes. Running them only in the post job means that in practice nobody sees the output of the job. Out of 83 jobs having a post coverage job, 19 failed. See below for list of failures and a list of all repos that have a coverage post job setup. I suggest that projects review their coverage setup and decide whether they want to run it as part of the check queue, fix it, or remove it. Btw. if you want to get the output of the post job, check the git SHA. logs are found at ``http://logs.openstack.org/<first two characters of commit SHA>/<commit SHA>``. For example, if a change is committed with the sha 'deadbeef123456', the logs will be found at ``http://logs.openstack.org/de/deadbeef123456``. Here're the failures (including some that run successful but coverage did not collect any data): cloudkitty-dashboard: http://logs.openstack.org/11/113209883e3e9131602f35593bc0cb8880db19b9/post/cloudkitty-dashboard-coverage/c390a24/ designate-dashboard: http://logs.openstack.org/56/5627ddb4a6eedb751fecced56d277961aac92436/post/designate-dashboard-coverage/73650dc/ horizon: http://logs.openstack.org/8f/8f35c43bc5b4182d6e82a67cdc2beccd2364da8a/post/horizon-coverage/5535457/ monasca-ui: http://logs.openstack.org/f0/f05e4992fb6ce722ac00c4aa6ad30ff89b453476/post/monasca-ui-coverage/af5105e/ murano-agent: http://logs.openstack.org/14/1450eb39fb9f6dcbe1b70167d23d16e74f28dbd5/post/murano-agent-coverage/ee9c33a/ nodepool: http://logs.openstack.org/e3/e345107476a82ddad82ea99e184398e0d0e7e85a/post/nodepool-coverage-db/8a0ee23/ nova: http://logs.openstack.org/3f/3f700b5a5a498ba08e77378d34f059c3fa6845d8/post/nova-coverage-db/2bdabf8/ nova-docker: http://logs.openstack.org/03/034a4842fc1ebba5912e02cff8cd197ae81eb0c3/post/nova-docker-coverage/879d790/ os-net-config: http://logs.openstack.org/6b/6bb8412ef3d3f163d91f2884081b743f07a78f18/post/os-net-config-coverage/cba622a/ poppy: http://logs.openstack.org/09/0948c854e4b8543f01d909437f09cfb23e71a5b0/post/poppy-coverage/ccbc8ad/ python-aodhclient: http://logs.openstack.org/65/65d2e625ee3b359bae154a5da3931f48b48fe720/post/python-aodhclient-coverage/2d8a169/ python-gnocchiclient: http://logs.openstack.org/81/81e1b91beb3d85760e574951e240a381d6a4d008/post/python-gnocchiclient-coverage/2d9a414/ python-monascaclient (this should be fixed with the enabling of constraints): http://logs.openstack.org/17/17b9eaa1ede715344ac9cb2049c63e25604476cb/post/python-monascaclient-coverage/2b44b1b/ sahara-dashboard: http://logs.openstack.org/bc/bcf8e2938d7085799a3754a9ff6d245d73ec33ff/post/sahara-dashboard-coverage/7807a4e/console.html.gz sahara-tests: http://logs.openstack.org/91/914bf0646f4de85107324f0aa05e856961bb0ee6/post/sahara-tests-coverage/b65352b/ solum-dashboard: http://logs.openstack.org/82/8235df5a5ab0d48a6b407931c1d998102050b1b9/post/solum-dashboard-coverage/8d23679/ trove: http://logs.openstack.org/4a/4ad0dfe88c6362356c8083d167f43ab495da661d/post/trove-coverage-db/990fd71/ trove-dashboard: http://logs.openstack.org/01/01815715539fad40e06e974d6fdf840957051b69/post/trove-dashboard-coverage/908f8df/ turbo-hipster: http://logs.openstack.org/7e/7ef12b758020176fb3e13e5bb0154084b1456797/post/turbo-hipster-coverage/ab2d17a/ Full list of repos with coverage job defined: openstack-dev/hacking hacking-coverage openstack-dev/pbr pbr-coverage openstack-infra/bindep bindep-coverage openstack-infra/grafyaml grafyaml-coverage openstack-infra/jenkins-job-builder jenkins-job-builder-coverage openstack-infra/nodepool nodepool-coverage-db openstack-infra/python-storyboardclient python-storyboardclient-coverage openstack-infra/shade shade-coverage openstack-infra/storyboard storyboard-coverage-db openstack-infra/zuul zuul-coverage-db openstack/ara ara-coverage openstack/ceilometermiddleware ceilometermiddleware-coverage openstack/cloudbase-init cloudbase-init-coverage openstack/cloudkitty cloudkitty-coverage openstack/cloudkitty-dashboard cloudkitty-dashboard-coverage openstack/designate designate-coverage-db openstack/designate-dashboard designate-dashboard-coverage openstack/heat heat-coverage-db openstack/heat-translator heat-translator-coverage openstack/horizon horizon-coverage openstack/ironic ironic-coverage-db openstack/ironic-lib ironic-lib-coverage openstack/keystonemiddleware keystonemiddleware-coverage openstack/kiloeyes kiloeyes-coverage openstack/manila manila-coverage-db openstack/monasca-ui monasca-ui-coverage openstack/murano murano-coverage-db openstack/murano-agent murano-agent-coverage openstack/neutron neutron-coverage openstack/neutron-dynamic-routing neutron-dynamic-routing-coverage openstack/neutron-fwaas neutron-fwaas-coverage openstack/neutron-vpnaas neutron-vpnaas-coverage openstack/nova nova-coverage-db openstack/nova-docker nova-docker-coverage openstack/os-apply-config os-apply-config-coverage openstack/os-cloud-config os-cloud-config-coverage openstack/os-collect-config os-collect-config-coverage openstack/os-net-config os-net-config-coverage openstack/oslo.concurrency oslo.concurrency-coverage openstack/oslo.i18n oslo.i18n-coverage openstack/oslo.messaging oslo.messaging-coverage openstack/oslotest oslotest-coverage openstack/osprofiler osprofiler-coverage openstack/poppy poppy-coverage openstack/poppy-ui poppy-ui-coverage openstack/pycadf pycadf-coverage openstack/python-aodhclient python-aodhclient-coverage openstack/python-ceilometerclient python-ceilometerclient-coverage openstack/python-cinderclient python-cinderclient-coverage openstack/python-cloudkittyclient python-cloudkittyclient-coverage openstack/python-designateclient python-designateclient-coverage openstack/python-glanceclient python-glanceclient-coverage openstack/python-gnocchiclient python-gnocchiclient-coverage openstack/python-heatclient python-heatclient-coverage openstack/python-ironicclient python-ironicclient-coverage openstack/python-keystoneclient python-keystoneclient-coverage openstack/python-manilaclient python-manilaclient-coverage openstack/python-monascaclient python-monascaclient-coverage openstack/python-neutronclient python-neutronclient-coverage openstack/python-novaclient python-novaclient-coverage openstack/python-openstackclient python-openstackclient-coverage openstack/python-openstacksdk python-openstacksdk-coverage openstack/python-rackclient python-rackclient-coverage openstack/python-saharaclient python-saharaclient-coverage openstack/python-solumclient python-solumclient-coverage openstack/python-swiftclient python-swiftclient-coverage openstack/rally rally-coverage openstack/refstack-client refstack-client-coverage openstack/sahara sahara-coverage-db openstack/sahara-dashboard sahara-dashboard-coverage openstack/sahara-tests sahara-tests-coverage openstack/solum solum-coverage openstack/solum-dashboard solum-dashboard-coverage openstack/solum-infra-guestagent solum-infra-guestagent-coverage openstack/swift swift-coverage openstack/swift3 swift3-coverage openstack/taskflow taskflow-coverage-db openstack/tempest tempest-coverage openstack/tooz tooz-coverage openstack/tosca-parser tosca-parser-coverage openstack/trove trove-coverage-db openstack/trove-dashboard trove-dashboard-coverage openstack/turbo-hipster turbo-hipster-coverage Andreas -- Andreas Jaeger aj@{suse.com,opensuse.org} Twitter/Identica: jaegerandi SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nürnberg) GPG fingerprint = 93A3 365E CE47 B889 DF7F FED1 389A 563C C272 A126 __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
