Source: python-pytest-subtests
Version: 0.8.0-2
Severity: serious
Tags: sid bookworm
User: [email protected]
Usertags: needs-update
User: [email protected]
Usertags: python3.11
Control: affects -1 src:python3-defaults

Dear maintainer(s),

We are in the transition of adding python3.11 as a supported Python version [0]. With a recent upload of python3-defaults the autopkgtest of python-pytest-subtests fails in testing when that autopkgtest is run with the binary packages of python3-defaults from unstable. It passes when run with only packages from testing. In tabular form:

                       pass            fail
python3-defaults       from testing    3.10.6-3
python-pytest-subtests from testing    0.8.0-2
all others             from testing    from testing

I copied some of the output at the bottom of this report.

Currently this regression is blocking the migration of python3-defaults to testing [1]. https://docs.python.org/3/whatsnew/3.11.html lists what's new in Python3.11, it may help to identify what needs to be updated.

More information about this bug and the reason for filing it can be found on
https://wiki.debian.org/ContinuousIntegration/RegressionEmailInformation

Paul

[0] https://bugs.debian.org/1021984
[1] https://qa.debian.org/excuses.php?package=python3-defaults

https://ci.debian.net/data/autopkgtest/testing/amd64/p/python-pytest-subtests/28750729/log.gz

=================================== FAILURES =================================== ______________ TestSubTest.test_simple_terminal_normal[unittest] _______________

self = <test_subtests.TestSubTest object at 0x7f70940cc650>
simple_script = local('/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py') testdir = <Testdir local('/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2')>
runner = 'unittest'

@pytest.mark.parametrize("runner", ["unittest", "pytest-normal", "pytest-xdist"])
    def test_simple_terminal_normal(self, simple_script, testdir, runner):
            if runner == "unittest":
            result = testdir.run(sys.executable, simple_script)
          result.stderr.fnmatch_lines(
                [
                    "FAIL: test_foo (__main__.T) [custom] (i=1)",
                    "AssertionError: 1 != 0",
                    "FAIL: test_foo (__main__.T) [custom] (i=3)",
                    "AssertionError: 1 != 0",
                    "Ran 1 test in *",
                    "FAILED (failures=2)",
                ]
            )
E           Failed: nomatch: 'FAIL: test_foo (__main__.T) [custom] (i=1)'
E               and: 'FF'
E and: '======================================================================'
E               and: 'FAIL: test_foo (__main__.T.test_foo) [custom] (i=1)'
E and: '----------------------------------------------------------------------'
E               and: 'Traceback (most recent call last):'
E and: ' File "/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py", line 8, in test_foo'
E               and: '    self.assertEqual(i % 2, 0)'
E               and: 'AssertionError: 1 != 0'
E               and: ''
E and: '======================================================================'
E               and: 'FAIL: test_foo (__main__.T.test_foo) [custom] (i=3)'
E and: '----------------------------------------------------------------------'
E               and: 'Traceback (most recent call last):'
E and: ' File "/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py", line 8, in test_foo'
E               and: '    self.assertEqual(i % 2, 0)'
E               and: 'AssertionError: 1 != 0'
E               and: ''
E and: '----------------------------------------------------------------------'
E               and: 'Ran 1 test in 0.001s'
E               and: ''
E               and: 'FAILED (failures=2)'
E           remains unmatched: 'FAIL: test_foo (__main__.T) [custom] (i=1)'

/tmp/autopkgtest-lxc.agke3g8v/downtmp/autopkgtest_tmp/tests/test_subtests.py:142: Failed ----------------------------- Captured stdout call ----------------------------- running: /usr/bin/python3.11 /tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py
     in: /tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2
----------------------------- Captured stderr call -----------------------------
FF
======================================================================
FAIL: test_foo (__main__.T.test_foo) [custom] (i=1)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py", line 8, in test_foo
    self.assertEqual(i % 2, 0)
AssertionError: 1 != 0

======================================================================
FAIL: test_foo (__main__.T.test_foo) [custom] (i=3)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmp/pytest-of-debci/pytest-0/test_simple_terminal_normal2/test_simple_terminal_normal.py", line 8, in test_foo
    self.assertEqual(i % 2, 0)
AssertionError: 1 != 0

----------------------------------------------------------------------
Ran 1 test in 0.001s

FAILED (failures=2)
______________ TestSubTest.test_simple_terminal_verbose[unittest] ______________

self = <test_subtests.TestSubTest object at 0x7f7094100450>
simple_script = local('/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py') testdir = <Testdir local('/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2')>
runner = 'unittest'

@pytest.mark.parametrize("runner", ["unittest", "pytest-normal", "pytest-xdist"])
    def test_simple_terminal_verbose(self, simple_script, testdir, runner):
            if runner == "unittest":
            result = testdir.run(sys.executable, simple_script, "-v")
          result.stderr.fnmatch_lines(
                [
                    "test_foo (__main__.T) ... ",
                    "FAIL: test_foo (__main__.T) [custom] (i=1)",
                    "AssertionError: 1 != 0",
                    "FAIL: test_foo (__main__.T) [custom] (i=3)",
                    "AssertionError: 1 != 0",
                    "Ran 1 test in *",
                    "FAILED (failures=2)",
                ]
            )
E           Failed: nomatch: 'test_foo (__main__.T) ... '
E               and: 'test_foo (__main__.T.test_foo) ... '
E and: ' test_foo (__main__.T.test_foo) [custom] (i=1) ... FAIL' E and: ' test_foo (__main__.T.test_foo) [custom] (i=3) ... FAIL'
E               and: ''
E and: '======================================================================'
E               and: 'FAIL: test_foo (__main__.T.test_foo) [custom] (i=1)'
E and: '----------------------------------------------------------------------'
E               and: 'Traceback (most recent call last):'
E and: ' File "/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py", line 8, in test_foo'
E               and: '    self.assertEqual(i % 2, 0)'
E               and: 'AssertionError: 1 != 0'
E               and: ''
E and: '======================================================================'
E               and: 'FAIL: test_foo (__main__.T.test_foo) [custom] (i=3)'
E and: '----------------------------------------------------------------------'
E               and: 'Traceback (most recent call last):'
E and: ' File "/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py", line 8, in test_foo'
E               and: '    self.assertEqual(i % 2, 0)'
E               and: 'AssertionError: 1 != 0'
E               and: ''
E and: '----------------------------------------------------------------------'
E               and: 'Ran 1 test in 0.001s'
E               and: ''
E               and: 'FAILED (failures=2)'
E           remains unmatched: 'test_foo (__main__.T) ... '

/tmp/autopkgtest-lxc.agke3g8v/downtmp/autopkgtest_tmp/tests/test_subtests.py:176: Failed ----------------------------- Captured stdout call ----------------------------- running: /usr/bin/python3.11 /tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py -v
     in: /tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2
----------------------------- Captured stderr call ----------------------------- test_foo (__main__.T.test_foo) ... test_foo (__main__.T.test_foo) [custom] (i=1) ... FAIL
  test_foo (__main__.T.test_foo) [custom] (i=3) ... FAIL

======================================================================
FAIL: test_foo (__main__.T.test_foo) [custom] (i=1)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py", line 8, in test_foo
    self.assertEqual(i % 2, 0)
AssertionError: 1 != 0

======================================================================
FAIL: test_foo (__main__.T.test_foo) [custom] (i=3)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmp/pytest-of-debci/pytest-0/test_simple_terminal_verbose2/test_simple_terminal_verbose.py", line 8, in test_foo
    self.assertEqual(i % 2, 0)
AssertionError: 1 != 0

----------------------------------------------------------------------
Ran 1 test in 0.001s

FAILED (failures=2)
=========================== short test summary info ============================ FAILED tests/test_subtests.py::TestSubTest::test_simple_terminal_normal[unittest] FAILED tests/test_subtests.py::TestSubTest::test_simple_terminal_verbose[unittest] =================== 2 failed, 19 passed, 5 xfailed in 2.44s ====================
autopkgtest [00:14:54]: test upstream

Attachment: OpenPGP_signature
Description: OpenPGP digital signature

Reply via email to