Hi. I've just made a team upload trying to address this.
The skips would probably needs to be added to both debian/rules and debian/tests.
I was unsure about how to do that, but then I looked at the autopkgtests logs and realized that the tests marked to be skipped in debian/rules are also skipped when the autopkgtests run. Apparently pybuild-autopkgtest has some kind of magic that reads variables from debian/rules so that we don't have to define things twice, which is great. So I hope what I did will work. If it does not, I'll probably need help to complete the fix. Thanks.