Thank you, Kamil, for the review, I will work on it tomorrow again to incorporate the suggestions.
Lukas On Wed, Feb 17, 2021 at 4:00 PM Kamil Paral <kpa...@redhat.com> wrote: > On Fri, Feb 12, 2021 at 2:28 PM Lukas Ruzicka <lruzi...@redhat.com> wrote: > >> List of test cases to test that: >> >> - PipeWire is used by default ( >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_pipewire_default >> ) >> >> > s/bare machines/bare-metal machines/ > (Also in (all) other testcases) > > >> - PipeWire CLI works ( >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_pipewire_cli) >> >> > "Have an audio file ready (wav)." > It would be nice either to link to some freely available sample, or > specify a path where such a file is present on default desktop > installations (there's usually something in /usr/share/sounds/, for > example). Otherwise each tester needs to waste time searching for a wav > file individually. > > "Play a sound file over the default target and check that it is correctly > played over the default sound device. > $ pw-cat -p <audiofile>" > Is this supposed to be the wav file, or any audio file (e.g. ogg)? A > clarification would be good, e.g.: > "Play a wav sound file over the default target and check that it is > correctly played over the default sound device. > $ pw-cat -p <audiofile.wav>" > > >> >> - ALSA backend works ( >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_ALSA_backend) >> >> > "Log in as a common user." > A "regular user", if you want to make it consistent. > > s/headphoned/headphones/ > > "Keep an audio file at hand (wav)." > Ditto as above. > > The Expected Results section could be simplified, either merged into the > steps, or e.g. "Every time you use `aplay` to play an audio file in each > testing step, you can hear it correctly". > > >> >> - Audio Selected Apps ( >> >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_audio_selected_apps >> ) >> - Pavucontrol works ( >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_pavucontrol_basic >> ) >> >> > LGTM > > >> >> - Pavucontrol mixing ( >> >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_pavucontrol_mixing >> ) >> >> > "Connect your speakers (headphones) to all your computer’s sound devices." > This confused me until I read the whole testcase. It sounds like I should > connect the same headphones to all sound outputs, which is of course > impossible to do at the same time, so I thought I would re-plug it to each > device as needed. Turns out you wanted to say "make sure each sound device > has some speakers/headphones connected to it", right? It would be good to > make this clearer. > > >> >> - Pavucontrol recording ( >> >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_pavucontrol_recording >> ) >> >> > LGTM > > >> >> - Pavucontrol add and remove devices ( >> >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_pavucontrol_addremove >> ) >> >> > "The computer must be equipped with a sound device with multiple ports > (speakers and phones), such as laptops." > Perhaps you can also say "or desktops with an audio front panel (where > plugging a jack into the front audio panel would disable the usual jack > output on the computer's back)" or similar, so that people know laptops are > not strictly needed. > > "Plug in an HDMI monitor and check that the device appears in the > Pavucontrol’s list of devices." > I'm a bit confused that Setup didn't speak about HDMI at all and suddenly > in step 8 I need it. If it is a requirement, it should be in Setup. If it > is just optional, it should be said so ("If you have a HDMI monitor, ..."). > Also: > a) audio routing is available not just with HDMI, but also with > DisplayPort (which might be even more common, for desktop users) > b) just a HDMI/DP monitor is not enough, I think. It has to either have > its own speakers, or an output jack (which you can plug headphones/speakers > into). If it doesn't have any audio output, I'm not sure whether it appears > as an audio output device once connected (and even if it did, you wouldn't > be able to verify it works). > > >> >> - PipeWire handles Bluetooth devices ( >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_bluetooth_devices >> ) >> >> > "The computer must be equipped with a Bluetooth adapter." > And also you need to have some BT device to test with. Those can be > BT-enabled headphones or speakers. Is there anything else? Can I test it > using a phone somehow? Just wondering. > > > >> >> - Jack applications ( >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_jack) >> >> > "Install the pipewire-jack-audio-connection-kit package. Using the > --allowerasing option might be necessary for successful installation." > This might be confusing if one doesn't know the option and therefore > doesn't realize you're talking about dnf. > > > > >> >> - Jack MIDI routing ( >> https://fedoraproject.org/wiki/User:Lruzicka/QA:Testcase_jack_midi) >> >> > "Install the pipewire-jack-audio-connection-kit package. Using the > --allowerasing option might be necessary for successful installation." > Ditto. > > Overall it looks very good. Note that some time ago I created a special > category for "test day's test cases", and so let's put all of those in when > moving them into the final location: > https://fedoraproject.org/wiki/Category:Test_Days_Test_Cases > Since those testcases are related to the PipeWire testday, you can prefix > them like that, e.g. "Testcase PipeWire ALSA backend" or "Testcase PipeWire > Jack". Just a thought. > > As discussed yesterday at our team meeting, adding one more testcase to > test popular videoconferencing tools is probably a good idea. > > Thanks for your work, > Kamil > > _______________________________________________ > test mailing list -- test@lists.fedoraproject.org > To unsubscribe send an email to test-le...@lists.fedoraproject.org > Fedora Code of Conduct: > https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org > Do not reply to spam on the list, report it: > https://pagure.io/fedora-infrastructure > -- Lukáš Růžička FEDORA QE, RHCE Red Hat <https://www.redhat.com> Purkyňova 115 612 45 Brno - Královo Pole lruzi...@redhat.com TRIED AND PERSONALLY TESTED, ERGO TRUSTED. <https://redhat.com/trusted>
_______________________________________________ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure