diff --git a/modules/release_guide/pages/sop_mass_rebuild_packages.adoc b/modules/release_guide/pages/sop_mass_rebuild_packages.adoc index 5084ef9..606a906 100644 --- a/modules/release_guide/pages/sop_mass_rebuild_packages.adoc +++ b/modules/release_guide/pages/sop_mass_rebuild_packages.adoc @@ -230,6 +230,33 @@ Set up the Site for Packages that Need Rebuilt:: $ while true; do ./need-rebuild.py > f26-need-rebuild.html && cp f26-need-rebuild.html /mnt/koji/mass-rebuild/f26-need-rebuild.html; sleep 600; done .... +==== Testing the Mass Rebuild + +Fedora openQA's update test suite can be run on the mass rebuild tag +before it is merged, to find any major bugs it may cause. The command +to trigger tests is `fedora-openqa tag `, +e.g. `fedora-openqa tag f39-rebuild 39`. This can be run as root +directly on an openQA server (preferably the staging instance), or +from any system with an appropriate configuration in +`~/.config/openqa/client.conf`, as documented https://pagure.io/fedora-qa/fedora_openqa[here]. +The link to the results will appear as the first entry under Fedora +Updates on the front page of the web UI (at time of creation, any +updates that appear subsequently will go top of the list) with a name +like "BuildTAG_f39-rebuild". On the results page you see when clicking +this, green dots indicate passed tests, red dots indicate failed tests, +yellow dots indicate 'softfailed' tests (these are probably fine), and +blue dots indicate scheduled/running tests. Grey dots indicate a test +that was cancelled (probably because a parent or sibling test failed). +If you see all green (or green and yellow), things are good. All green/ +yellow and blue, wait for the blues to change color. Any red or grey, +call for help from a QA person to interpret the results (and don't +merge anything yet). + +Contact an openQA admin (look for the tall, dashingly good-looking ones +in https://matrix.to/#/#quality:fedoraproject.org[Fedora Quality chat]) +for help scheduling the tests and interpreting the results if you are +unsure. + ==== Post Mass Rebuild Tasks Once the mass rebuild script completes, and all the pending builds have