From c253d0a81f5dbef93ba9cb7f37c992c3a754aa32 Mon Sep 17 00:00:00 2001 From: Adam Williamson Date: Tue, 25 Jul 2023 17:19:21 -0700 Subject: [PATCH] Mass rebuild SOP: add note about testing with openQA openQA can test side tags, now, so it should be possible to test the mass rebuild with it prior to merging. Let's add this to the SOP so we remember to do it next time (hopefully). Signed-off-by: Adam Williamson --- .../pages/sop_mass_rebuild_packages.adoc | 27 +++++++++++++++++++ 1 file changed, 27 insertions(+) diff --git a/modules/release_guide/pages/sop_mass_rebuild_packages.adoc b/modules/release_guide/pages/sop_mass_rebuild_packages.adoc index 5084ef9..606a906 100644 --- a/modules/release_guide/pages/sop_mass_rebuild_packages.adoc +++ b/modules/release_guide/pages/sop_mass_rebuild_packages.adoc @@ -230,6 +230,33 @@ Set up the Site for Packages that Need Rebuilt:: $ while true; do ./need-rebuild.py > f26-need-rebuild.html && cp f26-need-rebuild.html /mnt/koji/mass-rebuild/f26-need-rebuild.html; sleep 600; done .... +==== Testing the Mass Rebuild + +Fedora openQA's update test suite can be run on the mass rebuild tag +before it is merged, to find any major bugs it may cause. The command +to trigger tests is `fedora-openqa tag `, +e.g. `fedora-openqa tag f39-rebuild 39`. This can be run as root +directly on an openQA server (preferably the staging instance), or +from any system with an appropriate configuration in +`~/.config/openqa/client.conf`, as documented https://pagure.io/fedora-qa/fedora_openqa[here]. +The link to the results will appear as the first entry under Fedora +Updates on the front page of the web UI (at time of creation, any +updates that appear subsequently will go top of the list) with a name +like "BuildTAG_f39-rebuild". On the results page you see when clicking +this, green dots indicate passed tests, red dots indicate failed tests, +yellow dots indicate 'softfailed' tests (these are probably fine), and +blue dots indicate scheduled/running tests. Grey dots indicate a test +that was cancelled (probably because a parent or sibling test failed). +If you see all green (or green and yellow), things are good. All green/ +yellow and blue, wait for the blues to change color. Any red or grey, +call for help from a QA person to interpret the results (and don't +merge anything yet). + +Contact an openQA admin (look for the tall, dashingly good-looking ones +in https://matrix.to/#/#quality:fedoraproject.org[Fedora Quality chat]) +for help scheduling the tests and interpreting the results if you are +unsure. + ==== Post Mass Rebuild Tasks Once the mass rebuild script completes, and all the pending builds have