Infrastructure/infra-docs-fpo
1
0
Fork 0
Code Issues 100 Pull requests 6 Projects Releases Packages Wiki Activity Actions

Mass rebuild SOP: add note about testing with openQA

Browse source 
openQA can test side tags, now, so it should be possible to test
the mass rebuild with it prior to merging. Let's add this to the
SOP so we remember to do it next time (hopefully).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
This commit is contained in:
Adam Williamson 2023-07-25 17:19:21 -07:00 • committed by kevin
parent fc5f853ea0
commit c253d0a81f
1 changed files with 27 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

27
modules/release_guide/pages/sop_mass_rebuild_packages.adoc
View file

@ -230,6 +230,33 @@ Set up the Site for Packages that Need Rebuilt::
$ while true; do ./need-rebuild.py > f26-need-rebuild.html && cp f26-need-rebuild.html /mnt/koji/mass-rebuild/f26-need-rebuild.html; sleep 600; done
....
==== Testing the Mass Rebuild
Fedora openQA's update test suite can be run on the mass rebuild tag
before it is merged, to find any major bugs it may cause. The command
to trigger tests is `fedora-openqa tag <tagname> <release number>`,
e.g. `fedora-openqa tag f39-rebuild 39`. This can be run as root
directly on an openQA server (preferably the staging instance), or
from any system with an appropriate configuration in
`~/.config/openqa/client.conf`, as documented https://pagure.io/fedora-qa/fedora_openqa[here].
The link to the results will appear as the first entry under Fedora
Updates on the front page of the web UI (at time of creation, any
updates that appear subsequently will go top of the list) with a name
like "BuildTAG_f39-rebuild". On the results page you see when clicking
this, green dots indicate passed tests, red dots indicate failed tests,
yellow dots indicate 'softfailed' tests (these are probably fine), and
blue dots indicate scheduled/running tests. Grey dots indicate a test
that was cancelled (probably because a parent or sibling test failed).
If you see all green (or green and yellow), things are good. All green/
yellow and blue, wait for the blues to change color. Any red or grey,
call for help from a QA person to interpret the results (and don't
merge anything yet).
Contact an openQA admin (look for the tall, dashingly good-looking ones
in https://matrix.to/#/#quality:fedoraproject.org[Fedora Quality chat])
for help scheduling the tests and interpreting the results if you are
unsure.
==== Post Mass Rebuild Tasks
Once the mass rebuild script completes, and all the pending builds have