Commit graph

40 commits

Author SHA1 Message Date
Adam Williamson
3e4c3534e5 openqa: switch FCOS scheduling to messages, reduce duplication
This sets us up for scheduling FCOS tests from messages, not
using a cron job. Also reduces some duplication of variables
between openqa-servers-common and the dispatcher role defaults.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 10:59:01 -08:00
Adam Williamson
2b7a62f232 openqa/dispatcher: use arch filtering instead of custom WANTED
I just enhanced the scheduler code so we can share the stock
WANTED definition (which now includes all arches) between prod
and lab, but filter the arches with a config file setting. This
means we don't have to carry and install a whole custom WANTED
file with the extra arches for lab any more, we just set the
appropriate value in the config file. Also drop some stuff from
the config file that's been useless since we switched to
fedora-messaging.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-29 16:55:11 -07:00
Adam Williamson
6937712e23 openqa/dispatcher: enable Server and Workstation aarch64 images
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-29 15:43:58 -07:00
Adam Williamson
8ba222327d openqa/dispatcher: Drop 32-bit ARM disk image testing again
It's not working (no display output). Not sure why not yet.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-29 15:33:33 -07:00
Adam Williamson
728ae59b6d openqa/dispatcher: try scheduling 32-bit ARM minimal image again
...this time it'll run on an aarch64 host. Let's see if that
works better.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-29 14:10:21 -07:00
Adam Williamson
ef5d044161 openqa/dispatcher: schedule minimal disk image on aarch64
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-29 13:49:36 -07:00
Adam Williamson
11177cf2dc Good grief once more for the cheap seats in back
Would someone please fire me

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-02 15:24:19 -07:00
Adam Williamson
1afdb241ed openqa/dispatcher: fix that cron script cos I'm a doofus
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-02 15:22:42 -07:00
Adam Williamson
f77767ce85 openqa/dispatcher: add cron job to schedule jobs for CoreOS
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-02 15:19:26 -07:00
Adam Williamson
137c8cc123 openqa: test IoT dvd-ostree on aarch64, reorder file a bit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 12:38:35 -07:00
Adam Williamson
fbecb70bc1 openqa/dispatcher: Drop 32-bit ARM-on-x86_64 from stg scheduling
As in fedora_openqa, drop this as it's been broken forever and
we are clearly not going to fix it. At some point I'll set up
32-bit-ARM-on-aarch64 testing. Hopefully.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:29 +02:00
Adam Williamson
793b69e105 openqa/dispatcher: test everything and workstation on ppc64le
As requested by Michel in
https://pagure.io/fedora-qa/fedora_openqa/pull-request/77 (we
shadow changes to that here for $REASONS)

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:26 +02:00
Adam Williamson
dafa242542 openqa/dispatcher: add IoT to extraarches wanted JSON
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:23 +02:00
Adam Williamson
16076c620b openqa: Slow fm-consumer@ service restarts to every 60 secs
This is to reduce a flood of errors happening when servers the
consumers communicate with go down.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:20 +02:00
Adam Williamson
846376e873 openqa/dispatcher: drop old images from images.json.extraarches
This just matches the updates to the default WANTED dict in
fedora_openqa - removing various old images that aren't produced
any more (Workstation netinst, Atomic Host, and all i386 images).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:18 +02:00
Adam Williamson
be356508ae openqa/dispatcher: restart all fm-consumer@ services daily
fedora-messaging has an annoying bug where consumers get stuck
allegedly working fine but actually not handling any messages:

https://github.com/fedora-infra/fedora-messaging/issues/208

to deal with this on our openQA servers, just have the dispatcher
role install a cron job which restarts all the services nightly.
Strictly speaking this shouldn't really be part of a specific
role like this, but this is the easiest way to do it and it's
not really that "wrong".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:16 +02:00
Adam Williamson
b3546bd762 openqa/dispatcher: seriously JSON I will END YOU
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:16 +02:00
Adam Williamson
277300c022 openqa/dispatcher: goddamn json and commas
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:16 +02:00
Adam Williamson
bfd281cc42 openqa/dispatcher: schedule for Cloud_Base qcow2 images
This adjusts the images.json.extraarches used on staging to
look for Cloud_Base qcow2 images now we want to test those too.
Prod uses the stock config baked into fedora_openqa, which has
also been adjusted.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:16 +02:00
Adam Williamson
57bc370035 I swear to Christ json must die
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:09 +02:00
Adam Williamson
9b35d4fffd openqa/dispatcher: fix extraarches wanted image config syntax
Gah, JSON.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:09 +02:00
Adam Williamson
11136b796a openqa/dispatcher: add Silverblue installer to ppc64le WANTED
This means we will test it now. By request of Michel Normand.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:08 +02:00
Adam Williamson
2a1dd41542 openqa/dispatcher: drop ppc64 (BE) expected images
We no longer build big-endian ppc64 images, so no point looking
for them. ppc64le remains of course.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-10 14:16:08 -07:00
Adam Williamson
42359a80c0 openqa/dispatcher: fix Silverblue name in extraaraches JSON
We use a 'wanted images' config file for staging, which makes
us look for images from aarch64 and ppc64le arches; this was not
updated when AtomicWorkstation was renamed Silverblue, so we
haven't been scheduling Silverblue tests on staging at all...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-28 10:25:29 -07:00
Adam Williamson
2602d052b0 openqa/dispatcher: fix respin test scheduler
It broke because python3 setup.py install installs binaries
to /usr/local/bin , not /usr/bin, so fedora-openqa is no longer
where the script expects it to be...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-24 15:11:04 -07:00
Adam Williamson
e5d34dd9d3 openqa/dispatcher: fix staging AMQP broker setup
The correct auth bits are missing from the package so I'll ship
them here for now, and correct the config.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 19:01:01 -07:00
Adam Williamson
983e39abff openqa/dispatcher: improve 'extra arches' implementation
These bits were still named and described as if they were ppc64
specific, even though they actually cover aarch64 too. Also I
decided I don't like the implementation of cueing *directly* off
the infra deployment type here, it feels wrong. Instead let's
just make it work from a config variable, and set that variable
to false by default and true in group_vars/openqa-stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-30 10:34:04 -08:00
Adam Williamson
4017e9ebdc openqa: update ppc64 images.json for Atomic variant renames
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-06 16:09:02 -08:00
Paul Whalen
970640e4f4 Add aarch64 server boot, dvd to images. 2018-03-06 09:47:32 +00:00
Adam Williamson
7088130aaf openqa/dispatcher: update Workstation ostree variant name
In the variant wanted images config file we use on stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-10-10 10:31:26 -07:00
Adam Williamson
b95bbd14b9 Sigh. More JSON fixup.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-09-07 11:19:05 -07:00
Adam Williamson
f0aae3c405 openqa/dispatcher: fix up images.json.ppc64 to be valid JSON
Sigh, JSON, why must you be so generally awful.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-09-07 10:56:18 -07:00
Adam Williamson
873c55d3fc openqa/dispatcher: Install a variant images.json for stg
To get ppc64 tasks run on stg but not prod.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-09-07 09:42:37 -07:00
Adam Williamson
f78d015cf4 openqa/dispatcher: update respin cronjob for new scheduler name
The scheduler binary name changed from 'fedora-openqa-schedule'
to 'fedora-openqa', but I forgot to update the call in this
cronjob. Oops.
2017-02-22 11:56:53 -08:00
Adam Williamson
ea4ed40076 openqa/scheduler: add a cron job to schedule live-respins
There are no fedmsg notifications for the live respin composes,
so we just try scheduling them every hour; when we've already
tested the current compose this will not create any new jobs,
and when a new compose shows up, this will test it.
2016-12-14 12:32:48 -08:00
Adam Williamson
ddfa764ebf openqa: drop the workaround for ARM kernel/initrd collisions
We fixed the issue which meant ARM kernel / initrd file names
were colliding, so we don't need this workaround any more.
2016-10-18 15:20:59 -07:00
Adam Williamson
29d9e648ed couple of fixes to that script 2016-10-03 12:04:12 -07:00
Adam Williamson
f96b283dec openqa/dispatcher: add an ugly workaround for openQA #673
We currently can't tell openQA to download the ARM kernel and
initramfs with a filename unique to the build being tested, so
they just get downloaded as `vmlinuz` and `initrd.img`, which
means that when the next compose is tested, we won't download
them again, we'll just use the existing copies (which are no
longer the right ones). Because of this our current 'F25' and
'Rawhide' ARM tests are actually still using some F24 kernel
image. Until the openQA bug which prevents us giving the files
unique names is resolved, here's a hacky workaround: a script
which wipes the files every hour if no openQA jobs are pending.
2016-10-03 11:54:24 -07:00
Adam Williamson
605fc80786 openqa_dispatcher: enable fedmsg-based result wiki reporting
...by extending the fedmsg consumer config file. Requires the
latest openqa_fedora_tools to work.
2016-03-21 09:10:47 -07:00
Adam Williamson
651061ea10 openqa_dispatcher: revise for fedmsg hub consumer
ditch the old systemd consumer service, install the fedmsg
consumer config file, add some fedmsg-hub reload notifications.
2016-03-07 12:06:41 -08:00