Commit graph

36519 commits

Author SHA1 Message Date
Pavel Raiskup
17c08c18c1 copr-be: drop duplicate s390x limit 2022-01-17 10:15:40 +01:00
Pavel Raiskup
a691159346 copr-be: drop one useless condition in s390x quota 2022-01-17 10:10:57 +01:00
Pavel Raiskup
41df8091ab copr-be: deploy native s390x and Red Hat subscription to prod
While on it, setup the builder quota for max: 12 ATM, and we'll
communicate with IBM later if that's enough.
2022-01-17 10:04:52 +01:00
Kevin Fenzi
b6532ce193 buildvm_s390x: move to f35
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-14 11:49:12 -08:00
Kevin Fenzi
2d0ecc6cae buildvm_s390x: adjust mem and cpus on kvm s390x builders
We got some more resources a while back and so we wanted to make more
builders, but now we are waiting on disk space to do that. In the mean
time and since the mass rebuild is coming up tuesday, just upgrade them
to f35 and use the memory and cpus we have.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-14 11:47:38 -08:00
Pavel Raiskup
fbbddfe0b4 copr-be: playbook for building s390x images 2022-01-14 19:07:26 +01:00
Kevin Fenzi
4322a1a6a3 playbooks / manual / releng / koji-release-tags: drop make from new build groups
make was dropped from the build group a while back, but we have been
adding back in to new tags when we branch. Drop it here too so we don't
bring it back again.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-13 10:00:16 -08:00
Aurélien Bompard
b2229c6dfa
Improve datanommer's logging
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2022-01-13 16:25:00 +01:00
Adrian Reber
df910b3b23
Switch 'Fedora Archive' category to scan-primary-mirror
Scanning 'Fedora Archive' with the Python based scanner produces
following error for some time now:

/srv/pub/archive/fullfiletimelist-archive has changed since last run. Running umdl for Fedora Archive at Thu Jan 13 12:15:01 UTC 2022
Traceback (most recent call last):
  File "/usr/bin/mm2_update-master-directory-list", line 1122, in <module>
    sys.exit(main())
  File "/usr/bin/mm2_update-master-directory-list", line 1105, in main
    session, config, i['path'], category)
  File "/usr/bin/mm2_update-master-directory-list", line 970, in sync_directories_from_fullfiletimelist
    sync_category_directory(session, config, category, dirname, ctimes[dirname], file_dict, is_repo)
  File "/usr/bin/mm2_update-master-directory-list", line 617, in sync_category_directory
    session, config, relativeDName, D, category, 'repomd.xml')
  File "/usr/lib/python2.7/site-packages/mirrormanager2/lib/umdl.py", line 294, in make_repo_file_details
    yumrepo = rpmmd.repoMDObject.RepoMD('repoid', absolutepath)
  File "/usr/lib/python2.7/site-packages/rpmmd/repoMDObject.py", line 145, in __init__
    self.parse(srcfile)
  File "/usr/lib/python2.7/site-packages/rpmmd/repoMDObject.py", line 165, in parse
    for event, elem in parser:
  File "<string>", line 100, in next
  File "/usr/lib/python2.7/site-packages/rpmmd/misc.py", line 150, in read
    return self.checksums.read(self._fo, size)
  File "/usr/lib/python2.7/site-packages/rpmmd/misc.py", line 104, in read
    self.update(data)
  File "/usr/lib/python2.7/site-packages/rpmmd/misc.py", line 100, in update
    sumalgo.update(data.encode('utf-8'))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 273: ordinal not in range(128)
umdl for Fedora Archive returned non-zero. Something failed. Please check umdl.log. Thu Jan 13 12:17:45 UTC 2022

The new tool, scan-primary-mirror, does not have this problem and
I wanted to switch to it for some time already.

With this the error is gone and the new tool is used.

Signed-off-by: Adrian Reber <adrian@lisas.de>
2022-01-13 14:41:36 +01:00
Silvie Chlupova
2ea3cebe2b copr-fe: simpler rule for kerberos auth (in apache conf) 2022-01-13 14:19:50 +01:00
Pavel Raiskup
bc83b2e4c8 copr-builders: oslousl VMs waited with timeout, and verbosely 2022-01-12 17:15:02 +01:00
Pavel Raiskup
ed570d1562 copr-be: update the ppc64le image 2022-01-12 16:58:33 +01:00
Pavel Raiskup
ec5a00f25a copr-hypervisor: install glanceclient
We need to be able to upload the built images into OpenStack.
2022-01-12 16:56:03 +01:00
Pavel Raiskup
d1801a43e7 copr-builders: no need to have additional storage in osuosl 2022-01-12 16:32:44 +01:00
Pavel Raiskup
cb846847dc copr-hv: upload the ppc64le into OpenStack, too 2022-01-12 16:32:20 +01:00
Pavel Raiskup
8b4e1c0e15 copr-builders: Power9 boxes need to wait for ssh, too 2022-01-12 15:42:54 +01:00
Pavel Raiskup
e8bf32eb08 copr-builders: instantiate Power9 Oregon University OpenStack 2022-01-12 15:29:34 +01:00
Pavel Raiskup
88c881048d copr-builders: ibmcloud token filename on one place 2022-01-12 14:14:27 +01:00
Pavel Raiskup
fb905b9481 copr-builders: more pedantic swap setup on POWER9 2022-01-12 11:52:37 +01:00
Pavel Raiskup
16306a3558 copr-builders: swap and results on a loop device on Power9 2022-01-12 10:55:26 +01:00
Kevin Fenzi
5f14ef5388 pagure: fix typo in playbook enabling pagure_mirror service
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-11 17:30:22 -08:00
Kevin Fenzi
4ef9e9ba99 fasjson/aliases: disable flock aliases for now ( ticket 10411 )
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-11 16:36:18 -08:00
Adam Williamson
42ca4444ec Bodhi: update messaging queues for change in 5.7.1
In 5.7.1, Bodhi changed from consuming greenwave.decision.update
messages to consuming resultsdb and waiverdb messages, when
deciding whether to update an update's gating status. We need to
subscribe to the correct message queues for that to work properly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-11 11:53:49 -08:00
Adrian Reber
c6b8f53f85
Rerun primary mirror scan after one day
Signed-off-by: Adrian Reber <adrian@lisas.de>
2022-01-11 17:49:34 +01:00
Adrian Reber
41b2d49e3c
Also check SIGs COMPOSE_ID for centos
Signed-off-by: Adrian Reber <adrian@lisas.de>
2022-01-11 17:08:29 +01:00
Stephen Smoogen
0a7ac90878 remove hotspot analysis from web-data-analysis. It has been broken for over six months with no requests to fix 2022-01-11 05:42:47 -05:00
Kevin Fenzi
8f6381c245 buildvm-a32: fix kickstart for f35
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-10 15:20:24 -08:00
Kevin Fenzi
927e0cd793 arm builders: move to f35
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-10 14:56:59 -08:00
Kevin Fenzi
bf571230c4 buildvm-s390x: add a cache02 on buildvm-s390x-24
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-10 13:56:32 -08:00
Pavel Raiskup
333f125baa copr-builders: really install the epel-8-s390x config
Fix for 7c2719e7ff
2022-01-10 01:13:00 +01:00
Pavel Raiskup
7c2719e7ff copr-builders: provide epel-8-s390x config 2022-01-09 22:24:47 +01:00
Pavel Raiskup
fb673b2878 copr-builders: hypervisors shouldn't take s390x tasks 2022-01-09 22:14:21 +01:00
Pavel Raiskup
198c13a8b1 copr-builders: new s390x with appropriate metadata
Previously I couldn't pick "Fedora 34" OS type in IBM Cloud web UI, now
it was possible.  I bet this will diminish the need for additional
(e.g. subscription-manager) hacks.
2022-01-09 21:50:25 +01:00
Pavel Raiskup
ac25d3c9c4 copr-builder: unregister the s390x machines, too 2022-01-09 21:22:36 +01:00
Pavel Raiskup
cf6957dcc3 copr-builder: s390x: better matching prod/dev instances
Seems we have sometimes "-", sometimes "_", depending in which situation
the subscription-manager process fails :-(.
2022-01-09 21:15:39 +01:00
Pavel Raiskup
47e95419ec copr-backend: match prod/dev instances with "commas"
Complements: 07c54f11e2
2022-01-09 21:09:24 +01:00
Pavel Raiskup
24a2466b06 copr-builders: other s390x IBM Cloud fixes
Don't install subscription-manager when it is already installed.  Don't
even try to download the DNF metadata for that (at that point, the
subscription is not yet activated, and so the attempt to install
subscription-manager subjectively slows-down the spawning).

Try to subscribe a bit sooner, so we don't wait till the end of the
playbook for a potential subscription failure.

Run subscription-manager clean to which seems to way-around the
katello-* RPM hack.

One forgotten ibm-cloud-vm typofix (name vs. opts.name).

Define server_hostname to enforce the default rhsm server.
2022-01-09 20:46:29 +01:00
Pavel Raiskup
f133711de5 copr-builders: IBM Cloud may make the SWAP on /dev/vda, too 2022-01-09 20:01:34 +01:00
Pavel Raiskup
d3806102e9 copr-builder: fixes for s390x spawning 2022-01-09 19:48:00 +01:00
Pavel Raiskup
274d80ade8 copr-builders: ibm-cloud-vm: detect IP name only for create 2022-01-09 19:24:09 +01:00
Pavel Raiskup
a8a3d86620 copr-builder: local-image-update: use import instead of include
So we can use tags.
2022-01-08 21:40:24 +01:00
Pavel Raiskup
7a46737c44 copr-builders: two more typos 2022-01-08 21:02:08 +01:00
Pavel Raiskup
e6ecfdcdb9 copr-builder: check_output can't be used with stdout= 2022-01-08 20:59:10 +01:00
Pavel Raiskup
6ddb45f037 copr-builder: spawner should put only IP on stdout 2022-01-08 20:57:05 +01:00
Pavel Raiskup
0fc69a2392 copr-builders: different Pool ID for s390x
The other one doesn't seem to work.
2022-01-08 20:49:51 +01:00
Pavel Raiskup
ec7d85722f copr-builder: id in pool is int 2022-01-08 15:11:22 +01:00
Pavel Raiskup
ab03757115 copr-builders: fix PyLint warnings for s390x spawner 2022-01-08 15:01:06 +01:00
Pavel Raiskup
75b2d1aee6 copr-builders: better s390x Floating IP allocation 2022-01-08 14:57:45 +01:00
Pavel Raiskup
38151a6e5c copr-builders: another s390x spawner typo 2022-01-08 14:09:17 +01:00
Pavel Raiskup
c2266edb31 copr-builder: s390x spawner typo 2022-01-08 14:08:35 +01:00