Commit graph

392 commits

Author SHA1 Message Date
054a049eae Fedora 33 is going EOL
Signed-off-by: Tomas Hrcka <thrcka@redhat.com>
2021-11-30 15:15:19 +00:00
Igor Raits
d95c706959
koji_hub: Allow side tags for the EPEL9 (and epel8-next)
Signed-off-by: Igor Raits <igor.raits@gmail.com>
2021-11-27 18:38:15 +01:00
Leo Puvilland
a25a46b312 Add nano to hosts 2021-11-03 22:13:31 +00:00
Kevin Fenzi
049a0a604c koji hub / gc: update for f35 and f36 koji garbage collection
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-08-12 10:45:01 -07:00
e15133639e Branching f35 from rawhide
Signed-off-by: Tomas Hrcka <thrcka@redhat.com>
2021-08-10 15:17:02 +00:00
Nils Philippsen
9a5d550570 Koji: prepare for prod deployment of rpmautospec
The relevant parts were made conditional and only applied in the staging
environment, change that. Alongside, ensure the obsolete hub plugin
package and plugin configuration files are removed and don't
automatically update any of the involved packages.

Signed-off-by: Nils Philippsen <nils@redhat.com>
2021-06-17 15:45:19 +02:00
Kevin Fenzi
e887af865d koji_hub: setup cron job to clean up old and empty side tags daily.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-06-04 09:56:30 -07:00
Mohan Boddu
ec779e9721 F32 EOL
Signed-off-by: Mohan Boddu <mboddu@bhujji.com>
2021-05-25 14:44:41 -04:00
Kevin Fenzi
1bbfd7f02f koji_hub: increase max_delete_processes from 4 to 20
This is the threads that are doing deletes of repos. Since we have so
many repos, lets increase the delete threads as well so it can hopefully
keep up.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-17 10:17:43 -07:00
Kevin Fenzi
421fbeff12 koji_hub: add fwupd-efi to secure boot channel.
See https://pagure.io/fedora-infrastructure/issue/9912

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-17 10:08:53 -07:00
Kevin Fenzi
70d9f69a00 koji / kojira: switch back to the shipped version of kojira
We had a patched version, but the patches have been merged upstream so
we should switch back to using the 'stock' kojira.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-02-22 10:26:01 -05:00
Kevin Fenzi
2e415fc383 koji_hub / kojira: restart kojira when kojira.conf changes
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-02-11 09:23:15 -08:00
Kevin Fenzi
421f5b7cd8 koji_hub / koji_builders: enable save_failed_tree
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-02-10 16:19:41 -08:00
c6b02d2071 Branching f34 from rawhide
Signed-off-by: Tomas Hrcka <thrcka@redhat.com>
2021-02-09 19:09:18 +01:00
Kevin Fenzi
cdc344bb27 koji_hub / kojira: keep repos for 3 days instead of 1
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-02-03 06:33:32 -08:00
Kevin Fenzi
0da9feb845 koji_hub / gc: do not prune signed copies from epel8-infra
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-01-18 17:15:27 -08:00
Mark O'Brien
27a986ab85 koji: enable kojira run on boot in koji02 only 2021-01-15 16:08:52 +00:00
Kevin Fenzi
e78782bfe4 koji_hub: drop a stray space
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-12-22 17:57:45 -08:00
Kevin Fenzi
975269fbf0 koji_hub: keep koschei scratch build logs for 14 days instead of 7
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-12-22 17:56:28 -08:00
Kevin Fenzi
1b3282fb81 koji_hub: re-enable koji-gc delete job again
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-12-22 17:30:50 -08:00
Kevin Fenzi
e6f949df9b koji_hub: disable delete koji-gc job, re-enable purge
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-12-14 17:15:19 -08:00
Kevin Fenzi
83b0900ddd koji_hub: disable prune for now until we find out why it is causing db issues
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-12-13 16:19:07 -08:00
Kevin Fenzi
dbade2fa0b koji_hub: also allow epel7/8 side tags
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-12-10 15:36:42 -08:00
Kevin Fenzi
a1b08fa64d kojira: Tags for seperate src repos seperated by space, not ,
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-11-25 17:05:54 -08:00
Kevin Fenzi
9f4c79b8a1 koji_hub: kojira: enable src repo for eln-build also.
See https://pagure.io/releng/issue/9746
It's desired to have a src repo for eln-build so queries can be done
against it. This enables this for eln-build. If it turns out to cause
too many problems we can disable it again.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-11-24 14:50:56 -08:00
Kevin Fenzi
72bc88bfc3 koji_hub: add fwupd to list of secure-boot packages
Turns out fwupd needs to also be signed right for secure-boot, so we
should add it to the list of packages in koji that needs the secure-boot
permission. This should prevent provenpackagers from building it and
pushing out an inoperative one.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-11-24 14:49:56 -08:00
Mohan Boddu
73dc8a1042 F31 EOL
Signed-off-by: Mohan Boddu <mboddu@bhujji.com>
2020-11-24 17:19:23 +00:00
Kevin Fenzi
9a7d1e393c koji_hub: add fedora-34 to koji-gc list.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-10-28 11:39:25 -07:00
Kevin Fenzi
d2ced7d818 Allow eln to do side tags: see https://pagure.io/fedora-infrastructure/issue/9329
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-09-22 15:14:51 -07:00
Kevin Fenzi
3ffbd473f9 koji hub / heavybuilder: we do need a wildcard here.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-08-14 09:01:51 -07:00
309026dcc3 Branching F33 from rawhide
Signed-off-by: Tomas Hrcka <thrcka@redhat.com>
2020-08-11 16:07:06 +00:00
Kevin Fenzi
4dc3a0029d koji_hub / kojira: rebase kojira for new koji release
One of the 2 patches we were carrying for kojira was merged upstream in
1.22. The other wasn't yet, so we need to keep it around for now.
But we need to merge in the other 1.22 changes or auth fails.
Hopefully this rebases to 1.22

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-08-07 13:42:28 -07:00
Kevin Fenzi
3304484fe9 koji: hub/kojid: drop kerberos config options that got dropped upstream
Upstream switched from python-requests-kerberos to
python-requests-gssapi and dropped some options.
Unfortunately, these cause kojid / kojira to not even start if they are
present, so we have to remove them to make things happy.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-08-07 13:17:49 -07:00
Kevin Fenzi
953a4e8204 koji_hub: try and make sure that making srpms from scm doesn't happen on s390x
The s390x boxes have been really slow of late and have i/o issues.
Lets make sure that we only use x86 and ppc64le hosts for this so to
avoid moving large srpms around.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-08-05 14:49:38 -07:00
Dusty Mabe
64322971e0 koji_hub: allow update/remove for sidetag owners
https://pagure.io/releng/issue/9229#comment-667272
2020-07-25 16:58:55 +00:00
Kevin Fenzi
103210fb36 koji / hub: set MissingPolicyOk False
This will mean that anything we don't have a policy for will be denied
instead of allowed. We want this (safer) default.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-07-23 09:43:26 -07:00
Kevin Fenzi
5179479e16 koji_hub / kojiweb: move the kojira queue file to the right place
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-07-02 12:05:47 -07:00
Kevin Fenzi
3f4db992c9 koji_hub / kojiweb: allow access to /mnt/koji/kojira
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-07-02 11:53:47 -07:00
Kevin Fenzi
4045f59f96 koji_hub / kojira: rename queue to be easier to type
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-07-02 11:51:23 -07:00
Kevin Fenzi
88907aa1c8 koji_hub / kojira: place the queue file where everyone can see it.
New versions of kojira can optionally produce a queue file.
This shows the buildroots that it knows need regeneration and
how long they have been known out of date. It might help users
see where a buildroot they are waiting for is in the queue.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-07-02 11:40:17 -07:00
Kevin Fenzi
1267685f1a koji_hub: readd the heavybuilder channel for chromium
This only works currently for aarch64. we have 2 buildhw's that have a
lot of resources for aarch64, except for disk, so they are great fast
heavy builders. All the other arches machines are pretty much all the
same, so this doesn't help on any of them.

We might someday expand this to more arches and packages when it makes
sense to.

In this case it takes a chromium build that takes ~24 hours
down to taking about an hour.

Note that we are currently keeping these in the default channel too so
they can do normal builds most of the time. That might make chromium
wait a bit, but still will end up being a LOT faster.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-30 12:15:01 -07:00
Kevin Fenzi
7ae76c1e5a koji_hub: go up to 1 day for keeping old repos around
1 hour seems a bit low, and we should be able to afford the tb or so for
1 days worth of them.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-28 17:27:09 -07:00
Kevin Fenzi
c18f74386b kojira: change expired/deleted repo expiry down to an hour
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-27 14:50:54 -07:00
Kevin Fenzi
d087aea236 koji hub: check in current/patched kojira and adjust newrepos
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-27 11:19:31 -07:00
Kevin Fenzi
5521021287 koji_hub: put in hotfixed kojira and config for it
The stock 1.21.1 kojira has a number of problems.
It only does deletes rarely as part of the main thread, so if you are
needing to delete a ton of old repos it will never get to them all.
Also, it checks for it's running newrepos at a place in the loop that
causes it to take a lot longer to notice when it's hit the max for
newrepos.

So, this is the 1.21.1 version, and we will check in the diff/hotfix
which is upstream head version + several patches.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-27 11:16:21 -07:00
Kevin Fenzi
5870df1ea8 koji_hub: switch mpm to one that works with h2.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-18 18:43:47 -07:00
Mohan Boddu
2ca39a0a3c Use eln* tags instead of eln or eln-rebuild
Signed-off-by: Mohan Boddu <mboddu@bhujji.com>
2020-06-18 17:01:44 -04:00
Mohan Boddu
ddc6fb16d6 Adding perms to tag secure-boot packages to eln tags
Signed-off-by: Mohan Boddu <mboddu@bhujji.com>
2020-06-18 18:00:19 +00:00
Igor Raits
58ae9e93c2
koji_hub: Allow blocking/unblocking packages for sidetag owners
Signed-off-by: Igor Raits <i.gnatenko.brain@gmail.com>
2020-06-18 17:49:07 +02:00
Igor Raits
68185ee5eb
koji_hub: Disallow f30-based sidetags
Signed-off-by: Igor Raits <i.gnatenko.brain@gmail.com>
2020-06-18 17:38:34 +02:00