Commit graph

41325 commits

Author SHA1 Message Date
Carl George
fafd6f1adc batcave: delete excluded content in CentOS sync scripts 2024-07-15 21:30:51 -05:00
Patrick Creech
fe5216bb1f If description doesn't exist, use title instead 2024-07-15 18:16:00 -04:00
Mikolaj Izdebski
ca64df8b20 people: Fix broken assets URLs
Related: https://pagure.io/fedora-infrastructure/issue/12051
2024-07-15 12:43:22 +02:00
Kevin Fenzi
84b71edf51 koji_builder: try telling dnf to download filelists in prod
This sort of seemed to work in staging (although there is some issue
with staging koji).

So, lets try it in production. It will make all the boostrap repo regens
a little slower, but it should get epel8 back working hopefully for now.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-13 11:04:47 -07:00
Kevin Fenzi
28d03c6145 koji_builder / staging / mock site defaults: try adding option for fileslists for epel8
lets try setting the opt to download filelists for the bootstrap chroot.
This is needed for epel8 because the deps for dnf need to resolve
/usr/libexec/platform-python and cannot due to f40 dnf not downloading
filelists by default anymore.

This will affect all bootstrap chroot creation, but it seems the
simpilest solution without changes in koji.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-13 10:26:50 -07:00
Kevin Fenzi
8925937958 pagure: Drop incorrect robots.txt entry
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-13 10:21:28 -07:00
Michal Konecny
19769b6e77 [mailman3] Add info about disabled search
Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-07-12 11:05:29 +02:00
Michal Konecny
cdd78d1442 [mailman3] Disable search in hyperkitty
Mailman has huge memory spikes after migration, those are caused by visiting
`/archives/search` URL. This is probably because of the search index still being
regenerated.

This patch will disable the search from both web UI and as a HTTP URL endpoint.

Fixes https://pagure.io/fedora-infrastructure/issue/12043

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-07-12 11:05:18 +02:00
Patrick Creech
e6ef09084e Update developer sync to work with feedparser 6
feedparser 6 went through some refactorings, this updates rss.py to use
the new location of _HTMLSanitizer
2024-07-11 23:42:54 +00:00
Kevin Fenzi
34e1bb3e8d pagure: block some ips that are using too much resources
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-11 16:33:03 -07:00
Kevin Fenzi
521aa7bc19 koji_hub: add a httpd drop in config to allow fedora-messaging plugin to work
The fedora messaging plugin needs to have MemoryDenyWriteExecute=no
The default is yes, and it causes it to not work at all.
We should probibly investigate and fix this if we can so we can enable
this protection someday.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-11 15:37:01 -07:00
Nils Philippsen
f15d8572b4 people: Set git directories as safe
Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-07-11 17:23:16 +00:00
Nils Philippsen
129de273e9 Remove remnants of people01/02 distinction
Since people02 is gone, all the special cases aren’t necessary anymore.

Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-07-11 15:59:10 +02:00
Nils Philippsen
76c562df3f Appease yamllint on a couple of files
Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-07-11 15:57:14 +02:00
Michal Konecny
b8ea561123 [ipa/server] Remove RHEL 8 entries
We only now run IPA on RHEL 9, so let's clean the playbook a little bit.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-07-11 12:15:13 +00:00
bd1f4f82e8
firmitas: add imagestream template and task
Signed-off-by: David Kirwan <davidkirwanirl@gmail.com>
2024-07-11 10:36:16 +01:00
Aurélien Bompard
c0dc013186
Poddlers: remove MBS
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-11 10:40:34 +02:00
Michal Konecny
a048feb1ea [mailman3] Fix mailmanweb not starting
Remove the `--log-level=debug` as this is causing failure when starting
mailmanweb service.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-07-11 10:03:49 +02:00
Michal Konecny
e3de4275bd [mailman3] Enable autostart for timers
To be able to enable timer it needs to have WantedBy in [Install] section. Let's
add a hyperkitty.target to that section.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-07-11 09:32:50 +02:00
Michal Konecny
2f1529f76e [mailman3] Disable sending e-mails on staging
This commit is setting both mailman and hyperkitty to devmode and doesn't allow
them to sent mails anywhere.

I tested that from web UI and using `mail` command on the machine.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-07-11 09:30:42 +02:00
Nils Philippsen
ba92fb5339 Warn about str.format() in toddlers config
The configuration does the right thing now, but add the warning
nonetheless, so subsequent changes are less likely to be breaking.

Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-07-10 13:54:22 +02:00
Neil Hanlon
33cc3e0092 monitor-dashboard: fix image URI for oauth-proxy (redux) 2024-07-10 11:23:11 +00:00
Aurélien Bompard
da9ed00c5c
Badges: fix repo update script
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-10 07:20:11 +02:00
Kevin Fenzi
99514bbad0 koji / staging: move hub and builders in staging to fedora 40
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-09 13:32:12 -07:00
Kevin Fenzi
1da59362cd mailman: adjust some settings to try and avoid OOM
Set django to have 4 workers and have a retry longer than the timeout.
Disable local memcached and use the memcached01 instance.
Enabled debug logging on gunicorn to see what it's doing.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-09 13:27:32 -07:00
Aurélien Bompard
506ae2da05
Typo
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 19:00:05 +02:00
Aurélien Bompard
691afa08d3
Badges: rename the cla_done group
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 18:29:39 +02:00
4f539f2fd5 Added fedora-join to roles/openshift-apps/badges/templates/fm-fedbadges.toml
Adding the fedora-join group to fm-fedbadges.toml in order to automatically check for membership and assign the welcome-wagon badge.
2024-07-09 15:57:36 +00:00
Michal Konecny
3f7ee665d6 [toddlers] Disable distgit_commit_processor
The distgit_commit_processor is generating a lot of error messages, let's
disable it for now.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-07-09 16:44:08 +02:00
Michal Konecny
3d335893a3 [toddlers] Fix distgit_commit_processor templates
In https://pagure.io/fedora-infra/ansible/pull-request/2137 nils introduced the
fix for poddlers, but we need this for toddlers as well.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-07-09 16:31:38 +02:00
Nils Philippsen
52329a4c46 toddlers: Fix distgit_commit_processor templates
These are passed to str.format() which confusingly doesn’t expect quotes
around dictionary keys and adds them to the looked up key string,
yay!

Related: #183

Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-07-09 14:29:01 +00:00
james02135
abbddf11db Change typo from isos to iso, exclude source
Signed-off-by: james02135 <james02135@hotmail.com>

Change typo from isos to iso, exclude source

Signed-off-by: james02135 <james02135@hotmail.com>

Fix typo in centos 9 sync script

Signed-off-by: james02135 <james02135@hotmail.com>

Include the appropriate exclusions in the CentOS 9 script

Signed-off-by: james02135 <james02135@hotmail.com>
2024-07-09 10:57:12 +00:00
Stephen Gallagher
23311d8f9c AMQP: Fix pointless yamllint failures
Signed-off-by: Stephen Gallagher <sgallagh@redhat.com>
2024-07-09 10:47:36 +00:00
Stephen Gallagher
1e004c1252 AMQP: Add more routing keys for ELNBuildSync
EBS expects to receive notifications for task state changes as well as
the start of repo regeneration. Otherwise, it has to fall back to
polling, which is much slower (and what it has been doing for some time
now).

Signed-off-by: Stephen Gallagher <sgallagh@redhat.com>
2024-07-09 10:47:36 +00:00
Aurélien Bompard
fca7a63c6f
Give the macro access to the context
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 12:39:51 +02:00
Aurélien Bompard
915db29767
Add a comment
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 12:36:02 +02:00
Aurélien Bompard
e7817be546
Mirrormanager: adjust the supplementalGroups
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 12:33:17 +02:00
Aurélien Bompard
b847ea4815
Don't run a chgrp -R all the time (speeds up pod creation)
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 11:52:32 +02:00
Aurélien Bompard
d2d34ab68d
Mirrormanager: set the security context in the frontend as well
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 11:43:53 +02:00
Aurélien Bompard
6f003a1dab
Try to set the CEPHFS group to a fixed value
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 11:33:38 +02:00
Stephen Smoogen
a0397d7abb Add blocks to nagios.conf httpd
I forgot I am the expert on nagios configs so added it to the template
file.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2024-07-09 09:18:56 +00:00
Stephen Smoogen
969bbfcf2a Add blockers to dl.fedoraproject.org
Looked at logs of servers being hit by the 'non-responsive' bots and
the following were hit heavily every day multiple times a day:

100006 nagios.fedoraproject.org-access.log
102150 koschei.fedoraproject.org-access.log
162296 lists.fedoraproject.org-access.log
495776 fedoraproject.org-access.log
850471 dl.fedoraproject.org-access.log

Added bloks to dl.fedoraproject to try and lower its hit rate. Others
need review from people who know their internals more.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2024-07-09 09:18:56 +00:00
Stephen Smoogen
7e426dbf37 Add more spiders which do not seem to honour robots.txt
I went through the last couple of logs afer the first round of 'turn
off the spiders' went out. I looked at the areas which the /robots.txt
disregard and then looked for the bots which ignored it and still
looked up stuff in 'accounts'. This may cut down CPU spikes as these
are looking at dynamic data which can 'blow' things up.

It might be good to add similar tooling to pagure and src since they
seem to be hit a lot in the logs also.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2024-07-09 09:18:56 +00:00
Aurélien Bompard
377e83fdd1
Fixup
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 11:06:50 +02:00
Aurélien Bompard
f931febe61
Mirrormanager: adapt to the new version of generate-worldmap
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-09 10:33:32 +02:00
Aurélien Bompard
3b680accf3
Poddlers: fix cron job
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-08 11:35:31 +02:00
Carl George
61053600c3 mirrormanager: update EPEL regexes for EPEL 10
Previously these regexes only matched a single digit for EPEL paths.
This changes them to match multiple digits, and also to optionally match
a minor version.
2024-07-08 08:42:57 +00:00
Aurélien Bompard
71f07579c6
Poddlers: fixup
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-08 10:29:57 +02:00
Aurélien Bompard
849bb32726
Poddlers: fixup
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-07-06 08:43:33 +02:00
Kevin Fenzi
115c22652d bodhi / backend: remove epel8-next sync too
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-05 18:30:16 -07:00