Commit graph

1038 commits

Author SHA1 Message Date
Pavel Raiskup
5307818474 aws: epel9 repofile && gpgkey 2024-03-13 19:12:26 +01:00
Aurélien Bompard
2a5c65051b
Update create-filelist with PR 86
https://pagure.io/quick-fedora-mirror/pull-request/86

Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2024-02-26 13:23:14 +01:00
Kevin Fenzi
1da5038fcb base repos: make everything pointing to infrastructure use https
There's no reason any of these should be http.
https://infrastructure.fedoraproject.org should be valid and work
everywhere.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-15 10:41:05 -08:00
Frank Ch. Eigler
d67817bd88 debuginfod: enlarge rpm-extraction fdcache
Thanks to the recently shrunken database schema (~150GB for all of
fedora 35+) and generous storage on the VM servers (~1TB available),
we can dramatically increase the cache size.  Along with debuginfod
upstream improvements (brought in via a copr build), this should
drastically improve the responsiveness of the debuginfod service.
2024-02-14 03:23:00 +00:00
Andrew Heath
f97666a75d Add logrotate for proxy systems
Added rsyslog logrotate cong for proxy systems and a task land the
configs as well as fix some yamllint errors.
2024-01-15 09:55:20 +00:00
Aurélien Bompard
876c763701
Fix the cookie import script
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2023-10-12 11:07:59 +02:00
Aurélien Bompard
1b249c0a04
Add a script and a playbook to import IRC cookies to Matrix
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2023-10-11 10:19:54 +02:00
Stephen Smoogen
7d7d0bf0a8 Remove smooge from various aliases
Currently, I (Stephen Smoogen) do not have the time to work on Fedora
system administration items. However, I get a lot of email and people
see my email address in various places to ping me for working on
things. I feel it would be better to remove myself from those places
and let Fedora Infrastructure add someone else to replace me when it
is possible to do so.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2023-07-17 23:34:18 +00:00
Kevin Fenzi
e0cb1c5188 download: move centos items out of /srv/pub
We had centos stream and altarches and centos linux under /srv/pub on
external download servers. However, this breaks people who sync buffet
or the like from them because they suddenly get centos content that they
want to just get directly elsewhere. So, just move these up a leave so
they are out of the buffet target and people who want them can get them
elsewhere.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-07-12 15:53:43 -07:00
Kevin Fenzi
49d1a82f36 download-ib01: disable centos mirroring for now as it confuses things with rsync
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-05-16 10:10:41 -07:00
Frank Ch. Eigler
152c7f3d99 debuginfod: drop f33 & f34 from index, prepare for f40+
Tweak the -I/-X regex.
2023-05-02 00:20:27 +00:00
Kevin Fenzi
88b2bfcacc registry-index: just disable reg runs for now.
reg runs and gathers information from the container registry to make a
'pretty' web page at https://registry.fedoraproject.org. However, this
page is pretty useless and really only needs to update after branching
(if then). We may look at redirecting this to a static websites page
that has information on our containers at some point.

In the mean time reg sometimes creates a empty file that syncs out and
causes alerts. So, lets just completely disable it.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-05-01 09:11:45 -07:00
Jiri Kucera
e207a4cdf9 lsr-logs-clean: Normalize image names
Normalize RHEL image names to RHEL-X.Y. Since RHEL images are
produced quite frequently it is sufficient to keep just one
RHEL <major>.<minor> after the log expires.

Also add contacts to Linux system roles maintainers.

Signed-off-by: Jiri Kucera <jkucera@redhat.com>
2023-02-07 16:39:46 +01:00
Jiri Kucera
dc8c275f09 Clean /srv/pub/alt/linuxsystemroles/logs
Add cron task that prune /srv/pub/alt/linuxsystemroles/logs.

Related: RHELPLAN-104620

Sign-off-by: Jiri Kucera <jkucera@redhat.com>
2023-02-07 16:39:46 +01:00
Frank Ch. Eigler
873fed608d debuginfod: tweak caching, stop retaining f32 data
Signed-off-by: Frank Ch. Eigler <fche@redhat.com>
2023-01-12 21:20:34 +00:00
Clement Verna
e3a66f6a91 Use fedora 37 for OSBS buildroot
Signed-off-by: Clement Verna <cverna@tutanota.com>
2022-12-08 20:23:20 +01:00
Kevin Fenzi
0aece5b63e Fix rpmqa osbs plugin to look in the right place for rpmdb
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-11-16 14:15:02 -08:00
Kevin Fenzi
dcf30e51a9 osbs / prod: try upgrading the buildroot
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-09-30 18:22:48 -07:00
Kevin Fenzi
8fe6d2cf0c osbs / staging: try upgrading the buildroot
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-09-30 18:17:06 -07:00
Kevin Fenzi
3f253336e0 try dl here
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-06-17 12:37:37 -07:00
Kevin Fenzi
572ea9ba9d rhel6: set archive urls for fas
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-06-17 12:35:13 -07:00
Kevin Fenzi
2ff5956ff2 proxies: drop old zanata hack
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-06-01 20:52:46 -07:00
Kevin Fenzi
ddffeebb63 proxies: drop ipv6 restart script
Yesterdays fix: a script that restarted networking to bring back a ipv6
route on proxy11, causes:
Todays bug: restarting the interface every minute causes the nameserver
to burp and not find sundries01, so all the rsyncs fail. It seems to
handle this just fine now, so lets retire this glorious hack.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-05-19 16:31:30 -07:00
Kevin Fenzi
a02e57944f rhel9: disable advanced virt for now as it does not exist
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-05-19 14:02:39 -07:00
Frank Ch. Eigler
f0a0eb2ba9 debuginfod: tweak prefetch cache settings
Use more cache to avoid as much repeated archive busywork during
workload such as today since 8AM.
Related: https://sourceware.org/bugzilla/show_bug.cgi?id=29098
2022-05-18 23:38:41 +00:00
Kevin Fenzi
5e59e1f3ac add rhel9 repos
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-05-18 13:11:34 -07:00
Kevin Fenzi
af7c94951a and add the files
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-05-16 18:21:49 -07:00
Kevin Fenzi
1c792cf8c1 nbde: fix this with proper fixes
My last commit wasn't correct. It turns out we still need to:
a) drop the dracut made bogus "Wired Connection". We do this in
nbde_client-network-flush by removing the default connection file.
b) We also need to tell NetworkManager to not make 'Wired Connection 43'
for any non configured interfaces. We only want to use the ones we
configure and not any of the others that may or may not have link.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-05-16 18:19:34 -07:00
Kevin Fenzi
6f92ba3b9a nbde_client: workaround bug in dracut
In RHEL8.0->8.2 this all worked fine, because dracut was using legacy
networking. So, needsneed=1 would bring up network, it would not save it
to ifcfg files due to removing that dracut module all then NM would take
over. However, on RHEL8.3+ dracut started using NetworkManager. So, it
would bring up network, nbde_client would flush those so they had no
ip's on them, but dracut would hand off a "Wired Connection" NM profile
(even tho the interface had no ips now). It would then of course
activate it and boom, mess up your real Networking. It seems the logic
for handing off this network config is pivoting on needsnet=1. So, if we
switch to just 'ip=dhcp' it works and doesn't mess with your real
networking.
TODO: report this and try and get a real fix in either nbde_client or
dracut or both.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-05-16 17:11:27 -07:00
Dusty Mabe
803e4c9ffc
aws-iam-policies: fcos-upload-amis: add ability to cancel snapshot import
We had an import snapshot task get stuck and we don't have permission to
cancel it. This will enable us to run something like:

```
aws ec2 cancel-import-task --import-task-id import-snap-071b6e456e60146b7
```
2022-03-15 10:05:07 -04:00
Frank Ch. Eigler
2bf47f23fb debuginfod: apply thread-pool limits 2022-02-17 17:40:52 +00:00
Clement Verna
c07049af0f osbs: try to disable the import_image plugin in the worker customization
Signed-off-by: Clement Verna <cverna@tutanota.com>
2022-01-19 09:19:54 +01:00
Kevin Fenzi
bcd4365fec rhel sync: add advanced virt repo to sync and rhel8.repo files
We want to use advanced virt as it has a more tested/tweaked/patched set
of virt tools for our virthosts.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-12-01 14:37:29 -08:00
Frank Ch. Eigler
176ce60e33 debuginfod: add systemd drop-in tweaks
Already in effect on prod & stg, formalize these configuration tweaks
that limit overload, improve cgroup monitoring, and build tolerance to
transient fileserver problems.
2021-11-19 00:43:13 +00:00
Stephen Smoogen
95bb3249e6 ibiblio can rsync down cc-rdu01 for centos 2021-10-04 11:07:56 -04:00
Stephen Smoogen
19e0a22da1 turns out we had 2 syncs going on and the scripts needed cleaning. I have made a special file for centos downloads only and will let someone look at whether the other files are still needed 2021-10-04 08:47:14 -04:00
Stephen Smoogen
c6f0ec6ed5 revert to a working version of the sync script for rdu. The other version crashed out too often for some reason. 2021-10-04 08:29:57 -04:00
Stephen Smoogen
35cc062b71 fix syn-up-downloads.sh because I missed it needed a file argument in new code
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2021-10-01 08:30:43 -04:00
Stephen Smoogen
618bd95cf4 syncronize the ib01 and rdu01 download scripts to be more in line. This may not work but we can try
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2021-09-30 15:14:07 -04:00
Stephen Smoogen
16bf2c0a4e Add in support for mirroring centos-stream to the RDU-CC mirror. This will allow CBS and CI to use Stream-9 better
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2021-09-30 13:51:49 -04:00
Dusty Mabe
ddc89da862 aws-iam-policies: fcos-upload-amis: add ability to clean up AMIs
Adding DeregisterImage and DeleteSnapshot will allow us to prune
old AMIs from EC2.
2021-08-30 20:24:36 +00:00
Dusty Mabe
c2ceab0958 aws-iam-policies: fcos-upload-amis: group some policies with other similar ones
Move CreateSnapshot to be with ImportSnapshot. Move DescribeImageAttribute
to be with ModifyImageAttribute.
2021-08-30 20:24:36 +00:00
Frank Ch. Eigler
1af312bdd3 debuginfod: support f36+, enlarge fdcache
Fix the debuginfod sysconfig file to not stop at f32..f35 but go at
least to eleven ^W f39 for RPM inclusion.  Bump up the fdcache size
to 1024 entries so more archive pieces are retained unpacked, given
that the VMs still have pretty generous unused storage.

These changes are already hand-applied to prod and stg.
2021-08-18 20:35:49 +00:00
Kevin Fenzi
680ebd81db yum repos: drop failovermethod from secondary repo files too
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-29 14:15:11 -07:00
Kevin Fenzi
54a29eaaa1 repo files: drop failovermethod=priority as it's not been used in years
Additionally, newer fedora complains about it being invalid.
It was used back in the yum days and never ported to dnf.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-23 11:07:35 -07:00
Kevin Fenzi
f23fd1b7a1 totpcgi / 2fa: remove old totpci and files and roles.
Note: there are still some calls here in old fas in openshift, but we
will remove those when we remove old fas (likely as soon as zodbot is
ported over to noggin).

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-17 13:00:56 -07:00
Frank Ch. Eigler
47b5976abd debuginfod: tweak server configuration and proxy frontend
Codify a few debuginfod process parameters that appear to be working well.

Adjust incoming proxies to redirect the "/" URL to a wiki page, as
requested by FESCO.
2021-05-10 12:24:39 +00:00
Frank Ch. Eigler
12dc83f767 debuginfod: vm configuration for running service with ansible-based config file 2021-04-06 17:23:43 +00:00
Pierre-Yves Chibon
eefdc6f33b yumrepos: import the EPEL7 public key
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2021-03-30 14:34:01 +02:00
Pierre-Yves Chibon
aa3769d3bf yumrepos: Add an original-epel7.repo file for RHEL7/CentOS7 in aws
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2021-03-30 14:31:29 +02:00