infrastructure/ansible
1
0
Fork 0
Code Issues Pull requests 7 Projects Releases Packages Wiki Activity Actions
42856 commits 9 branches 0 tags 110 MiB
Commit graph

8793 commits

Author SHA1 Message Date
Jeremy Cline
0571feb2ce fedora-image-uploader: deploy as multiple containers 
In the beginning, this just handled Azure images. Now it does Azure,
AWS, GCP, and containers. Currently, it processes images serially, which
is mostly okay. However, it does mean that whatever service is handled
last has to wait for all the others to succeed before it starts, and it
also means if any of the handlers for their respective platform fail, it
retries *all* the images again. For most things this is a no-op (or a
few inexpensive calls), but it does have to re-download the image from
Koji to checksum it.

This adds an AMQP message queue for each content type we handle, and
produces a fedora-messaging config for each content type. The deployment
is now made up of 4 containers: azure-image-uploader,
aws-image-uploader, container-image-uploader, and
google-cloud-image-uploader. They only differ in the secrets injected
into them and the fedora-messaging config file they use. The end result
is that images should be available faster and its more resilient to
remote services being down.

Finally, it's worth noting that this bumps the warning threshold for
queue sizes. It can take some services (Azure and AWS) upwards of 30
minutes to replicate the images around the world, and since we subscribe
to _any_ compose status changes, it's not unreasonable for 5-10 messages
to stack up when we hit a compose change that is "FINISHED" with images.

Signed-off-by: Jeremy Cline <jeremycline@linux.microsoft.com>
 2025-04-29 18:25:08 +00:00
Patrik Polakovič
bdc169d3c7 Add Fedora version variable to the playbook 
Signed-off-by: Patrik Polakovič <patrik@alphamail.org>
 2025-04-28 12:18:58 +02:00
Kevin Fenzi
bea41a6732 koji / staging sync: increase sequences to be higher than prod 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-04-25 09:15:08 -07:00
Kevin Fenzi
4da0ff7c4d koji / sync staging: drop removed warn arg 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-04-25 09:06:23 -07:00
Kevin Fenzi
dc1b09121b ipsilon: use correct centos stg ipsilon host for hbac rule 
This was using the wrong host and thus removing the correct one.
Fixing it to use the right host.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-04-24 09:26:09 -07:00
apiaseck
a4aaf6f0d0 fedora-ostree-pruner: Move from deprecated DeploymentConfig to Deployment 
First try aat move from deprecated DeploymentConfig to Deployment using staging environment.

See: https://github.com/jbtrystram/coreos-hackathon/issues/13
 2025-04-15 15:22:57 +00:00
apiaseck
678f318f4c coreos-ostree-importer: Move from deprecated DeploymentConfig to Deployment 
First try aat move from deprecated DeploymentConfig to Deployment using staging environment.

See: https://github.com/jbtrystram/coreos-hackathon/issues/13
 2025-04-15 15:22:57 +00:00
apiaseck
91beda6fc4 coreos-cincinnati: Move from deprecated DeploymentConfig to Deployment 
First try aat move from deprecated DeploymentConfig to Deployment using staging environment.

See: https://github.com/jbtrystram/coreos-hackathon/issues/13
 2025-04-15 15:22:57 +00:00
apiaseck
1d5588e5ab coreos-koji-tagger: Move from deprecated DeploymentConfig to Deployment 
First try at move from deprecated DeploymentConfig to Deployment using staging environment.

Using the information related to moving to Deployment as per:
https://github.com/jbtrystram/coreos-hackathon/issues/13

See: https://github.com/jbtrystram/coreos-hackathon/issues/13
 2025-04-15 15:22:56 +00:00
Joel Capitao
83e9619526 fedora-coreos-pipeline: use jcapitao Fedora account URI 2025-04-14 07:46:39 +00:00
Aurélien Bompard
d884a0f8ba
Use the combined RabbitMQ CA cert in the clients 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2025-04-11 15:15:45 +02:00
Joel Capitao
3322ae0888 fedora-coreos-pipeline: add Joel Capitao (jcapiitao) 2025-04-08 17:09:05 +00:00
Tiago Bueno
a0bdc9b9ab Add new team member to fcos-pipeline 
Signed-off-by: Tiago Bueno <49003339+tlbueno@users.noreply.github.com>
 2025-04-08 17:07:28 +00:00
Adam Piasecki
5f0fcd4a79 playbooks/fedora-ostree-pruner.yml: Add apiaseck to appowners 
As I'm working on moving fedora-ostree-pruner to k8s deployment
I'm blocked by Zuul due to lack of permissions.

See: https://pagure.io/fedora-infra/ansible/pull-request/2331
 2025-04-08 16:58:36 +01:00
Josef Skladanka
b6a6aa5821 Testdays - try OIDC 2025-04-07 11:52:26 +02:00
Kevin Fenzi
ee5d2b3a57 poddlers: add jnsamyak for releng work in poddlers 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-04-01 08:43:01 -07:00
Adam Williamson
721ffe0df4 proxies: drop caiapi 
this isn't a thing any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
 2025-03-28 18:11:11 +00:00
Kevin Fenzi
b1363750ce waiverdb: also delete the playbook play referring to the template that was just removed 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-28 11:00:34 -07:00
Lukas Holecek
6426d72854 waiverdb: Remove unnecessary image build 2025-03-28 17:55:33 +00:00
Aurélien Bompard
292c7f6c6e
Deploy journal-to-fedora-messaging on IPA (staging for now) 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2025-03-28 12:37:56 +01:00
Kevin Fenzi
33415d8399 proxies: riscv reverse proxies are not on ocp4 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-27 15:39:00 -07:00
Kevin Fenzi
1f2bba4489 bvmhost-a64 / buildhw-a64: enable nbde role here as well 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-26 16:17:37 -07:00
Pavel Raiskup
33e01feafc copr-frontend: upgrade using dnf command 
The Ansible dnf module still fails to update packages to the latest
versions, for an unknown reason.
 2025-03-26 08:06:49 +01:00
Pavel Raiskup
d2873f81f7 copr-frontend: try to expire all caches 
Ansible still doesn't update the packages :-(
 2025-03-26 08:03:40 +01:00
Pavel Raiskup
0f07d5c9d0 copr-frontend: update dnf caches when updating packages 2025-03-26 08:00:09 +01:00
James Antill
f74cd17a23 Add regexp to drop spaces from hostnames in prompts, for add_host. 
Signed-off-by: James Antill <james@and.org>
 2025-03-25 20:36:02 -04:00
James Antill
aa5691d1b5 Add regexp to drop spaces from hostnames in prompts. 
Signed-off-by: James Antill <james@and.org>
 2025-03-25 20:00:53 -04:00
Kevin Fenzi
4ab30bdc37 backup: also add nbde role to backup server 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-25 11:33:11 -07:00
Kevin Fenzi
f54142e770 backup: add serial console config here 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-25 11:29:59 -07:00
Kevin Fenzi
a4985b880b proxies / riscv-kojipkgs: try and get it to use the right template 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-24 16:44:12 -07:00
Kevin Fenzi
3c4d4250c0 proxies / riscv-kojipkgs: also need to set proxyurl 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-24 16:34:02 -07:00
Kevin Fenzi
81ca9bd8a1 proxies: add a riscv-kojipkgs virthost/proxy 
We are actually just pointing these to the hub for now, but we have them
seperated in case we want to make a seperate kojipkgs for this.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-24 16:23:11 -07:00
Josef Skladanka
1219776da7 Add lbrabec as appowner to FQA apps 2025-03-24 22:30:11 +01:00
Josef Skladanka
a8672eac88 Testdays - add kparal to appowners 2025-03-24 20:03:50 +01:00
Samyak Jain
b4e6f57a4a playbooks/groups/secondary.yml: Install isomd5sum package on secondary servers 
Added `isomd5sum` to the list of installed packages in `playbooks/groups/secondary.yml`
to support checksum verification tests on `secondary01.fedoraproject.org`.

This ensures that `isomd5sum` is available for testing workflows, particularly for
QA tasks related to Fedora media checksums.

Signed-off-by: Samyak Jain <samyak.jn11@gmail.com>
 2025-03-19 21:19:58 +00:00
Kevin Fenzi
5bfa8f4802 cloud-image-uploader: this role assumes /files/ in the path already 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2025-03-19 14:19:21 -07:00
Francois Andrieu
c906396525 websites: redirect kde to the edition page 2025-03-19 21:14:27 +00:00
Jeremy Cline
3c6ab8afd8 fedora-image-uploader: add Google Compute Engine support for staging 
This enables support for uploading images to Google Cloud in staging.

Signed-off-by: Jeremy Cline <jeremycline@linux.microsoft.com>
 2025-03-19 21:10:14 +00:00
Mark Rosenbaum
75fdb66594 Update playbooks/include/proxies-redirects.yml - Updated join.fp.o redirect 2025-03-19 20:58:02 +00:00
Josef Skladanka
4761b75c97 Add lbrabec to appowners for testdays 2025-03-19 13:10:03 +01:00
Aurélien Bompard
90e0325597
D'uh 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2025-03-13 17:15:06 +01:00
Aurélien Bompard
4df684038d
Minor fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2025-03-13 17:13:55 +01:00
Aurélien Bompard
a32457a7aa
Add a playbook to sync the Badges DB to staging 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2025-03-13 17:12:34 +01:00
Pragyan Poudyal
a6177a5e52 Add pragyan-poudyal to appowners 2025-03-13 04:58:36 +00:00
Greg Sutcliffe
a69b10a128 resultsdb-ci-listener: deploy app via s2i 2025-03-07 13:06:46 +00:00
James Antill
31d65aa439 Actually move to nftables for any host with nftables: true (nothing atm). 
Signed-off-by: James Antill <jantill@redhat.com>
 2025-03-03 21:20:30 +00:00
Aurélien Bompard
c9b9086535
Add missing j2 suffixes 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2025-03-03 10:18:14 +01:00
Aurélien Bompard
097b8f9214
Give the clean packagers groups toddler access to the corresponding service's keytab 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2025-02-25 08:54:06 +01:00
Jiri Kyjovsky
1e8c7dcba9 copr: we now use dnf5 on copr, theres no need of dnf-plugins-core then 2025-02-24 13:56:45 +01:00
Patrik Polakovič
d63afb09d8 Remove all mentions of monitor-gating 
Signed-off-by: Patrik Polakovič <patrik@alphamail.org>
 2025-02-20 11:07:20 +01:00