Commit graph

37971 commits

Author SHA1 Message Date
Kevin Fenzi
fa6096d33d proxies: old fas2 never moved to ocp4
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 14:12:57 -07:00
Kevin Fenzi
fbc18add50 koji_builder: make iptables rule staging only until we are sure it is working there
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 12:54:03 -07:00
Kevin Fenzi
29efa52e94 koji_build: add identity to allowed list, add some comments
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 12:33:11 -07:00
Kevin Fenzi
20e0e74096 koji_builder: require ipset
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 12:07:00 -07:00
Kevin Fenzi
a3cf18320e koji_build: add new template file
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 12:05:52 -07:00
Kevin Fenzi
f545ece040 koji_builder: move update to templates for stg/prod
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 11:59:30 -07:00
Kevin Fenzi
e13df4173b koji_builder: fix typo and add tags
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 11:40:29 -07:00
Kevin Fenzi
1951c7fb1b koji_builder: first cut at a script to update osbuild api ip for builder firewalls
This is a quick, hacked up script that just runs once per minute and
updates the ip addresses for the osbuild koji plugin. The script calls
systemd's resolvectl without cache and puts the ips in a ipset. The
koji_builder firewall has a added rule to check that ipset for outgoing
connections that are allowed.

TODO: add some kind of error checking
TODO: probibly won't work on s390x builders as they can't reach the host
even with open firewalls, but should work for others.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 11:29:07 -07:00
Michal Konečný
022ac7036a [toddlers] Don't use DEBUG log level on production
Don't overflow the log with DEBUG messages on production for toddlers. This is
fine on staging, but on production this should be on demand.

Signed-off-by: Michal Konečný <mkonecny@redhat.com>
2022-07-28 14:30:21 +02:00
Pavel Raiskup
b56a7826c6 backend: IBM Cloud helper for reporting to support
We often get never-removed instances that need to be sent to IBM support
for manual removal.  This is the helper that eases the reporting part.
2022-07-28 08:46:38 +02:00
Kevin Fenzi
54f746d30e proxies: drop mirrors*.centos.org certs, use letsencrypt locally instead
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-27 10:28:59 -07:00
Kevin Fenzi
d09c0703bf proxies / reverseproxy / mirrors.stg.centos.org: also setup reverseproxy in stg
Since we split up stg and prod so they could have seperate ssl certs, we
need to also setup the reverseproxy for staging.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-27 10:25:09 -07:00
Kevin Fenzi
9f4fdacdeb proxies / mirrors.centos.org: switch to local letsencrypt ssl cert
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-27 10:13:35 -07:00
Kevin Fenzi
b8a4eda79e robosignatory: ima sign side tags, infra tag, modular tags and pending
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-27 10:02:01 -07:00
Kevin Fenzi
9ddd3e2e6d postfix / gateway: add bysender map
This is a hack to work around SPF screwing us for @fedoraproject.org
aliases. It only fixes email from @redhat.com, but due to bugzilla thats
a lot of email.

Without this:
bugzilla@redhat.com -> user@fedoraproject.org (expands) ->
user@gmail.com sent out directly to gmail and gets rejected because
we aren't in the redhat.com SPF record.

With this:

bugzilla@redhat.com -> user@fedoraproject.org (expands) ->
user@gmail.com but sent to mx2.redhat.com to deliver. Since
mx2.redhat.com definitely is in the redhat.com SPF record the email is
delivered fine and SPF checks pass.

This won't help for other domains with -all SPF records, but at least it
helps for all the redhat.com emails, of which there are a lot going to
fedoraproject.org aliases. :)

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-26 15:58:43 -07:00
Kevin Fenzi
7cf2d7b56a iptables / builders / staging: adjust to allow proxy01/10/101/110 in staging
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-26 14:22:55 -07:00
Kevin Fenzi
02154c2ef6 buildvm-a64.stg: move to f36
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-26 13:51:11 -07:00
Kevin Fenzi
4e3d057cbb builders_stg: do not set staging as datacenter for staging builders
This has caused them to pick up the iptables template for staging
instead of the one for their host group (koji_builder). There's no
reason to have staging as a datacenter for these, nothing checks it
besides the base iptables role hopefully.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-26 12:52:00 -07:00
Michal Konečný
cd0edc872d [toddlers] Disable all cron jobs on staging
The cron jobs are causing the queue to just fill up and the messages can't be
currently processed so they are just being processed in loops.
Disable them for now, till at least some mailing server will be available on staging.

Signed-off-by: Michal Konečný <mkonecny@redhat.com>
2022-07-26 13:15:37 +02:00
Kevin Fenzi
3688c1508d flatpak indexer: update to new bugfix release
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-25 11:33:36 -07:00
Adam Williamson
ebe67df74b openqa_onebox_test: disable message consumer mails
We don't want this box to be trying to email anybody.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-22 12:42:04 -07:00
Kevin Fenzi
aacb604700 odcs: disable fmc queue for now
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-22 09:23:42 -07:00
Mark O Brien
2003cd2b5b limit image builder to one buildhost in stg
Signed-off-by: Mark O Brien <markobri@redhat.com>
2022-07-22 11:49:33 +01:00
Kevin Fenzi
24088dfe9b postfix: put CA file back, needed to verify other certs
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-21 16:42:22 -07:00
Kevin Fenzi
a3c96c4032 postfix: gateway: consolidate tls settings and use chain-file.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-21 16:33:25 -07:00
Kevin Fenzi
a336ba2a9e postfix: use a chain file for ssl certs
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-21 16:25:10 -07:00
Kevin Fenzi
b54b8a0bb7 bastion / postfix: adjust gateway ssl cert to base name
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-21 13:39:43 -07:00
Kamil Páral
f91294e5d7 send compose and updates reports to test-reports list instead of test list
Related: https://pagure.io/fedora-qa/issue/700

Signed-off-by: Kamil Páral <kparal@redhat.com>
2022-07-21 16:13:38 +00:00
Michal Konečný
6a8a507572 [toddlers] Use the correct pagure user
There was a placeholder for pagure user in scm_request_processor configuration.
Let's change this to correct user.

Signed-off-by: Michal Konečný <mkonecny@redhat.com>
2022-07-21 16:51:08 +02:00
af4de4fbd7 mote: Add redis password & liveness probes 2022-07-21 08:47:51 +00:00
Kevin Fenzi
c287d34d44 robosignatory: sign f37-rebuild side tag, enable ima
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-20 14:33:36 -07:00
Stephen Smoogen
16b5e17c19 Fix DNS issues in IAD2
Problem: Fedora Infrastructure has used various DNS servers in
PHX2. Those no longer exist. This is causing breakage in DNS and many
other internal services.

Fix: Work with Red Hat IT
     - to get new DNS servers which are infoblox devices.
     - get firewall rules fixed to that
     - update named.conf to have new ips
     - remove old ips which no longer exist.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2022-07-20 09:45:04 -04:00
Kevin Fenzi
aea127f83d rabbitmq: double cluster vm memory
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-19 14:16:54 -07:00
Kevin Fenzi
debbc13616 koji_builder: disable/stop systemd-oomd on builders
systemd-oomd seems to be a bit eager and kills builds before the kernel
OOM would have. Disable it for now and see if it helps memory hungry
builds any.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-19 11:26:38 -07:00
Luca BRUNO
7702ab7584
coreos-cincinnati: deploy current git (24516a0) 2022-07-19 14:26:57 +00:00
Luca BRUNO
95c1ae8111
coreos-cincinnati: build current git (24516a0) 2022-07-19 14:18:55 +00:00
Kevin Fenzi
443222f804 dhcpd: add some buildhw-a64s
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-18 19:27:47 -07:00
Kevin Fenzi
dc85205755 osci: remove queue-3
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-18 09:28:01 -07:00
Miroslav Vadkerti
6db9b164a1 Add another OSCI queue
We need another queue as we are extending one of our triggers
to another topic.

Signed-off-by: Miroslav Vadkerti <mvadkert@redhat.com>
2022-07-18 16:26:22 +00:00
David Kirwan
068a93e272 flask-oidc: renaming config variables
Signed-off-by: David Kirwan <dkirwan@redhat.com>
2022-07-18 15:00:09 +01:00
Michal Konečný
9d7e034b68 [toddlers] Disable packager bugzilla sync on staging
distgit_packager_bugzilla_sync toddler doesn't work well on staging, because the
accounts from staging dist_git are not properly synced to staging bugzilla.
which is causing this toddler to run for too long and blocking the queue.

Signed-off-by: Michal Konečný <mkonecny@redhat.com>
2022-07-18 14:46:51 +02:00
David Kirwan
9b0d4ad38a flask-oidc: updating config variable
Signed-off-by: David Kirwan <dkirwan@redhat.com>
2022-07-18 12:28:05 +01:00
Jakub Kadlcik
28300df291 copr: make signd log into a file
This will log what keys were accessed via `sign` command and from what
IP address.
2022-07-18 11:22:05 +02:00
Kevin Fenzi
e7daae10f7 batcave: pdr cleanup cron needs a / so it does not try and remove the directory
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-16 12:28:33 -07:00
Kevin Fenzi
fc93ccc61b dhcp: fix ip for bvmhost-a64-11
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-15 11:44:57 -07:00
Aurélien Bompard
82bead6642
Allow specifiying the username in scripts/generate-oidc-token
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2022-07-15 19:12:17 +02:00
Kevin Fenzi
ff52cbd435 rhel sync: make sure errors go to stderr so we see them
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-14 16:22:27 -07:00
Kevin Fenzi
9dde1370d0 dhcp_server: add bvmhost-a64-05 to 11 to dhcp
Apparently we never reinstalled these since we moved to iad2.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-14 15:46:26 -07:00
Adam Williamson
fb51893a84 openqa/workers: skip nbde-client on a64 workers
They aren't encrypted, and it causes networking config problems.
We'd like to solve the underlying problem but we don't know how,
this is good enough for now. Also drop the workaround things
again because they don't seem to help.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-14 14:07:12 -07:00
Adam Williamson
72a1f710d5 Add nirik's nbde client fixups to openQA worker playbook
nirik did some stuff in the virthost and buildhw groups to try
and deal with a problem where network configuration created
during the initrd phase for the nbde_client role is activated
by NM during the regular system boot phase, which results in
the network configuration not being the one we actually want
and carefully set up. However, he didn't add this stuff to the
openqa-workers group playbook even though that uses the
nbde_client role too, and we sure are having the same problem
on the openQA workers. Adding it now to see if it helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-14 12:35:03 -07:00