Commit graph

426 commits

Author SHA1 Message Date
Pavel Raiskup
391e4ea7af copr-be: override centos-stream configs
This is needed for now because we are updating mock-core-configs,
and there is an incompatible variant of the centos-stream configuration:
https://pagure.io/copr/copr/issue/1691
2021-02-08 15:11:13 +01:00
Jakub Kadlcik
c7bcb48be7 copr: make sure that swap is available for our builders 2021-02-01 16:46:39 +00:00
Pavel Raiskup
863ef89512 copr: builders: disable bootstrap chroot for armhfp fedora
Users can disable bootstrap themselves, but it doesn't seem to be worth
bothering everyone while rhbz#1895363 is not moving anywhere.

More info:
https://pagure.io/copr/copr/issue/1660
https://bugzilla.redhat.com/show_bug.cgi?id=1895363
2021-01-27 09:49:29 +01:00
Pavel Raiskup
b9d52f1b65 copr: builders: drop best=0 EL8 hack
The default config + command:

    $ mock -r centos-8-x86_64 --install perl-Test-Harness

installs just

    perl-Test-Harness-1:3.42-1.el8.noarch, not

and not

    perl-Test-Harness-1:3.42-440.module_f33+9369+dac0eadc.noarch

or something alike.  I think we are fine to drop the hack for rhbz#1758459.
2021-01-27 09:40:12 +01:00
Pavel Raiskup
cc548317ac copr: builders: +20G build storage space
https://pagure.io/copr/copr/issue/1657
2021-01-27 08:58:26 +01:00
Pavel Raiskup
e646904fcd copr-be: fix && comment-out the cleanup-vms-aws command 2021-01-19 17:33:32 +01:00
Pavel Raiskup
66451136c2 copr-be: provision: don't create SWAP when preparing image
Only when the real builder is started.
2021-01-19 15:37:18 +01:00
Pavel Raiskup
d4e1b2d5bc copr-be: increase the chroot tmpfs space on builders
Mock allocated 75g before, and this started to be not enough for some
projects (tmpfs resides in ram + swap).  Increasing the size isn't a
huge deal for us since the major subset of builders is x86_64 and those
have pretty large (currently unused) swap disk size.  For aarch64 I had
to add a bit more storage to guarantee that the large tmpfs will fit
the swap (+17%).
2021-01-19 14:58:47 +01:00
Jakub Kadlcik
c8b0a00592 copr: separate describe-isntances filters with a space instead of a comma
Fixing the following issue

    Error parsing parameter '--filters': Second instance of key "Name" encountered for input:
    Name=tag-key,Values=Name,Name=tag-value,Values=copr-dev-builder-x86_64-20201212_122038_399669659
			    ^
    This is often because there is a preceeding "," instead of a space.
2020-12-12 14:08:06 +01:00
Pavel Raiskup
e8bc4f67e0 backend: provide mock profiles for re-enabling epel-6
We could avoid this if we added support for eol-ed but otherwise working
official config files in /etc/mock/eol/.
2020-12-09 19:18:17 +01:00
Jakub Kadlcik
f2e70b89bf copr: fallback to DEFAULT:FEDORA32 instead of LEGACY on builders
This option is less open/permitting, but should be good enough since
we are currently running F32 builders and haven't messed with the
crypto policy value. According to

https://fedoraproject.org/wiki/Changes/StrongCryptoSettings2#Upgrade.2Fcompatibility_impact

the `DEFAULT:FEDORA32` should be the first step and only when it is
not good enough, then we should fallback to `LEGACY`.

Thank you @nirik
2020-11-04 00:56:41 +01:00
Jakub Kadlcik
3ccd49e655 copr: remove unnecessary brackets
They messes up vim syntax highlighting and makes editing the file
remotely too annoying.
2020-11-04 00:27:19 +01:00
Jakub Kadlcik
10f62c6bb5 copr: fallback to the LEGACY crypto policies for builders 2020-11-04 00:26:14 +01:00
Jakub Kadlcik
47a0701583 copr: stop disabling systemd-resolved, the RHBZ 1710699 is already fixed
This works just fine now:

    $ mock --enable-network -r fedora-rawhide-x86_64 --shell
    ...
    <mock-chroot> sh-5.0# curl https://copr.fedorainfracloud.org/
    curl: (6) Could not resolve host: copr.fedorainfracloud.org
2020-11-01 18:11:54 +01:00
Jakub Kadlcik
39ea93ca97 copr: remove the python3-rpkg-1.60, RHBZ 1879471 is already fixed 2020-11-01 18:11:54 +01:00
Jakub Kadlcik
4f97eae38b copr: login as "fedora" user instead of root
Otherwise we get following error

    Please login as the user "fedora" rather than the user "root".

Which messes up our variables - `$fedora` contains the `Please login
as the user "fedora" rather than the user "root".` warning and
therefore `new_volume_name` is

    copr-builder-x86_64-fPlease login as the user "fedora" rather than the user "root".-20201101_155103
2020-11-01 17:05:24 +01:00
Jakub Kadlcik
1400b4f01d copr: keep builders on python3-rpkg-1.60 because of RHBZ 1879471
On F32, rpkg-2.7 doesn't work with python3-rpkg-1.61
See https://bugzilla.redhat.com/show_bug.cgi?id=1879471
Until this gets resolved, let's stay on the older version
2020-09-17 20:58:07 +02:00
Pavel Raiskup
b4b963d037 copr-be: start builders in random availability zones
Aarch64 hosts are not in all zones, so specify subnets per-architecture.
2020-08-25 11:20:36 +02:00
Pavel Raiskup
d72ce0481b copr-be: again disable @copr/copr on production builders
Because Koji infra tags seem to be working again.
2020-06-22 08:58:19 +02:00
Pavel Raiskup
6fbeb77fed copr-be: complement daae61472c 2020-06-19 10:01:03 +02:00
Pavel Raiskup
daae61472c copr-be: don't attempt to install mock from koji
We don't need it ATM, and currently it often fails for some reason
(perhaps related to Fedora outages):

TASK [install the latest mock and mock-core-configs from updates-testing] ******
Friday 19 June 2020  05:54:19 +0000 (0:01:07.155)       0:07:47.913 ***********
fatal: [52.90.206.190]: FAILED! => {"changed": false, "msg": "Failure
downloading
https://kojipkgs.fedoraproject.org/packages/mock/2.2/1.fc31/noarch/mock-2.2-1.fc31.noarch.rpm,
Connection failure: The read operation timed out", "results": []}
2020-06-19 08:44:43 +02:00
Adam Williamson
891da76e48 Drop an old unnecessary workaround
This is another use of blacklist, but the entire workaround has
been obsolete since a day after it was added, per
https://pagure.io/fedora-infrastructure/issue/8096 . I double
checked and the mirror still exists and is still up to date.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-12 10:08:28 -07:00
Pavel Raiskup
5ae974e4cd copr-be: temporarily allow @copr/copr on production builders
We can not build copr-rpmbuild package in Koji now (outage) so let's use
the copr's one.
2020-06-09 23:13:00 +02:00
Pavel Raiskup
bb5bbf2704 copr-be: better ssh client configuration
- don't wait too long for SSH connection timeout (set it to 60s), we
  we will be restarting the build by backend when the last 4 attempts to
  contact builder failed more quickly than each 2 minutes.
- make the keep alive interval much smaller than the connection timeout
  is
2020-06-04 21:18:38 +02:00
Silvie Chlupova
2be7045bfc copr/backend: creating a new partition for /var/cache/mock
Fixes: #787 in copr
2020-06-03 14:53:43 +00:00
Pavel Raiskup
f2d318bc73 copr: builders: update tito
https://pagure.io/copr/copr/issue/1386
2020-06-01 14:47:14 +02:00
Pavel Raiskup
9e02be6a5a copr-be: automatically cleanup VMs (not)started by resalloc
For some reason, starting VMs sometimes fails and VM is kept idling on
in our VMs list, and we are accounted for it.  This script periodically
checks the list of started VMs and terminates those which we are not
interested in.

The script requires, except for python3, also python3-dateutil.
2020-05-25 11:03:58 +02:00
Pavel Raiskup
5d26e6c7d4 copr-be: don't re-define alrady defined vm_name
Ie define vm_name only if the playbook is _not_ run from resalloc
server.
2020-05-07 14:41:43 +02:00
Pavel Raiskup
6b429d1e8e copr: buliders: typofix for previous commit 2020-04-24 21:34:28 +02:00
Pavel Raiskup
efbb4d2d3a copr: builders: better tweak mock-core-configs
We first run the copr-update-builder script, so it does it's work.
Then we can try to update to our own (newer only!) version of
mock-core-configs, and re-run the copr-update-builder.

We though have to stop removing the old .rpmnew files blindly, this
needs patch against copr/copr.git.
2020-04-24 21:34:28 +02:00
Pavel Raiskup
f8cdc5e2bc copr: builders: enable mock 2.2 on production builders 2020-04-24 21:34:28 +02:00
Pavel Raiskup
15889c9181 copr: builders: better work with mock config overrides
With new copr-rpmbuild 0.38 it is much easier.
2020-04-24 21:34:28 +02:00
Pavel Raiskup
9ba2bf5111 copr: dev-builders: typo from previous commit 2020-04-24 21:34:28 +02:00
Pavel Raiskup
406cb67d9a copr: dev-builders: install mock 2.2 and configs in one transaction 2020-04-24 21:34:28 +02:00
Pavel Raiskup
1872267196 copr: dev-builders: install mock 2.2 2020-04-24 21:34:28 +02:00
Pavel Raiskup
d562bde01e copr: be: more careful periodic cleanup of VMs
Never remove CoprPurpose=infrastructure, only builders.
2020-04-24 21:34:26 +02:00
Pavel Raiskup
ed20388baf copr: builders: re-enable root cache
I was wrong.  We actually use the root cache, because we - for each
build_chroot - build src.rpm separately, and once src.rpm is ready we
build binary rpm.

This reverts commit b768a27fafd28ab0168279c9d7d474021a1f6534.
2020-04-24 21:34:25 +02:00
Pavel Raiskup
8081fa90b5 copr: builders: disable root cache
https://pagure.io/copr/copr/issue/1202
2020-04-24 21:34:25 +02:00
Pavel Raiskup
2869ec8244 copr: builder: tag AWS instances with CoprPurpose and CoprInstance 2020-04-24 21:34:25 +02:00
Pavel Raiskup
92171f9b8d copr-builders: update mock core configs for OpenSUSE 15.1 config 2020-04-24 21:34:24 +02:00
Pavel Raiskup
e45cc6e31b copr-be: drop prune weekly job
We run it on a daily basis, from cron job provided by copr-backend.rpm.
2020-04-24 21:34:24 +02:00
Pavel Raiskup
9d95dd38fc copr-be-aws: move lighttpd.conf to proper location 2020-04-24 21:34:24 +02:00
Pavel Raiskup
c73bb140ac copr-be-dev-aws: proper location of lighttpd_dev.conf template 2020-04-24 21:34:24 +02:00
Pavel Raiskup
0c305c731a copr-be-dev: fix path to LE certificate 2020-04-24 21:34:24 +02:00
Pavel Raiskup
389da0d097 copr: builders: updated mock-core-configs
For broken OpenSUSE and Mageia chroots.
2020-04-24 21:34:24 +02:00
Pavel Raiskup
0fcdeb04ab copr: builders-dev: don't enable @copr/copr-dev 2020-04-24 21:34:23 +02:00
Pavel Raiskup
0fe1e29d89 Revert "copr: backend: fix Rawhide builds"
This reverts commit 429efe9c1d735374ebe58317a7ba62f28ea34c0e.
2020-04-24 21:34:23 +02:00
Pavel Raiskup
3a21950120 copr: builders: config_opts['dnf_warning'] = False 2020-04-24 21:34:23 +02:00
Pavel Raiskup
3d45c8c79d copr: be-dev: temporarily enable @copr/copr-dev on builders 2020-04-24 21:34:23 +02:00
Pavel Raiskup
d282179097 copr: be: again apply fixes for mock 2.0
Revert "Revert "copr: be: install new mock on builders""

This reverts commit bc76f65891e6fb6ca6738e5b9ca92c50fd77cc9e.
2020-04-24 21:34:23 +02:00