infrastructure/ansible
1
0
Fork 0
Code Issues Pull requests 7 Projects Releases Packages Wiki Activity Actions
41659 commits 9 branches 0 tags 110 MiB
Commit graph

45 commits

Author SHA1 Message Date
Jiri Podivin
f513e7cbcd Linting python scripts 
Signed-off-by: Jiri Podivin <jpodivin@redhat.com>
 2024-09-18 19:57:29 +00:00
Miro Hrončok
fbf810dfaa Revert "Hack around c8s python39 module versions not in ascending order" 
EPEL 8 Next is EOL.

This reverts commit fc460139cd.
 2024-08-01 08:30:49 +00:00
Carl George
8350b55843 Stop syncing and grobisplitting CentOS Stream 8 
CentOS Stream 8 is now EOL, so it is no longer necessary to sync and
grobisplit that content for EPEL 8 Next to build against.

https://pagure.io/releng/issue/12147
 2024-06-05 13:14:16 +00:00
Miro Hrončok
fc460139cd Hack around c8s python39 module versions not in ascending order 
Fixes https://pagure.io/releng/issue/11947

See also:

https://issues.redhat.com/browse/CS-2025 (module with highest version is incomplete)
https://issues.redhat.com/browse/CS-2044 (module versions are not in ascending order)

Signed-off-by: Miro Hrončok <miro@hroncok.cz>
 2024-04-22 10:06:38 +00:00
Kevin Fenzi
50dcf526ae grobisplitter: we do not seem to actually need python3-repomd 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2023-05-30 14:00:28 -07:00
Stephen Smoogen
1250b004ea Adjust running koji-split cleanup to 1/week from 1/month 
The reposplit cron job runs on the first day of the month and deletes
anything older than 30 days old at that time. However this has caused
a disk crunch on centos stream as each day is 195 GB of data and 60
days of traffic was over 8TB. The cron job is now to run every Sunday
and remove any data older than 14 days.

The same is done for the RHEL splitter as its space was growing also.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2022-11-17 01:51:46 +00:00
Pedro Moura
f1f1088fb8 monthly cron job to clean up old koji trees 
Signed-off-by: Pedro Moura <pmoura@redhat.com>
 2022-06-28 19:30:38 +00:00
Stephen Smoogen
63a8c4a39e move back to the older splitter.py. clean up whitespace differences between it and upstream. put upstream in tree for someone to fix later. 2022-05-31 11:30:47 -04:00
Stephen Smoogen
618f0501d5 Fixed: when putting in new code, missed there was a _idx instead of idx. This caused splittery.py to crash. 2022-05-28 14:51:56 -04:00
Stephen Smoogen
c10120cea2 Fix: splitter.py to put in hack from 2020 to deal with CentOS Stream using xz compression versus gz 2022-05-28 14:38:49 -04:00
Stephen Smoogen
284a8d91e2 Fix: grobisplitter scripts. You cant touch a datefile until after the directory is created 2022-05-28 10:23:50 -04:00
Stephen Smoogen
45d0034a8f copy takes up lots of disk space and is 2x slower. move back to hardlink 2022-05-28 09:39:47 -04:00
Stephen Smoogen
8db4eb6564 make sure the timestamp file is the same for all arches in case koji freaks out 2022-05-27 20:29:20 +00:00
Stephen Smoogen
824654b955 Changes: Updates splitter.py to the one in upstream modules git repository. 
Removes the two stage process for building repositories
	 Sets all the files to the same timestamp.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2022-05-27 20:29:20 +00:00
Stephen Smoogen
7c77f430dd First attempt to fix rhel8 splitter for multi-tree dirs. 2022-05-27 20:29:20 +00:00
Stephen Smoogen
7b5d4d5145 This is a hack in order to make grobisplitter understand different 
compression types from pungi output. Basically determine if the file
is ends with gz (oldstyle) or xz (newstyle) or neither. If it is gz
assume it is a gzip (HA!) or if it is xz assume it is LZMA (double
ha!) and bail if it is neither.

A proper fix would be to determine the file type holistically and pull
in the appropriate decompression as needed. However to quote Dante
from Clerks:  I'm not even supposed to be here today!

Signed-off-by: Stephen Smoogen <smooge@smoogespace.com>
 2021-05-27 12:34:56 -04:00
Stephen Smoogen
631399e2dc fix misspelled filename so that grobisplit of cents8 can occur 2020-12-12 12:07:54 -05:00
Stephen Smoogen
741bf4d49a Reverting part of previous update to splitter.py from Fedora 
Modularity tree. That code is not functional and is causing the wrong
packages to be brought into place.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-12-09 09:18:48 -05:00
Stephen Smoogen
e9798a9cac Add in the Devel tree if needed. Currently it is empty 2020-12-08 15:08:59 -05:00
Stephen Smoogen
861e79c16c If you make a directory you need to pushd into it. 
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-12-08 14:30:20 -05:00
Stephen Smoogen
98568cfd62 Fix the directory that we sync to and from so that the final steps work 
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-12-08 13:51:50 -05:00
Stephen Smoogen
921d8cef83 Comment out part of the splitter which does not work with libmodulemd -2.9 
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-12-08 13:27:47 -05:00
Stephen Smoogen
578612992a Fix where kojitarget directory is. You can not put it in a tree you do a rsync --delete on 
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-12-08 12:53:24 -05:00
Stephen Smoogen
c874fe2f99 The directory name layout between CentOS and RHEL are different so a different logic is needed to split the trees. 
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-12-08 12:45:39 -05:00
Stephen Smoogen
5df198ba30 Add in the tasks to playbook for scripts to run 2020-12-08 11:25:26 -05:00
Stephen Smoogen
e3ae9a8c13 Try to get splitter working so that EPEL Stream work can start 
Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-12-08 11:14:38 -05:00
Stephen Smoogen
ddb13e640a Update splitter to fedora modules upstream and improve documentation. 
The grobisplitter parts need some documentation to explain what they
are doing and for whom. This is a first attempt at getting that right

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-12-03 16:22:44 -05:00
Stephen Smoogen
5de561dec3 make sure every task has a tag 2020-06-06 18:32:39 -04:00
Stephen Smoogen
bf37019d63 and we remember that we had it not try to split things on a ro disk space. fix 2020-06-06 18:25:08 -04:00
Stephen Smoogen
7c62c814c7 this should allow batcave01.iad2 to have grobisplitter items but not try to run grobisplitter 2020-05-30 17:21:52 -04:00
Stephen Smoogen
d982c06fde [grobisplitter] upgrade to latest splitter 2020-04-24 21:34:10 +02:00
Stephen Smoogen
9bf044951e move grobisplitter out so it doesnt collide with rhel8 download 2020-04-24 21:34:10 +02:00
Stephen Smoogen
4a22ddc81e [grobisplitter] fix script to be less chatty AND to give proper error messages 2019-06-25 13:23:35 +00:00
Stephen Smoogen
2316099cbf put in some fixes to make grobimirror more grobi 2019-06-25 00:05:12 +00:00
Stephen Smoogen
94c3ce1c99 make it so the rhel8 repos have a valid repository 2019-06-04 22:37:01 +00:00
Stephen Smoogen
c49b9e5a6b make it so we dont have too much indirection 2019-06-04 19:03:43 +00:00
Stephen Smoogen
672f66017f [grobi] make it only split out the latest module stream 2019-06-03 23:14:25 +00:00
Stephen Smoogen
f9db2dbd16 [grobi] add in final logic for link setup 2019-06-01 22:16:10 +00:00
Stephen Smoogen
fab2e5c0e1 Add in cron job for grobisplitter and set rhel8 to run daily 2019-06-01 21:58:36 +00:00
Stephen Smoogen
79d6116ace [grobi] make cp non-clobber 2019-06-01 21:42:52 +00:00
Stephen Smoogen
2ca15fdb7b [grobi] fix more bone head sh mistakes. Really I have been programming in this since 1987 really 2019-06-01 21:21:29 +00:00
Stephen Smoogen
264bded0ea [grobi] more brain dead sh mistakes 2019-06-01 21:08:12 +00:00
Stephen Smoogen
bc275840e4 [grobi] Take out verbose cp. Will need to cut out other verbosity elsewhere later 2019-06-01 20:56:26 +00:00
Stephen Smoogen
94fa772a04 [grobi] Fix bonehead sh script mistake. add in link 2019-06-01 20:51:36 +00:00
Stephen Smoogen
6f69b370f4 [grobisplitter] first attempt at adding configs for system 2019-06-01 17:32:24 +00:00