Review archive-old-fedora SOP

Signed-off-by: Michal Konečný <mkonecny@redhat.com>
This commit is contained in:
Michal Konečný 2021-08-17 12:08:46 +02:00
parent 63999b4599
commit b4d8411410
2 changed files with 66 additions and 22 deletions

View file

@ -5,7 +5,7 @@
** xref:anitya.adoc[Anitya Infrastructure SOP] ** xref:anitya.adoc[Anitya Infrastructure SOP]
** xref:ansible.adoc[ansible - SOP] ** xref:ansible.adoc[ansible - SOP]
** xref:apps-fp-o.adoc[apps-fp-o - SOP] ** xref:apps-fp-o.adoc[apps-fp-o - SOP]
** xref:archive-old-fedora.adoc[archive-old-fedora - SOP in review ] ** xref:archive-old-fedora.adoc[How to Archive Old Fedora Releases - SOP]
** xref:arm.adoc[arm - SOP in review ] ** xref:arm.adoc[arm - SOP in review ]
** xref:aws-access.adoc[aws-access - SOP in review ] ** xref:aws-access.adoc[aws-access - SOP in review ]
** xref:bastion-hosts-info.adoc[bastion-hosts-info - SOP in review ] ** xref:bastion-hosts-info.adoc[bastion-hosts-info - SOP in review ]

View file

@ -2,59 +2,103 @@
The Fedora download servers contain terabytes of data, and to allow for The Fedora download servers contain terabytes of data, and to allow for
mirrors to not have to take all of that data, infrastructure regularly mirrors to not have to take all of that data, infrastructure regularly
moves data of end of lifed releases (from /pub/fedora/linux) to the moves data of end of lifed releases (from `/pub/fedora/linux`) to the
archives section (/pub/archive/fedora/linux) archives section (`/pub/archive/fedora/linux`)
== Steps Involved == Steps Involved
[arabic] [arabic]
. log into batcave01.phx2.fedoraproject.org and ssh to bodhi-backend01 . log into batcave01.phx2.fedoraproject.org and ssh to bodhi-backend01
+ +
$ sudo -i ssh root@bodhi-backend01.iad2.fedoraproject.org # su - ftpsync [source]
$ ----
$ sudo -i ssh root@bodhi-backend01.iad2.fedoraproject.org
# su - ftpsync
----
. Then change into the releases directory. . Then change into the releases directory.
+ +
[source]
----
$ cd /pub/fedora/linux/releases $ cd /pub/fedora/linux/releases
----
. Check to see that the target directory doesn't already exist. . Check to see that the target directory doesn't already exist.
+ +
[source]
----
$ ls /pub/archive/fedora/linux/releases/ $ ls /pub/archive/fedora/linux/releases/
----
. If the target directory does not already exist, do a recursive link . If the target directory does not already exist, do a recursive link
copy of the tree you want to the target copy of the tree you want to the target
+ +
[source]
----
$ cp -lvpnr 21 /pub/archive/fedora/linux/releases/21 $ cp -lvpnr 21 /pub/archive/fedora/linux/releases/21
----
. If the target directory already exists, then we need to do a recursive . If the target directory already exists, then we need to do a recursive
rsync to update any changes in the trees since the previous copy. rsync to update any changes in the trees since the previous copy.
+ +
[source]
----
$ rsync -avAXSHP --delete ./21/ /pub/archive/fedora/linux/releases/21/ $ rsync -avAXSHP --delete ./21/ /pub/archive/fedora/linux/releases/21/
----
. We now do the updates and updates/testing in similar ways. . We now do the updates and updates/testing in similar ways.
+ +
$ cd ../updates/ $ cp -lpnr 21 /pub/archive/fedora/linux/updates/21 $ cd [source]
testing $ cp -lpnr 21 /pub/archive/fedora/linux/updates/testing/21 ----
$ cd ../updates/
$ cp -lpnr 21 /pub/archive/fedora/linux/updates/21
$ cd testing
$ cp -lpnr 21 /pub/archive/fedora/linux/updates/testing/21
----
+
Alternative if this is a later refresh of an older copy. Alternative if this is a later refresh of an older copy.
+
[source]
----
$ cd ../updates/
$ rsync -avAXSHP 21/ /pub/archive/fedora/linux/updates/21/
$ cd testing
$ rsync -avAXSHP 21/ /pub/archive/fedora/linux/updates/testing/21/
----
____
$ cd ../updates/ $ rsync -avAXSHP 21/
/pub/archive/fedora/linux/updates/21/ $ cd testing $ rsync -avAXSHP 21/
/pub/archive/fedora/linux/updates/testing/21/
____
[arabic, start=7]
. Do the same with fedora-secondary. . Do the same with fedora-secondary.
. Announce to the mirror list this has been done and that in 2 weeks you . Announce to the mirror list this has been done and that in 2 weeks you
will move the old trees to archives. will move the old trees to archives.
. In two weeks, log into mm-backend01 and run the archive script . In two weeks, log into mm-backend01 and run the archive script
+ +
sudo -u mirrormanager mm2_move-to-archive --originalCategory="Fedora [source]
Linux" --archiveCategory="Fedora Archive" --directoryRe='/21/Everything' ----
$ sudo -u mirrormanager mm2_move-to-archive --originalCategory="Fedora Linux" --archiveCategory="Fedora Archive" --directoryRe='/21/Everything'
----
. If there are problems, the postgres DB may have issues and so you need . If there are problems, the postgres DB may have issues and so you need
to get a DBA to update the backend to fix items. to get a DBA to update the backend to fix items.
. Wait an hour or so then you can remove the files from the main tree. . Wait an hour or so then you can remove the files from the main tree.
+ +
ssh bodhi-backend01 cd /pub/fedora/linux cd releases/21 ls # make sure [source]
you have stuff here rm -rf * ln ../20/README . cd ../../updates/21 ls # ----
make sure you have stuff here rm -rf * ln ../20/README . cd $ ssh bodhi-backend01
../testing/21 ls # make sure you have stuff here rm -rf * ln $ cd /pub/fedora/linux
../20/README . $ cd releases/21
$ ls # make sure you have stuff here
$ rm -rf *
$ ln ../20/README .
$ cd ../../updates/21
$ ls #make sure you have stuff here
$ rm -rf *
$ ln ../20/README .
$ cd ../testing/21
$ ls # make sure you have stuff here
$ rm -rf *
$ ln ../20/README .
----
This should complete the archiving. This should complete the archiving.