Migrate howto repository to infra docs

It doesn't make much sense to have separate guides outside infra documentation.
So let's migrate https://pagure.io/fedora-infra/howtos to infra docs.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
This commit is contained in:
Michal Konecny 2023-09-05 17:09:58 +02:00
parent bcee198347
commit 1d458e6d8a
39 changed files with 1399 additions and 126 deletions

View file

@ -1,126 +1,4 @@
* xref:orientation.adoc[Orientation for Sysadmin Guide]
* xref:index.adoc[Sysadmin Guide]
** xref:2-factor.adoc[Two factor auth]
** xref:accountdeletion.adoc[Account Deletion SOP]
** xref:anitya.adoc[Anitya Infrastructure SOP]
** xref:ansible.adoc[ansible - SOP]
** xref:apps-fp-o.adoc[apps-fp-o - SOP]
** xref:archive-old-fedora.adoc[How to Archive Old Fedora Releases - SOP]
** xref:arm.adoc[Fedora ARM Infrastructure - SOP]
** xref:aws-access.adoc[Amazon Web Services Access - SOP]
** xref:bastion-hosts-info.adoc[Fedora Bastion Hosts - SOP]
** xref:blockerbugs.adoc[Blockerbugs Infrastructure - SOP]
** xref:bodhi-deploy.adoc[Bodhi Infrastructure - Deployment SOP]
** xref:bodhi.adoc[Bodhi Infrastructure - Releng SOP]
** xref:bugzilla.adoc[Bugzilla Sync Infrastructure - SOP]
** xref:bugzilla2fedmsg.adoc[bugzilla2fedmsg - SOP]
** xref:collectd.adoc[Collectd - SOP]
** xref:compose-tracker.adoc[Compose Tracker - SOP]
** xref:contenthosting.adoc[Content Hosting Infrastructure - SOP]
** xref:copr.adoc[Copr - SOP]
** xref:coreos-cincinnati.adoc[CoreOS Cincinnati - SOP]
** xref:database.adoc[Database Infrastructure - SOP]
** xref:datanommer.adoc[datanommer - SOP]
** xref:debuginfod.adoc[Fedora Debuginfod Service - SOP]
** xref:departing-admin.adoc[Departing admin - SOP]
** xref:dnf-counting.adoc[DNF Counting - SOP]
** xref:dns.adoc[DNS repository for fedoraproject - SOP]
** xref:docs.fedoraproject.org.adoc[Docs - SOP]
** xref:externally-hosted-services.adoc[Externally Hosted Services - SOP]
** xref:fas-notes.adoc[Fedora Account System - SOP]
** xref:fas-openid.adoc[FAS-OpenID - SOP]
** xref:fedmsg-certs.adoc[fedmsg (Fedora Messaging) Certs, Keys, and CA - SOP]
** xref:fedmsg-gateway.adoc[fedmsg-gateway - SOP]
** xref:fedmsg-introduction.adoc[fedmsg introduction and basics - SOP]
** xref:fedmsg-irc.adoc[fedmsg-irc - SOP]
** xref:fedmsg-new-message-type.adoc[Adding a new fedmsg message type - SOP]
** xref:fedmsg-relay.adoc[fedmsg-relay - SOP]
** xref:fedmsg-websocket.adoc[WebSocket - SOP]
** xref:fedocal.adoc[Fedocal - SOP]
** xref:fedora-releases.adoc[Fedora Release Infrastructure - SOP]
** xref:fedorawebsites.adoc[Websites Release - SOP]
** xref:fmn.adoc[FedMsg Notifications (FMN) - SOP]
** xref:gather-easyfix.adoc[Fedora gather easyfix - SOP]
** xref:gdpr_delete.adoc[GDPR Delete - SOP]
** xref:gdpr_sar.adoc[GDPR SAR - SOP]
** xref:geoip-city-wsgi.adoc[geoip-city-wsgi - SOP]
** xref:github.adoc[Using github for Infra Projects - SOP]
** xref:github2fedmsg.adoc[github2fedmsg - SOP]
** xref:greenwave.adoc[Greenwave - SOP]
** xref:guest_migrate.adoc[Migrate Guest VMs - SOP]
** xref:guestdisk.adoc[Guest Disk Resize - SOP]
** xref:guestedit.adoc[Guest Editing - SOP]
** xref:haproxy.adoc[Haproxy Infrastructure - SOP]
** xref:hotfix.adoc[HOTFIXES - SOP]
** xref:hotness.adoc[The New Hotness - SOP]
** xref:infra-git-repo.adoc[Infrastructure Git Repos - SOP]
** xref:infra-hostrename.adoc[Infrastructure Host Rename - SOP]
** xref:infra-raidmismatch.adoc[Infrastructure Raid Mismatch Count - SOP]
** xref:infra-repo.adoc[Infrastructure Yum Repo - SOP]
** xref:infra-retiremachine.adoc[Infrastructure retire machine - SOP]
** xref:infra_handover.adoc[Initiative Handover - SOP]
** xref:ipsilon.adoc[Ipsilon Infrastructure - SOP]
** xref:iscsi.adoc[iSCSI - SOP]
** xref:jenkins-fedmsg.adoc[Jenkins Fedmsg - SOP]
** xref:kerneltest-harness.adoc[Kerneltest-harness - SOP]
** xref:kickstarts.adoc[Kickstart Infrastructure - SOP]
** xref:koji-archive.adoc[Koji Archive - SOP]
** xref:koji-builder-setup.adoc[Setup Koji Builder - SOP]
** xref:koji.adoc[Koji Infrastructure - SOP]
** xref:koschei.adoc[Koschei - SOP]
** xref:layered-image-buildsys.adoc[Layered Image Build System - SOP]
** xref:mailman.adoc[Mailman Infrastructure - SOP]
** xref:making-ssl-certificates.adoc[SSL Certificate Creation - SOP]
** xref:massupgrade.adoc[Mass Upgrade Infrastructure - SOP]
** xref:mastermirror.adoc[Master Mirror Infrastructure - SOP]
** xref:mbs.adoc[Module Build Service Infra - SOP]
** xref:memcached.adoc[Memcached Infrastructure - SOP]
** xref:message-tagging-service.adoc[Message Tagging Service - SOP]
** xref:mini_initiatives.adoc[Mini initiative Process - SOP]
** xref:mirrorhiding.adoc[Mirror Hiding Infrastructure - SOP]
** xref:mirrormanager-S3-EC2-netblocks.adoc[AWS Mirrors - SOP]
** xref:mirrormanager.adoc[MirrorManager Infrastructure - SOP]
** xref:mote.adoc[mote - SOP]
** xref:nagios.adoc[Fedora Infrastructure Nagios - SOP]
** xref:netapp.adoc[Netapp Infrastructure - SOP]
** xref:new-hosts.adoc[DNS Host Addition - SOP]
** xref:nonhumanaccounts.adoc[Non-human Accounts Infrastructure - SOP]
** xref:nuancier.adoc[Nuancier - SOP]
** xref:ocp4:sops.adoc[Openshift SOPs]
** xref:odcs.adoc[On Demand Compose Service - SOP]
** xref:openqa.adoc[OpenQA Infrastructure - SOP]
** xref:openvpn.adoc[OpenVPN - SOP]
** xref:outage.adoc[Outage Infrastructure - SOP]
** xref:packagereview.adoc[Package Review - SOP]
** xref:pagure.adoc[Pagure Infrastructure - SOP]
** xref:pdc.adoc[PDC - SOP]
** xref:pesign-upgrade.adoc[Pesign upgrades/reboots - SOP]
** xref:planetsubgroup.adoc[Planet Subgroup Infrastructure - SOP]
** xref:publictest-dev-stg-production.adoc[Fedora Infrastructure Machine Classes - SOP]
** xref:rabbitmq.adoc[RabbitMQ - SOP]
** xref:rdiff-backup.adoc[rdiff-backup - SOP]
** xref:registry.adoc[Container registry - SOP]
** xref:requestforresources.adoc[Request for resources - SOP]
** xref:resultsdb.adoc[ResultsDB - SOP]
** xref:retrace.adoc[Retrace - SOP]
** xref:scmadmin.adoc[SCM Admin - SOP]
** xref:selinux.adoc[SELinux Infrastructure - SOP]
** xref:sigul-upgrade.adoc[Sigul servers upgrades/reboots - SOP]
** xref:simple_koji_ci.adoc[simple_koji_ci - SOP]
** xref:sshaccess.adoc[SSH Access Infrastructure - SOP]
** xref:sshknownhosts.adoc[SSH known hosts Infrastructure - SOP]
** xref:staging.adoc[Staging - SOP]
** xref:status-fedora.adoc[Fedora Status Service - SOP]
** xref:syslog.adoc[Log Infrastructure - SOP]
** xref:tag2distrepo.adoc[Tag2DistRepo Infrastructure - SOP]
** xref:tickets.adoc[How to handle new tickets in fedora-infrastructure - SOP]
** xref:unbound.adoc[Fedora Infra Unbound Notes - SOP]
** xref:virt-image.adoc[Fedora Infrastructure Kpartx Notes - SOP]
** xref:virt-notes.adoc[Fedora Infrastructure Libvirt Notes - SOP]
** xref:virtio.adoc[Virtio Notes - SOP]
** xref:voting.adoc[Voting Infrastructure - SOP]
** xref:waiverdb.adoc[WaiverDB - SOP]
** xref:wcidff.adoc[What Can I Do For Fedora - SOP]
** xref:wiki.adoc[Wiki Infrastructure - SOP]
** xref:zabbix.adoc[Zabbix Server Infrastructure - SOP]
** xref:zodbot.adoc[Zodbot Infrastructure - SOP]
** xref:index.adoc#_standard_operating_procedures[Standard Operation Procedures]
** xref:index.adoc#_howtos[HOWTOs]

View file

@ -1,104 +0,0 @@
= How to Archive Old Fedora Releases
The Fedora download servers contain terabytes of data, and to allow for
mirrors to not have to take all of that data, infrastructure regularly
moves data of end of lifed releases (from `/pub/fedora/linux`) to the
archives section (`/pub/archive/fedora/linux`)
== Steps Involved
[arabic]
. log into batcave01.phx2.fedoraproject.org and ssh to bodhi-backend01
+
[source]
----
$ sudo -i ssh root@bodhi-backend01.iad2.fedoraproject.org
# su - ftpsync
----
. Then change into the releases directory.
+
[source]
----
$ cd /pub/fedora/linux/releases
----
. Check to see that the target directory doesn't already exist.
+
[source]
----
$ ls /pub/archive/fedora/linux/releases/
----
. If the target directory does not already exist, do a recursive link
copy of the tree you want to the target
+
[source]
----
$ cp -lvpnr 21 /pub/archive/fedora/linux/releases/21
----
. If the target directory already exists, then we need to do a recursive
rsync to update any changes in the trees since the previous copy.
+
[source]
----
$ rsync -avAXSHP --delete ./21/ /pub/archive/fedora/linux/releases/21/
----
. We now do the updates and updates/testing in similar ways.
+
[source]
----
$ cd ../updates/
$ cp -lpnr 21 /pub/archive/fedora/linux/updates/21
$ cd testing
$ cp -lpnr 21 /pub/archive/fedora/linux/updates/testing/21
----
+
Alternative if this is a later refresh of an older copy.
+
[source]
----
$ cd ../updates/
$ rsync -avAXSHP 21/ /pub/archive/fedora/linux/updates/21/
$ cd testing
$ rsync -avAXSHP 21/ /pub/archive/fedora/linux/updates/testing/21/
----
. Do the same with fedora-secondary.
. Announce to the mirror list this has been done and that in 2 weeks you
will move the old trees to archives.
. In two weeks, log into mm-backend01 and run the archive script
+
[source]
----
$ sudo -u mirrormanager mm2_move-to-archive --originalCategory="Fedora Linux" --archiveCategory="Fedora Archive" --directoryRe='/21/Everything'
----
. If there are problems, the postgres DB may have issues and so you need
to get a DBA to update the backend to fix items.
. Wait an hour or so then you can remove the files from the main tree.
+
[source]
----
$ ssh bodhi-backend01
$ cd /pub/fedora/linux
$ cd releases/21
$ ls # make sure you have stuff here
$ rm -rf *
$ ln ../20/README .
$ cd ../../updates/21
$ ls #make sure you have stuff here
$ rm -rf *
$ ln ../20/README .
$ cd ../testing/21
$ ls # make sure you have stuff here
$ rm -rf *
$ ln ../20/README .
----
This should complete the archiving.

View file

@ -69,3 +69,168 @@ Below is a table of contents containing all the standard operating
procedures for Fedora Infrastructure applications. For information on
how to write a new standard operating procedure, consult the guide on
xref:developer_guide:sops.adoc[Developing Standard Operating Procedures].
* xref:accountdeletion.adoc[Account Deletion SOP]
* xref:fedmsg-new-message-type.adoc[Adding a new fedmsg message type]
* xref:anitya.adoc[Anitya Infrastructure SOP]
* xref:ansible.adoc[Ansible]
* xref:apps-fp-o.adoc[apps.fedoraproject.org]
* xref:arm.adoc[ARM Infrastructure]
* xref:aws-access.adoc[Amazon Web Services Access]
* xref:mirrormanager-S3-EC2-netblocks.adoc[Amazon Web Services Mirrors]
* xref:bastion-hosts-info.adoc[Bastion Hosts]
* xref:blockerbugs.adoc[Blockerbugs Infrastructure]
* xref:bodhi.adoc[Bodhi Infrastructure - Releng]
* xref:bodhi-deploy.adoc[Bodhi Infrastructure - Deployment]
* xref:bugzilla.adoc[Bugzilla Sync Infrastructure]
* xref:bugzilla2fedmsg.adoc[bugzilla2fedmsg]
* xref:collectd.adoc[Collectd]
* xref:compose-tracker.adoc[Compose Tracker]
* xref:registry.adoc[Container registry]
* xref:contenthosting.adoc[Content Hosting Infrastructure]
* xref:copr.adoc[Copr]
* xref:coreos-cincinnati.adoc[CoreOS Cincinnati]
* xref:database.adoc[Database Infrastructure]
* xref:datanommer.adoc[Datanommer]
* xref:debuginfod.adoc[Debuginfod Service]
* xref:departing-admin.adoc[Departing admin]
* xref:dnf-counting.adoc[DNF Counting]
* xref:new-hosts.adoc[DNS Host Addition]
* xref:dns.adoc[DNS repository for fedoraproject]
* xref:docs.fedoraproject.org.adoc[Docs]
* xref:externally-hosted-services.adoc[Externally Hosted Services]
* xref:fas-notes.adoc[Fedora Account System]
* xref:fas-openid.adoc[FAS-OpenID]
* xref:fedmsg-certs.adoc[fedmsg (Fedora Messaging) Certs, Keys, and CA]
* xref:fedmsg-gateway.adoc[fedmsg-gateway]
* xref:fedmsg-introduction.adoc[fedmsg introduction and basics]
* xref:fedmsg-irc.adoc[fedmsg-irc]
* xref:fedmsg-relay.adoc[fedmsg-relay]
* xref:fedocal.adoc[Fedocal]
* xref:fedora-releases.adoc[Fedora Release Infrastructure]
* xref:fmn.adoc[FedMsg Notifications (FMN)]
* xref:gather-easyfix.adoc[Fedora gather easyfix]
* xref:status-fedora.adoc[Fedora Status Service]
* xref:gdpr_delete.adoc[GDPR Delete]
* xref:gdpr_sar.adoc[GDPR SAR]
* xref:geoip-city-wsgi.adoc[geoip-city-wsgi]
* xref:github.adoc[Using github for Infra Projects]
* xref:github2fedmsg.adoc[github2fedmsg]
* xref:greenwave.adoc[Greenwave]
* xref:guestdisk.adoc[Guest Disk Resize]
* xref:guestedit.adoc[Guest Editing]
* xref:guest_migrate.adoc[Migrate Guest VMs]
* xref:haproxy.adoc[Haproxy Infrastructure]
* xref:hotfix.adoc[HOTFIXES]
* xref:tickets.adoc[How to handle new tickets in fedora-infrastructure]
* xref:infra-git-repo.adoc[Infrastructure Git Repos]
* xref:infra-hostrename.adoc[Infrastructure Host Rename]
* xref:infra_handover.adoc[Initiative Handover]
* xref:infra-raidmismatch.adoc[Infrastructure Raid Mismatch Count]
* xref:infra-repo.adoc[Infrastructure Yum Repo]
* xref:infra-retiremachine.adoc[Infrastructure retire machine]
* xref:ipsilon.adoc[Ipsilon Infrastructure]
* xref:iscsi.adoc[iSCSI]
* xref:jenkins-fedmsg.adoc[Jenkins Fedmsg]
* xref:kerneltest-harness.adoc[Kerneltest-harness]
* xref:kickstarts.adoc[Kickstart Infrastructure]
* xref:koji-archive.adoc[Koji Archive]
* xref:virt-image.adoc[Kpartx Notes]
* xref:koji.adoc[Koji Infrastructure]
* xref:koschei.adoc[Koschei]
* xref:layered-image-buildsys.adoc[Layered Image Build System]
* xref:virt-notes.adoc[Libvirt Notes]
* xref:syslog.adoc[Log Infrastructure]
* xref:publictest-dev-stg-production.adoc[Machine Classes]
* xref:mailman.adoc[Mailman Infrastructure]
* xref:massupgrade.adoc[Mass Upgrade Infrastructure]
* xref:mastermirror.adoc[Master Mirror Infrastructure]
* xref:mbs.adoc[Module Build Service Infra]
* xref:memcached.adoc[Memcached Infrastructure]
* xref:message-tagging-service.adoc[Message Tagging Service]
* xref:mini_initiatives.adoc[Mini initiative Process]
* xref:mirrorhiding.adoc[Mirror Hiding Infrastructure]
* xref:mirrormanager.adoc[MirrorManager Infrastructure]
* xref:mote.adoc[mote]
* xref:nagios.adoc[Nagios]
* xref:netapp.adoc[Netapp Infrastructure]
* xref:nonhumanaccounts.adoc[Non-human Accounts Infrastructure]
* xref:nuancier.adoc[Nuancier]
* xref:ocp4:sops.adoc[Openshift SOPs]
* xref:odcs.adoc[On Demand Compose Service]
* xref:openqa.adoc[OpenQA Infrastructure]
* xref:openvpn.adoc[OpenVPN]
* xref:outage.adoc[Outage Infrastructure]
* xref:packagereview.adoc[Package Review]
* xref:pagure.adoc[Pagure Infrastructure]
* xref:pdc.adoc[PDC]
* xref:pesign-upgrade.adoc[Pesign upgrades/reboots]
* xref:planetsubgroup.adoc[Planet Subgroup Infrastructure]
* xref:rabbitmq.adoc[RabbitMQ]
* xref:rdiff-backup.adoc[rdiff-backup]
* xref:requestforresources.adoc[Request for resources]
* xref:resultsdb.adoc[ResultsDB]
* xref:retrace.adoc[Retrace]
* xref:scmadmin.adoc[SCM Admin]
* xref:selinux.adoc[SELinux Infrastructure]
* xref:koji-builder-setup.adoc[Setup Koji Builder]
* xref:sigul-upgrade.adoc[Sigul servers upgrades/reboots]
* xref:simple_koji_ci.adoc[simple_koji_ci]
* xref:sshaccess.adoc[SSH Access Infrastructure]
* xref:sshknownhosts.adoc[SSH known hosts Infrastructure]
* xref:making-ssl-certificates.adoc[SSL Certificate Creation]
* xref:staging.adoc[Staging]
* xref:tag2distrepo.adoc[Tag2DistRepo Infrastructure]
* xref:hotness.adoc[The New Hotness]
* xref:2-factor.adoc[Two factor auth]
* xref:unbound.adoc[Unbound Notes]
* xref:virtio.adoc[Virtio Notes]
* xref:voting.adoc[Voting Infrastructure]
* xref:waiverdb.adoc[WaiverDB]
* xref:fedorawebsites.adoc[Websites Release]
* xref:fedmsg-websocket.adoc[WebSocket]
* xref:wcidff.adoc[What Can I Do For Fedora]
* xref:wiki.adoc[Wiki Infrastructure]
* xref:zodbot.adoc[Zodbot Infrastructure]
== HOWTOs
In this section is list of guides for common tasks that are done in Fedora Infrastructure.
* xref:howtos:access_rabbitmq_ui.adoc[How to access the rabbitmq administrative UI]
* xref:howtos:archive-old-fedora.adoc[How to Archive Old Fedora Releases]
* xref:howtos:activate_a_spamcheck_account.adoc[How to activate a FAS account that was marked as spamcheck_awaiting]
* xref:howtos:add_a_package_to_infra_tag.adoc[How to add a package to an infra tag]
* xref:howtos:add_external_hardware_to_vpn.adoc[Add external servers to vpn]
* xref:howtos:build_against_infra_tags.adoc[How to build against an infra tag in koji]
* xref:howtos:check_robosignatory_production_logs.adoc[How to check robosignatory productions logs]
* xref:howtos:clean_2f_tokens.adoc[How to remove 2 factor authentication tokens in IPA]
* xref:howtos:clean_monitoring_sidetags.adoc[How to clean up the side-tags created by the monitor-gating project]
* xref:howtos:create_keytab.adoc[How to create a keytab for an user]
* xref:howtos:create_new_mailing_list.adoc[Creating a new mailing list]
* xref:howtos:creating_groups_distgit.adoc[How to create a group in dist-git]
* xref:howtos:delete_mailman_thread.adoc[How to delete a thread in mailman]
* xref:howtos:destroy_a_virt_instance.adoc[How to destroy a virt instance]
* xref:howtos:discourse_spam.adoc[How to deal with spam posts on discourse]
* xref:howtos:fedora_messaging_certificates.adoc[How to create TLS certificates for fedora-messaging]
* xref:howtos:fix_bugzilla_aws_saml_login.adoc[How to fix SAML login in bugzilla/AWS]
* xref:howtos:fix_robosignatory.adoc[How to check/fix robosignatory]
* xref:howtos:free_space_in_openshift.adoc[How to free some space in OpenShift]
* xref:howtos:generate_2fa_keys.adoc[How to generate 2 Factor Authentication key and certificate]
* xref:howtos:generate_openvpn_keys.adoc[How to generate private key and certificate for OpenVPN client]
* xref:howtos:get_logs_pod_openshift.adoc[How to get logs of a pod in OpenShift]
* xref:howtos:give_groups_dist_git.adoc[How to give a group from someone to someone else in dist-git]
* xref:howtos:groups_in_fedora.adoc[Groups in Fedora]
* xref:howtos:make_mailman_user_admin.adoc[Make mailman user an admin]
* xref:howtos:rebuild_osbs_buildroot.adoc[How to rebuild OSBS buildroot image]
* xref:howtos:refresh_osbs_odcs_oicd_token.adoc[How to refresh the ODCS OIDC token used by OSBS]
* xref:howtos:remove_meeting_minutes_meetbot.adoc[How to remove meeting minutes from meetbot]
* xref:howtos:remove_monitoring_rabbitmq_queue.adoc[How to remove the monitoring of a rabbitmq queue]
* xref:howtos:remove_branch_distgit.adoc[How to remove a git branch in a dist-git repository]
* xref:howtos:remove_fedora_user_at_launch_aws.adoc[How to add allow root ssh login and remove fedora user]
* xref:howtos:remove_user_from_watchlist_pagure.adoc[How to remove someone from a watch list on Pagure]
* xref:howtos:restart_sigul_bridge.adoc[How to restart the sigul bridge]
* xref:howtos:scale_up_or_down_deployment.adoc[How to scale up/down a deployment in OpenShift]
* xref:howtos:share_tmux_session.adoc[How to share a tmux session accross users]
* xref:howtos:unblock_bodhi_rawhide_updates.adoc[How to unblock Bodhi rawhide updates]
* xref:howtos:update_watch_dist_git.adoc[How to udpate the watch status of someone in dist-git]