2021-07-26 10:39:47 +02:00
|
|
|
= Netapp Infrastructure SOP
|
|
|
|
|
|
2021-09-07 14:28:43 +02:00
|
|
|
Provides primary mirrors and additional storage in IAD2
|
2021-07-26 10:39:47 +02:00
|
|
|
|
|
|
|
|
== Contents
|
|
|
|
|
|
2021-09-07 14:28:43 +02:00
|
|
|
* <<_contact_information>>
|
|
|
|
|
* <<_description>>
|
|
|
|
|
* <<_public_mirrors>>
|
|
|
|
|
** <<_snapshots>>
|
|
|
|
|
* <<_iad2_nfs_storage>>
|
|
|
|
|
** <<_access>>
|
|
|
|
|
** <<_snapshots>>
|
|
|
|
|
* <<_iscsi>>
|
|
|
|
|
** <<_updating_lvm>>
|
|
|
|
|
** <<_mounting_iscsi>>
|
2021-07-26 10:39:47 +02:00
|
|
|
|
|
|
|
|
== Contact Information
|
|
|
|
|
|
|
|
|
|
Owner::
|
|
|
|
|
Fedora Infrastructure Team
|
|
|
|
|
Contact::
|
|
|
|
|
#fedora-admin, sysadmin-main, releng
|
|
|
|
|
Servers::
|
|
|
|
|
batcave01, virt servers, application servers, builders, releng boxes
|
|
|
|
|
Purpose::
|
2021-09-07 14:28:43 +02:00
|
|
|
Provides primary mirrors and additional storage in IAD2
|
2021-07-26 10:39:47 +02:00
|
|
|
|
|
|
|
|
== Description
|
|
|
|
|
|
|
|
|
|
At present we have three netapps in our infrastructure. One in TPA, RDU
|
2021-09-07 14:28:43 +02:00
|
|
|
and IAD2. For purposes of visualization its easiest to think of us as
|
|
|
|
|
having 4 netapps, 1 TPA, 1 RDU and 1 IAD2 for public mirrors. And an
|
|
|
|
|
additional 1 in IAD2 used for additional storage not related to the
|
2021-07-26 10:39:47 +02:00
|
|
|
public mirrors.
|
|
|
|
|
|
|
|
|
|
== Public Mirrors
|
|
|
|
|
|
|
|
|
|
The netapps are our primary public mirrors. The canonical location for
|
2021-09-07 14:28:43 +02:00
|
|
|
the mirrors is currently in IAD2. From there it gets synced to RDU and
|
2021-07-26 10:39:47 +02:00
|
|
|
TPA.
|
|
|
|
|
|
|
|
|
|
=== Snapshots
|
|
|
|
|
|
2021-09-07 14:28:43 +02:00
|
|
|
Snapshots on the IAD2 netapp are taken hourly. Unfortunately the way it
|
2021-07-26 10:39:47 +02:00
|
|
|
is setup only Red Hat employees can access this mirror (this is
|
|
|
|
|
scheduled to change when PHX becomes the canonical location but that
|
|
|
|
|
will take time to setup and deploy). The snapshots are available, for
|
|
|
|
|
example, on wallace in:
|
|
|
|
|
|
|
|
|
|
....
|
|
|
|
|
/var/ftp/download.fedora.redhat.com/.snapshot/hourly.0
|
|
|
|
|
....
|
|
|
|
|
|
2021-09-07 14:28:43 +02:00
|
|
|
== IAD2 NFS Storage
|
2021-07-26 10:39:47 +02:00
|
|
|
|
2021-09-07 14:28:43 +02:00
|
|
|
There is a great deal of storage in IAD2 over NFS from the netapp there.
|
2021-07-26 10:39:47 +02:00
|
|
|
This storage includes the public mirror. The majority of this storage is
|
|
|
|
|
koji however there are a few gig worth of storage that goes to wiki
|
2021-09-07 14:28:43 +02:00
|
|
|
attachments and other storage needs we have in IAD2.
|
2021-07-26 10:39:47 +02:00
|
|
|
|
|
|
|
|
You can access all of the nfs share shares at:
|
|
|
|
|
|
|
|
|
|
....
|
|
|
|
|
batcave01:/mnt/fedora
|
|
|
|
|
....
|
|
|
|
|
|
|
|
|
|
or:
|
|
|
|
|
|
|
|
|
|
....
|
2021-09-07 14:28:43 +02:00
|
|
|
ntap-fedora-a.storage.iad2.redhat.com:/vol/fedora/
|
2021-07-26 10:39:47 +02:00
|
|
|
....
|
|
|
|
|
|
|
|
|
|
=== Access
|
|
|
|
|
|
|
|
|
|
The netapp is provided by RHIS and as a result they also control access.
|
|
|
|
|
Access is controlled by IP mostly and some machines have root squashed.
|
|
|
|
|
Worst case scenario if batcave01 is not accessible, just bring another
|
|
|
|
|
box up under its IP address and use that for an emergency.
|
|
|
|
|
|
|
|
|
|
=== Snapshots
|
|
|
|
|
|
|
|
|
|
There are hourly and nightly snapshots on the netapp. They are available
|
|
|
|
|
in:
|
|
|
|
|
|
|
|
|
|
....
|
|
|
|
|
batcave01:/mnt/fedora/.snapshot
|
|
|
|
|
....
|
|
|
|
|
|
|
|
|
|
== iscsi
|
|
|
|
|
|
|
|
|
|
We have iscsi deployed in a number of locations in our infrastructure
|
|
|
|
|
for xen machines. To get a list of what xen machines are deployed with
|
|
|
|
|
iscsi, just run lvs:
|
|
|
|
|
|
|
|
|
|
....
|
|
|
|
|
lvs /dev/xenGuests
|
|
|
|
|
....
|
|
|
|
|
|
|
|
|
|
Live migration is possible though not fully supported at this time.
|
|
|
|
|
Please shut a xen machine down and bring it up on another host. Memory
|
|
|
|
|
is the main issue here.
|
|
|
|
|
|
|
|
|
|
=== Updating LVM
|
|
|
|
|
|
|
|
|
|
iscsi is mounted all over the place and if one xen machine creates a
|
|
|
|
|
logical volume the other xen machines will have to pick up those
|
|
|
|
|
changes. To do this run:
|
|
|
|
|
|
|
|
|
|
....
|
|
|
|
|
pvscan
|
|
|
|
|
vgscan
|
|
|
|
|
lvscan
|
|
|
|
|
vgchange -a y
|
|
|
|
|
....
|
|
|
|
|
|
|
|
|
|
=== Mounting ISCSI
|
|
|
|
|
|
|
|
|
|
On reboots sometimes the iscsi share is not remounted. This should be
|
|
|
|
|
automated in the future but for now run:
|
|
|
|
|
|
|
|
|
|
....
|
2021-09-07 14:28:43 +02:00
|
|
|
iscsiadm -m discovery -tst -p ntap-fedora-b.storage.iad2.redhat.com:3260
|
2021-07-26 10:39:47 +02:00
|
|
|
sleep 1
|
|
|
|
|
iscsiadm -m node -T iqn.1992-08.com.netapp:sn.118047036 -p 10.5.88.21:3260 -l
|
|
|
|
|
sleep 1
|
|
|
|
|
pvscan
|
|
|
|
|
vgscan
|
|
|
|
|
lvscan
|
|
|
|
|
vgchange -a y
|
|
|
|
|
....
|
