Commit graph

11 commits

Author SHA1 Message Date
Kevin Fenzi
a1ecb9decb fix for bash arrays from upstream. fixes multiple mod updates at once 2016-11-26 19:31:41 +00:00
Adam Williamson
2e09ca2d00 turn 'filterlist' into 'imagelist', using productmd
This adopts https://pagure.io/quick-fedora-mirror/pull-request/27
and adapts to it, so we get `imagelist` files rather than
`filterlist` files (see recent commits for this). The rationale
is more fully explained in that PR (and in PR #26 also) - on
further inspection it turns out that we have to filter out an
awful lot of extensions to create small filterlists for all
three modules, and I'm worried that other file extensions may
appear in the future and cause the filterlists to suddenly get
bigger again. Instead, we have create-filelist use the productmd
constant that defines valid image formats, and only include files
that match those formats in the list. The downside of this
approach is we have to ensure productmd on all the systems that
run `create-filelist` is kept up to date if the list of valid
image formats changes.
2016-11-23 09:21:45 -08:00
Adam Williamson
45d8ea3f89 Generate filtered file lists for fedfind to use
This adds `filterlist` files alongside the `fullfilelist` and
`fullfiletimelist` files. These are much, much shorter lists
which skip the entries for packages, ARM device tree boot files
and directories. They are intended for consumption by fedfind,
so it can stop using rync scraping to discover the image files
it looks for. To enable this, we update to a newer version of
`create-filelist` from upstream `quick-fedora-mirror` and make
`update-fullfiletimelist` create the filterlist files as well.

We also delete a couple of old copies of `create-filelist`;
nirik made the two roles that use it share a common copy a few
months back, but missed deleting the copy each role had in its
`files` directory.
2016-11-19 15:15:53 -08:00
Kevin Fenzi
03a8923c04 Update create-filelist and wrapper from upstream quick mirror.
Merge all the various copies of the wrapper into one copy.
Setup arguments as needed for each call.
2016-07-15 20:05:53 +00:00
Kevin Fenzi
d5e67b45fe Some server side improvements for quick-mirror 2016-06-22 21:51:06 +00:00
Kevin Fenzi
e7a8652831 Fix missing space 2016-05-28 16:53:35 +00:00
Kevin Fenzi
baafbbc7e8 Helps if it has the right path too. 2016-05-28 16:47:16 +00:00
Kevin Fenzi
c54d26a9f9 Update new version from upstream 2016-05-28 16:42:05 +00:00
Kevin Fenzi
daa00a39b1 Put new create-filelist in scripts so we can use it all the places we need. 2016-05-27 22:05:41 +00:00
Kevin Fenzi
d0a046d431 Fix unneeded chmod of files on mirrors. releng ticket 6421 2016-05-21 16:15:04 +00:00
Kevin Fenzi
7b2a5482bf Setup a cron job to update fulfiletimelist in alt. For now run every 6 hours, but once things settle down we can do more often. 2016-05-19 19:05:16 +00:00