Commit graph

42 commits

Author SHA1 Message Date
Kevin Fenzi
e0cfad793d proxies / docs-rsync job: set timeout on rsync
Set a 300 second timeout here, so we don't get jobs that are stuck
sitting around for a long time. See
https://pagure.io/fedora-infrastructure/issue/9221

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-08-24 10:34:07 -07:00
Kevin Fenzi
6062f31827 Revert "docs sync cron: disable until the initial sync I am doing finishes."
This reverts commit df2adf6842.
2020-06-23 11:13:41 -07:00
Kevin Fenzi
df2adf6842 docs sync cron: disable until the initial sync I am doing finishes.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-23 10:50:51 -07:00
Kevin Fenzi
41ca654628 docs sync: adjust cron jobs and rsync script
Right now we update translation files once a day at 22:00UTC.
So, it makes no sense to generate the translated docs more often than
once a day after that update. So, that cron moves to 23:00UTC.
The en cron can be once per hour, run it before sync.

Finally, adjust the docs-rsync script so it's actually idempotent,
and only transfers as much as it needs to.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-23 10:08:28 -07:00
Kevin Fenzi
e01343e2ba fedora-docs / proxies: re-enable docs-sync cron job
Move the docs-sync cron to :55 and re-enable it.
See https://pagure.io/fedora-infrastructure/issue/8964
for more info

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-22 13:06:49 -07:00
Kevin Fenzi
cf212af782 fedora-docs: adjust rsync script a bunch more
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-07 19:04:09 -07:00
Stephen Smoogen
0339781ad3 have proxies not copy over copying.tmp if it shows up in docs tree 2020-06-04 10:15:37 -04:00
Stephen Smoogen
1a69c6bd50 have the docs rsync remove excluded files in case they came over. should remove garbage from proxies 2020-05-29 12:16:47 -04:00
Kevin Fenzi
93b435f3ba DISABLE DOCS SYNC: we need to figure out space issues before re-enabling
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-05-28 21:05:08 -07:00
Stephen Smoogen
581f7feec9 have docs-rsync not sync over the ar.rebuilding directory which will have incomplete and duplicaed data 2020-05-27 14:19:17 -04:00
Kevin Fenzi
828a35a67b do the same thing in prod too 2018-11-08 00:50:28 +00:00
Kevin Fenzi
bff1f4d622 Switch to letting rsync filter our overlaps in docs combined site.
Right now we are doing 3 rsyncs one at a time, but this prevents us
from deleting content that has disappeared from one of the first ones.
So, switch to doing one rsync with multiple sources and let it sort out
files that are now gone to be deleted in the target.
Fixes ticket 7334.
2018-11-08 00:47:37 +00:00
Kevin Fenzi
e40b57559a make sure we keep hardlinks for the 12GB docs-old 2018-08-02 19:35:45 +00:00
Kevin Fenzi
129cd1f153 docs combined site to prod 2018-08-02 15:25:30 +00:00
Kevin Fenzi
a91923fc2d docs unified website in stg. ticket 7130 2018-08-01 19:51:25 +00:00
Kevin Fenzi
c3ee20181c no stderr from docssync either 2018-06-21 18:58:29 +00:00
Patrick Uiterwijk
8449774d3d Add docs-old.stg
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2017-09-27 16:31:03 +00:00
Patrick Uiterwijk
9c67c7019b Redirect old docs urls to docs-old
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2017-09-27 17:26:58 +02:00
Kevin Fenzi
b2a1c831a0 Make docs 404 page a real local 404 page instead of a redirect that ends in a 200. 2017-09-12 15:00:36 +00:00
Kevin Fenzi
a975655c2b test this fix in staging 2017-09-11 19:49:06 +00:00
Kevin Fenzi
e859a157e5 also add the file 2017-08-30 15:58:28 +00:00
Kevin Fenzi
84e33ff9f3 try this 2017-08-30 14:16:41 +00:00
Kevin Fenzi
b1b36c15c6 try again 2017-08-30 14:14:24 +00:00
Kevin Fenzi
3e7b8f95e1 set 404 for docs 2017-08-30 14:10:17 +00:00
Kevin Fenzi
8f264907f7 Make staging docs sync every 5min 2017-08-26 23:41:18 +00:00
Kevin Fenzi
f0e03bd7e9 Fix up docs config 2017-08-24 21:42:51 +00:00
Kevin Fenzi
adc88df3a3 remove all these old docs redirects 2017-08-24 21:41:32 +00:00
39f9d1e4ad one more docs redirect for f26 2017-07-12 00:11:57 +00:00
Kevin Fenzi
ab7c342694 fix docs links for f26 2017-07-11 15:10:48 +00:00
82417064e4 Change static content caching from 5 days to 30 minutes
Signed-off-by: Ricky Elrod <codeblock@fedoraproject.org>
2017-06-09 06:30:47 +00:00
35ab8c7f19 update docs.fp.o redirects for new F25 guides 2016-11-22 08:04:48 +00:00
7dd5ec40b6 correct response code for relnotes, add redirect for ipa docs 2016-08-05 02:11:26 +00:00
2fdbf621b9 move relnotes redirect to top of file so some oaf doesn't miss it again 2016-07-09 21:48:07 -05:00
92b7c8c7c2 use 302 redirect for redirects that change with each release 2016-06-22 13:49:02 +00:00
9493fdc0ba update redirects for published f24 docs 2016-06-22 13:20:08 +00:00
Patrick Uiterwijk
927ed203aa We dont want to be nagged twelve times every hour
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2015-12-16 20:15:10 +00:00
Patrick Uiterwijk
0be7818268 Lock for docs sync
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2015-12-16 18:57:54 +00:00
Nick Bebout
78a9bb8f1c Update redirects for docs 2015-11-03 15:51:10 +00:00
Kevin Fenzi
ed7984ef1f Switch all these sync jobs to pull from sundries01 instead of bapp02.
Will test out on one proxy first, then push to the rest.
2015-07-27 22:55:32 +00:00
dd440f21d1 update some docs redirects for F22 2015-05-27 22:55:33 -06:00
Kevin Fenzi
ae77a15521 Set release-notes default to f22. 2015-05-27 16:08:18 +00:00
Ralph Bean
8ca69b327f Add fedora-docs proxy entry. 2014-12-12 19:42:48 +00:00