Infrastructure/ansible
1
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions

Remove koschei from robots.txt for apps.fp.o

Browse source
This commit is contained in:
Mikolaj Izdebski 2019-09-26 06:38:46 +02:00 • committed by Pierre-Yves Chibon
parent 8cd5a6b5a7
commit a07dfe1c02
1 changed files with 0 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
roles/httpd/website/templates/robots/apps.fedoraproject.org-robots.txt
View file

@ -1,6 +1,4 @@
User-agent: * User-agent: *
Disallow: /packages/ Disallow: /packages/
Disallow: /datagrepper/ Disallow: /datagrepper/
Disallow: /koschei/user/
Disallow: /koschei/affected-by/
Crawl-delay: 1 Crawl-delay: 1