Infrastructure/ansible
3
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions

try disallowing blobs for robots on pagure.io

Browse source
This commit is contained in:
Kevin Fenzi 2018-02-19 20:41:03 +00:00
parent 1ae76f5983
commit 3896b82982
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
roles/pagure/frontend/templates/robots.txt.j2
View file

@ -5,5 +5,6 @@ Disallow: /
Disallow: /api Disallow: /api
Disallow: /login Disallow: /login
Disallow: /*/raw Disallow: /*/raw
Disallow: /*/blob
Crawl-Delay: 2 Crawl-Delay: 2
{% endif %} {% endif %}