Infrastructure/ansible
3
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions

pagure: Drop incorrect robots.txt entry

Browse source 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
This commit is contained in:
Kevin Fenzi 2024-07-13 10:21:28 -07:00
parent 19769b6e77
commit 8925937958
1 changed files with 0 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
roles/pagure/templates/robots.txt.j2
View file

@ -7,6 +7,4 @@ Disallow: /login
Disallow: /*/raw Disallow: /*/raw
Disallow: /*/blob Disallow: /*/blob
Crawl-Delay: 10 Crawl-Delay: 10
User-agent: Bytespider
Disallow: /
{% endif %} {% endif %}