Infrastructure/ansible
1
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions

taskotron: update robots.txt

Browse source 
Exclude as much as reasonable, since we have performance issues and
we don't really need to have results or artifacts indexed.
This commit is contained in:
Kamil Páral 2017-03-16 12:33:54 +00:00
parent 9841d619fc
commit 894e27b920
1 changed files with 5 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

14
roles/taskotron/buildmaster/templates/robots.txt.j2
View file

@ -1,10 +1,6 @@
User-agent: *
Disallow: /{{ buildmaster_endpoint }}/waterfall
Disallow: /{{ buildmaster_endpoint }}/builders
Disallow: /{{ buildmaster_endpoint }}/changes
Disallow: /{{ buildmaster_endpoint }}/buildslaves
Disallow: /{{ buildmaster_endpoint }}/schedulers
Disallow: /{{ buildmaster_endpoint }}/one_line_per_build
Disallow: /{{ buildmaster_endpoint }}/grid
Disallow: /{{ buildmaster_endpoint }}/tgrid
Disallow: /{{ buildmaster_endpoint }}/json
Disallow: /{{ buildmaster_endpoint }}/
Disallow: /{{ resultsdb_fe_endpoint }}/
Disallow: /resultsdb_api/
Disallow: /execdb/
Disallow: /artifacts/