Infrastructure/ansible
1
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions
ansible/roles/httpd/website/files/robots/robots.txt
Kevin Fenzi 09fb09d20d Drop crawl-delay down to 1
2015-01-29 00:00:21 +00:00

2 lines
29 B
Text
Raw Blame History

User-agent: *
Crawl-delay: 1
Reference in a new issue View git blame Copy permalink