Infrastructure/ansible
1
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions
ansible/roles/httpd/website/files/robots/robots.txt.apps.fedoraproject.org

4 lines
50 B
Org Mode
Raw Normal View History

Robots have no use in fedoracommunity as its just an aggregator Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2015-09-14 12:03:20 +00:00
User-agent: *
Disallow: /packages/
Crawl-delay: 1
Reference in a new issue Copy permalink