Block all but internal from pkgs.fp.o and set up robots.txt files

Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
This commit is contained in:
Patrick Uiterwijk 2018-02-08 22:44:06 +00:00
parent cd65be2774
commit 4aa1c5bcc3
4 changed files with 40 additions and 3 deletions

View file

@ -0,0 +1,8 @@
User-agent: *
Disallow: /cgit/
User-agent: *
Disallow: /git/
User-agent: *
Disallow: /repo/