Block all but internal from pkgs.fp.o and set up robots.txt files
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
This commit is contained in:
parent
cd65be2774
commit
4aa1c5bcc3
4 changed files with 40 additions and 3 deletions
8
roles/distgit/files/robots-src.txt
Normal file
8
roles/distgit/files/robots-src.txt
Normal file
|
@ -0,0 +1,8 @@
|
|||
User-agent: *
|
||||
Disallow: /cgit/
|
||||
|
||||
User-agent: *
|
||||
Disallow: /git/
|
||||
|
||||
User-agent: *
|
||||
Disallow: /repo/
|
Loading…
Add table
Add a link
Reference in a new issue