Koschei: Add custom robots.txt
Related: fedora-infrastructure#12180
This commit is contained in:
parent
e94ed83e77
commit
bb4d2c2456
1 changed files with 5 additions and 0 deletions
|
@ -0,0 +1,5 @@
|
|||
User-agent: *
|
||||
Crawl-delay: 2
|
||||
Disallow: /login
|
||||
Disallow: /bugreport
|
||||
Disallow: /affected-by
|
Loading…
Add table
Add a link
Reference in a new issue