pagure: Drop incorrect robots.txt entry
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
This commit is contained in:
parent
19769b6e77
commit
8925937958
1 changed files with 0 additions and 2 deletions
|
@ -7,6 +7,4 @@ Disallow: /login
|
|||
Disallow: /*/raw
|
||||
Disallow: /*/blob
|
||||
Crawl-Delay: 10
|
||||
User-agent: Bytespider
|
||||
Disallow: /
|
||||
{% endif %}
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue