pagure: Drop incorrect robots.txt entry

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
This commit is contained in:
Kevin Fenzi 2024-07-13 10:21:28 -07:00
parent 19769b6e77
commit 8925937958

View file

@ -7,6 +7,4 @@ Disallow: /login
Disallow: /*/raw
Disallow: /*/blob
Crawl-Delay: 10
User-agent: Bytespider
Disallow: /
{% endif %}