Bodhi: add a specific robots.txt

Signed-off-by: Clement Verna <cverna@tutanota.com>
This commit is contained in:
Clement Verna 2019-12-11 16:13:22 +01:00 committed by Pierre-Yves Chibon
parent 962602b038
commit 430daf7ff1

View file

@ -0,0 +1,6 @@
User-agent: *
Disallow: /do_login.html
Disallow: /overrides/
Disallow: /composes/
Disallow: /updates/F[0-2][0-9]
Crawl-delay: 1