Bodhi: add a specific robots.txt
Signed-off-by: Clement Verna <cverna@tutanota.com>
This commit is contained in:
parent
962602b038
commit
430daf7ff1
1 changed files with 6 additions and 0 deletions
|
@ -0,0 +1,6 @@
|
|||
User-agent: *
|
||||
Disallow: /do_login.html
|
||||
Disallow: /overrides/
|
||||
Disallow: /composes/
|
||||
Disallow: /updates/F[0-2][0-9]
|
||||
Crawl-delay: 1
|
Loading…
Add table
Add a link
Reference in a new issue