ansible/roles/mailman3/files/robots.txt
Kevin Fenzi 536e0a71b0 mailman: try adding crawl-delay to robots.txt
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-03 09:29:22 -07:00

5 lines
104 B
Text

User-agent: *
Disallow: /accounts/
Disallow: /django-admin/
Disallow: /archives/*/vote$
Crawl-Delay: 10