ansible/roles/mailman3/files/robots.txt

User-agent: *
Disallow: /accounts/
Disallow: /django-admin/
Disallow: /archives/*/vote$
Crawl-Delay: 10
[mailman3] Create a new role mailman3 It seems that the mailman update is more complicated than I originally thought. So I decided to start with clean role and will slowly start adding new changes. Signed-off-by: Michal Konecny <mkonecny@redhat.com> 2024-03-18 17:23:36 +01:00			`User-agent: *`
			`Disallow: /accounts/`
			`Disallow: /django-admin/`
			`Disallow: /archives/*/vote$`
mailman: try adding crawl-delay to robots.txt Signed-off-by: Kevin Fenzi <kevin@scrye.com> 2024-07-03 09:29:22 -07:00			`Crawl-Delay: 10`