From a069f698d3a9669eeadbb061fc768b6d0ef94084 Mon Sep 17 00:00:00 2001 From: Patrick Uiterwijk Date: Sat, 19 May 2018 22:15:25 +0200 Subject: [PATCH] Paste should not be indexed by engines Signed-off-by: Patrick Uiterwijk --- .../website/files/robots/robots.txt.paste.fedoraproject.org | 2 ++ 1 file changed, 2 insertions(+) create mode 100644 roles/httpd/website/files/robots/robots.txt.paste.fedoraproject.org diff --git a/roles/httpd/website/files/robots/robots.txt.paste.fedoraproject.org b/roles/httpd/website/files/robots/robots.txt.paste.fedoraproject.org new file mode 100644 index 0000000000..1f53798bb4 --- /dev/null +++ b/roles/httpd/website/files/robots/robots.txt.paste.fedoraproject.org @@ -0,0 +1,2 @@ +User-agent: * +Disallow: /