Add a robots.txt

This adds a basic robots.txt which prevents indexing of pages under `/groups`.

Add a robots.txt
This adds a basic robots.txt which prevents indexing of pages under `/groups`.
0af6c962 · Nick Stenning · faeb6a52 · 0af6c962
Commit 0af6c962 authored Dec 07, 2015 by Nick Stenning
Hide whitespace changes
Inline Side-by-side

Showing with 3 additions and 0 deletions

robots.txt h/static/robots.txt +3 -0

No files found.
--- a/h/static/robots.txt
+++ b/h/static/robots.txt
+User-agent: *
+Disallow: /groups
+Allow: /groups/new