robots.txt: disallow crawling when not in production. (#27559)

3256a2c2 · XhmikosR · GitHub · 4b15ec9c · 3256a2c2
Unverified Commit 3256a2c2 authored 6 years ago by XhmikosR Committed by GitHub 6 years ago
Hide whitespace changes
Inline Side-by-side

Showing

with 1 addition and 1 deletion
+1 -1
--- a/site/robots.txt
+++ b/site/robots.txt
@@ -5,5 +5,5 @@
 # Allow crawling of all content
 User-agent: *
-Disallow:
+Disallow:{% if jekyll.environment != "production" %} /{% endif %}
 Sitemap: {{ site.url }}/sitemap.xml