[Scummvm-git-logs] scummvm-web master -> ab3bf004d879f0dfd1c9f79e58585a2e0f13be5c

[Mataniko]

This automated email contains information about 1 new commit which have been
pushed to the 'scummvm-web' repo located at https://github.com/scummvm/scummvm-web .

Summary:
ab3bf004d8 WEB: Disallow SemrushBot


Commit: ab3bf004d879f0dfd1c9f79e58585a2e0f13be5c
    https://github.com/scummvm/scummvm-web/commit/ab3bf004d879f0dfd1c9f79e58585a2e0f13be5c
Author: Matan Bareket (mataniko at gmail.com)
Date: 2019-01-05T20:33:02-05:00

Commit Message:
WEB: Disallow SemrushBot

Changed paths:
    robots.txt


diff --git a/robots.txt b/robots.txt
index 6b4837b..aad2803 100644
--- a/robots.txt
+++ b/robots.txt
@@ -1,3 +1,6 @@
 User-agent: *
 Disallow: /frs
 Disallow: /downloads
+
+User-agent: SemrushBot
+Disallow: /