dotya.ml/gitea-templates
dotya.ml/gitea-templates
2
1
Fork 0
Code Issues 2 Pull Requests 1 Projects 2 Releases Activity

robots: add DataForSeoBot to blocklist

Browse Source
This commit is contained in:
surtur 2022-06-15 01:10:01 +02:00
parent 0e596da80f
commit 27dc6198ed
Signed by: wanderer
GPG Key ID: 19CE1EC1D9E0486D
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
custom/public/robots.txt
View File

@ -21,6 +21,10 @@ User-agent: BLEXBot
Disallow: /
User-agent: DataForSeoBot
Disallow: /
User-agent: *