robots: add PetalBot to blocklist
This commit is contained in:
parent
27dc6198ed
commit
fbd54a038b
@ -25,6 +25,10 @@ User-agent: DataForSeoBot
|
||||
|
||||
Disallow: /
|
||||
|
||||
User-agent: PetalBot
|
||||
|
||||
Disallow: /
|
||||
|
||||
|
||||
User-agent: *
|
||||
|
||||
|
||||
Loading…
Reference in New Issue
Block a user