robots: increase global Crawl-delay to 3s
This commit is contained in:
parent
b27e152bc8
commit
d210e30aea
@ -83,4 +83,4 @@ Disallow: */search
|
||||
Disallow: /*q=
|
||||
Disallow: /*.atom
|
||||
|
||||
Crawl-delay: 1
|
||||
Crawl-delay: 3
|
||||
|
||||
Loading…
Reference in New Issue
Block a user