NoLog.cz/headline
6
2
Fork 0
Code Issues Pull requests Releases Wiki Activity
headline/view/static/robots.txt

2 lines
25 B
Text
Raw Normal View History

create robots.txt to stop crawlers
2022-08-27 13:20:44 +02:00
User-agent: *
Disallow: /
Reference in a new issue Copy permalink