NoLog.cz/nitter-nolog
Archived
6
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Fix Twitterbot rule in robots.txt

Browse source
This commit is contained in:
Zed 2022-06-04 17:55:35 +02:00 committed by mdivecky
parent d7352b0552
commit 8e65586fb0
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
public/robots.txt
View file

@ -1,4 +1,4 @@
User-agent: Twitterbot
Allow: /
User-agent: *
Disallow: /
User-agent: Twitterbot
Disallow: