github/overleaf
1
0
Fork 0
mirror of https://github.com/overleaf/overleaf.git synced 2024-12-24 03:23:10 +00:00
Code Issues Projects Releases Packages Wiki Activity

change robots.txt to ignore all

Browse source
This commit is contained in:
Henry Oswald 2016-02-16 12:37:38 +00:00
parent 735f7bd51e
commit 5f719e7105
1 changed files with 0 additions and 16 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
services/web/public/robots.txt
View file

@ -1,18 +1,2 @@
# robots.txt for https://www.sharelatex.com/
User-agent: *
Disallow: /project/*
Disallow: /recurly.com
Allow: /
User-Agent: AhrefsBot
Disallow: /
User-Agent: XoviBot
Disallow: /
User-Agent: RankSonicBot
Disallow: /
User-Agent: SMTBot
Disallow: /