github/overleaf
1
0
Fork 0
mirror of https://github.com/overleaf/overleaf.git synced 2024-11-07 20:31:06 -05:00
Code Issues Projects Releases Packages Wiki Activity

Remove changes to robots.txt.

Browse source
This commit is contained in:
Paulo Reis 2018-08-02 16:33:45 +01:00
parent f418929dcf
commit f605e79fa5
1 changed files with 1 additions and 20 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

21
services/web/public/robots.txt
View file

@ -1,21 +1,2 @@
# robots.txt for https://www.sharelatex.com/
User-agent: *
Disallow: /project/*
Disallow: /github/repos/*
Disallow: /recurly.com
Disallow: /user/password/set
Disallow: /learn-scripts/*
Allow: /
User-Agent: AhrefsBot
Disallow: /
User-Agent: XoviBot
Disallow: /
User-Agent: RankSonicBot
Disallow: /
User-Agent: SMTBot
Disallow: /
Disallow: /