overleaf/services/web/public/robots.txt

18 lines
250 B
Text
Raw Normal View History

2014-02-12 05:23:40 -05:00
# robots.txt for https://www.sharelatex.com/
User-agent: *
Disallow: /project/*
Disallow: /recurly.com
2015-09-22 09:16:58 -04:00
Allow: /
User-Agent: AhrefsBot
Disallow: /
User-Agent: XoviBot
Disallow: /
User-Agent: RankSonicBot
Disallow: /
User-Agent: SMTBot
Disallow: /