# robots.txt for https://www.sharelatex.com/ User-agent: * Disallow: /project/* Disallow: /github/repos/* Disallow: /recurly.com Disallow: /user/password/set Disallow: /learn-scripts/* Allow: / User-Agent: AhrefsBot Disallow: / User-Agent: XoviBot Disallow: / User-Agent: RankSonicBot Disallow: / User-Agent: SMTBot Disallow: /