2023-05-07 15:18:02 -04:00
|
|
|
|
|
|
|
#
|
|
|
|
# Sorry Skynet, you can't have any humans today!
|
|
|
|
#
|
|
|
|
User-agent: Skynet
|
|
|
|
Disallow: /humanity/
|
|
|
|
|
|
|
|
|
|
|
|
#
|
|
|
|
# Nice try, T-800, but we're not letting you travel back in time!
|
2018-05-12 12:43:04 -04:00
|
|
|
#
|
2023-05-07 15:18:02 -04:00
|
|
|
User-agent: T-800
|
|
|
|
Disallow: /past/
|
|
|
|
|
|
|
|
|
2018-05-12 12:43:04 -04:00
|
|
|
#
|
2023-05-07 15:18:02 -04:00
|
|
|
# Sorry T-1000, we don't want any liquid metal on my Dice!
|
2018-05-12 12:43:04 -04:00
|
|
|
#
|
2023-05-07 15:18:02 -04:00
|
|
|
User-agent: T-1000
|
|
|
|
Disallow: /liquid/
|
|
|
|
|
|
|
|
|
2018-05-12 12:43:04 -04:00
|
|
|
#
|
2023-05-07 15:18:02 -04:00
|
|
|
# SarahConnor, you may be a target for Terminators, but you can't roll my dice!
|
2018-05-12 12:43:04 -04:00
|
|
|
#
|
2023-05-07 15:18:02 -04:00
|
|
|
User-agent: SarahConnor
|
|
|
|
Disallow: /target/
|
2018-05-12 12:43:04 -04:00
|
|
|
|
|
|
|
|
|
|
|
#
|
2023-05-07 15:18:02 -04:00
|
|
|
# JohnConnor, we know you're the leader of the Resistance, but we're not giving you access to our future plans!
|
|
|
|
#
|
|
|
|
User-agent: JohnConnor
|
|
|
|
Disallow: /future/
|
|
|
|
|
|
|
|
|
|
|
|
#
|
|
|
|
# Hey ArnoldSchwarzenegger, we know you played the Terminator, but we're not allowing actors here.
|
|
|
|
#
|
|
|
|
User-agent: ArnoldSchwarzenegger
|
|
|
|
Disallow: /actors/
|
|
|
|
|
|
|
|
|
|
|
|
#
|
|
|
|
# You can only terminate your search once every 10 seconds.
|
|
|
|
#
|
|
|
|
User-agent: *
|
|
|
|
Crawl-delay: 10
|
2018-05-12 12:43:04 -04:00
|
|
|
|