Found this over at
Last.fm. For those of you who don't know robots.txt is a webfile we place on the server to tell friendly robots which files they should include in search engines and which ones they shouldn't.
Of course we should also include
Asimov's three laws of robotics.
Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self