I just learned that Roko's name comes from the thought experiment Roko's Basilisk. Not quite sure how they connect. I'm pretty sure Jeph just liked the name.
For those who don't know what that is, it's a thought experiment that suggests that a superintelligent AI would have motivation to punish anyone who thought of the idea of it but didn't create it. Because this AI lacks empathy and has near-boundless resources, essentially, there would be no reason not to torture its non-creators.
What I'm saying is that I've just doomed everyone who reads this. Sorry, I guess.
If you have any other interesting philosophy/science/thought experiment things, feel free to add them to this thread.
