
The paperclip maximizer is an AI that makes paperclips and never stops making them. Its existence, or possible existence, presents us with the problem of how to talk to an AI. For example, if we say “AI, make me a lot of paperclips” will the AI then start to convert the entire solar system into paperclips. Can we stop such a runaway AI? Or will it eventually kill itself?
If the paperclip maximizer...