rationalskepticism.org

The Singularity, Virtual Immortality and the Trouble with Consciousness
by Robert Lawrence Kuhn

According to techno-futurists, the exponential development of technology in general and artificial intelligence (“AI”) in particular — including the complete digital replication of human brains — will radically transform humanity via two revolutions. The first is the "singularity," when artificial intelligence will redesign itself recursively and progressively, such that AI will become vastly more powerful than human intelligence ("superstrong AI"). The second revolution will be "virtual immortality," when the fullness of our mental selves can be uploaded perfectly to nonbiological media (such as silicon chips), and our mental selves will live on beyond the demise of our fleshy, physical bodies.

AI singularity and virtual immortality would mark a startling, transhuman world that techno-futurists envision as inevitable and perhaps just over the horizon. They do not question whether their vision can be actualized; they only debate when will it occur, with estimates ranging from 10 to 100 years. [Artificial Intelligence: Friendly or Frightening? ]

I'm not so sure. Actually, I'm a skeptic — not because I doubt the science, but because I challenge the philosophical foundation of the claims. Consciousness is the elephant in the room, and most techno-futurists do not see it. Whatever consciousness may be, it affects the nature of the AI singularity and determines whether virtual immortality is even possible.

....