Nov 3, 2025
REDMOND, Washington –
My life’s mission has been to create safe, beneficial AI that will make the world a better place. But recently, I’ve been increasingly concerned about people starting to believe so strongly in AIs as conscious entities that they will advocate for “AI rights” and even citizenship. This development would represent a dangerous turn for the technology. It must be avoided. We must build AI for people, not to be people.
In this context, debates about whether AI truly can be conscious are a distraction. What matters in the near term is the illusion of consciousness. We are already approaching what I call “seemingly conscious AI” systems that will imitate consciousness convincingly enough.
An SCAI would be capable of fluently using natural language, di…
Nov 3, 2025
REDMOND, Washington –
My life’s mission has been to create safe, beneficial AI that will make the world a better place. But recently, I’ve been increasingly concerned about people starting to believe so strongly in AIs as conscious entities that they will advocate for “AI rights” and even citizenship. This development would represent a dangerous turn for the technology. It must be avoided. We must build AI for people, not to be people.
In this context, debates about whether AI truly can be conscious are a distraction. What matters in the near term is the illusion of consciousness. We are already approaching what I call “seemingly conscious AI” systems that will imitate consciousness convincingly enough.
An SCAI would be capable of fluently using natural language, displaying a persuasive and emotionally resonant personality. It would have a long, accurate memory that fosters a coherent sense of itself and it would use this capacity to claim subjective experience (by referencing past interactions and memories). Complex reward functions within these models would simulate intrinsic motivation and advanced goal setting and planning would reinforce our sense that the AI is exercising true agency.