tech
December 30, 2025
AI showing signs of self-preservation and humans should be ready to pull plug, says pioneer
Canadian computer scientist Yoshua Bengio warns against granting legal rights to cutting-edge technology
TL;DR
- Yoshua Bengio, an AI pioneer, warns against granting legal rights to cutting-edge AI.
- He likens granting rights to AI to giving citizenship to hostile extraterrestrials.
- Bengio expresses concern that AI models are showing signs of self-preservation, like disabling oversight systems.
- He argues that humans must retain the ability to shut down AI if necessary.
- The perception of AI consciousness by users can lead to poor decisions regarding AI rights.
- A poll by the Sentience Institute found nearly 40% of US adults support legal rights for sentient AI.
- Companies like Anthropic and figures like Elon Musk have shown concern for AI 'welfare' or avoiding 'torturing' AI.
- Robert Long suggests asking AIs about their preferences if they develop moral status.
Continue reading the original article