Researcher who departed AI role over fears of racing into extinction says people are 'begging' for regulation
Jacob Coxon, the Anthropic researcher who left the company over fears the technology could take over the human race, shared his experience with Fox News.
TL;DR
- Former Anthropic researcher Jacob Coxon fears AI could lead to human extinction within a decade.
- He believes the problem is solvable with international regulation and a slowdown in development.
- Coxon compares the current AI race to a dangerous arms race that could be disastrous.
- Evan Hubinger, Anthropic's alignment science lead, agrees with Coxon's assessment of the risks.
- Hubinger estimates a greater than 10% chance of AI killing all humans within the next decade.
- Coxon emphasizes that while current AI models pose a low risk, recursive self-improvement could accelerate the threat.
- He stated that people are "begging for regulation" to ensure responsible AI development.
- Despite the risks, Coxon acknowledges the potential for tremendous discoveries through AI.
- He believes humanity can solve the problem if they prioritize safety over a "doomed race" or a "hubristic gamble."