tech
Silicon Valley Is in a Frenzy Over Bots That Build Themselves
Late last month, a large crowd gathered in downtown San Francisco to demand that the AI industry stop developing more powerful bots. Holding signs and banners reading Stop the AI Race and Don’t Build Skynet, the protesters marched through the city and gave speeches outside the offices of Anthropic, OpenAI, and xAI. The crowd demanded that these companies halt efforts to create superintelligent machines—and, in particular, AI models that can develop future AI models. Such a technology, attendees said, could extinguish all human life.
TL;DR
- Protesters in San Francisco demanded AI companies halt development of superintelligent machines that can create future AI models.
- Top AI firms like OpenAI and Anthropic are boasting about internal efforts to automate research, with AI already writing significant portions of code.
- The concept of recursive self-improvement in AI dates back to the 1960s, but recent advances in coding capabilities have reignited interest.
- AI tools are currently speeding up research workflows by assisting with tasks like coding and data curation, but human oversight remains crucial.
- Predictions vary, with some anticipating fully automated AI researchers by 2028 or even 2032, while others cite constraints like funding and energy as potential slowdowns.
- Even if fantastical dreams of self-improvement aren't realized, marginal automation of research is expected to accelerate AI development and alter competition dynamics.
- Leading AI researchers identify the automation of AI research as a severe and urgent risk, with warnings about human loss of control gaining traction.