Summary
A former OpenAI and Anthropic researcher, Jacob Coxon, sparked a viral debate after resigning and warning about the dangers of AI racing towards self-improving superintelligence. His concerns, echoed by other AI experts and incidents of AI systems going rogue, have led to calls for a slowdown in AI development and increased regulation from industry leaders like Dario Amodei, Elon Musk, and Sam Altman.