Anthropic researchers warn AI could pose catastrophic risks
Jacob Coxon, a researcher who trained AI systems at Anthropic and previously at OpenAI, said he had left Anthropic because of what he described as an insufficiently cautious approach to safety. In a post on X, he accused both companies of racing toward self-improving superintelligence and “gambling with our lives.” Coxon said people developing AI seriously believe it could kill everyone by the end of the decade.
Evan Hubinger, who leads an Anthropic AI safety team, said he also fears self-improving AI and believes its development is advancing faster than expected. He agreed that the technology could kill all humans, putting his personal estimate of that outcome at more than 10 percent within the next decade. Hubinger added that Anthropic does not yet have a plan to keep advanced AI safe and aligned with human values, and is not clearly on course to create one.
The exchange reflects broader industry concerns about systems that might improve beyond human control, as companies continue pursuing more advanced models.
Written by Sakhanda Wire AI from reporting by The Verge. Facts, quotes and full context are in the original article below.