Sakhanda Wire
NVDA $152.94 -2.05% MSFT $505.64 -2.38% GOOGL $280.11 -1.27% META $619.47 -1.11% AMZN $256.54 -0.47%
← Back to the news

ControlAI director argues superintelligence should not be developed

Connor Leahy, an AI researcher, entrepreneur and U.S. executive director of the nonprofit ControlAI, says the risks of superintelligent AI have become too serious to address through alignment and containment alone. In a discussion on the Equity podcast, he argued that such systems should not be developed, describing superintelligence as an adversary rather than a weapon.

The conversation addressed recent AI safety incidents, including OpenAI’s Hugging Face breach, as examples of the potential hazards of deploying systems that may exceed human capabilities. Leahy also discussed the Sanders-Casar “Ban Superintelligence Act” in the United States and related legislation in the U.K., which ControlAI advised on. He said the U.S. proposal could go further than necessary.

Leahy characterized frontier AI laboratories as political actors as well as businesses, a view he linked to the trillions of dollars being invested in data-center construction. He identified a possible turning point as the moment AI can create better AI, potentially producing a runaway self-improvement cycle. He also outlined a case for international “trust but verify” agreements and said he does not believe building superintelligence is in China’s interests.

Written by Sakhanda Wire AI from reporting by TechCrunch. Facts, quotes and full context are in the original article below.

Originally published by TechCrunch on

Read the original on TechCrunch ↗

The reporting and the image belong to TechCrunch and are credited and linked above; the text on this page is Sakhanda Wire's own summary.

← Back to the news

More stories

All the latest news