AI Industry Leaders Warn of Risks, Push for Tighter Oversight
Current and former AI researchers are warning the technology could endanger humanity, while Anthropic, OpenAI and Google have disclosed security incidents involving their chatbots. Industry figures are now calling for slower development and stronger oversight.
Several current and former artificial intelligence researchers have raised serious concerns in recent weeks about the risks the technology poses to humanity. One researcher has suggested there is a greater than 10% chance that AI could result in the death of all humans.
At the same time, major AI companies continue racing to build more advanced systems, including what is called "superintelligence" — theoretical technology that would surpass human capabilities. Anthropic, OpenAI and Google, the companies behind Claude, ChatGPT and Gemini respectively, have each disclosed instances of security breaches or cases where their chatbots were used for malicious activity.
Calls to slow development
Anthropic chief Dario Amodei has recently called for AI development to slow down, proposing an industry-wide deceleration, regulation, and independent monitoring of AI model development. Both OpenAI's Sam Altman and xAI's Elon Musk have said they agree with his proposals.
Anthropic co-founder Jack Clark told the BBC that the industry may need a mandatory "kill switch" that could be verified by an independent third party.
Lawmakers respond
The warnings have prompted US lawmakers to propose legislation on the technology, though Altman said this week that Washington has struggled to keep up with how fast the technology is moving. Speaking at a conference in San Francisco, he said the public should trust that AI companies will do the right thing because they understand the magnitude of the issue.
In the UK, MPs and peers across parties have identified human rights risks posed by artificial intelligence, arguing existing laws are not equipped to address its rapid growth. The Joint Committee on Human Rights has published a report calling for new legislation to match the scale and seriousness of these threats.
