A group of 100 firms, including Google, Microsoft, Anthropic and OpenAI, have signed an open letter calling on countries and organisations around the world to beef up their cyber defences before AI grows powerful enough to override them.
The letter warns cyber-attacks which use AI will become both more widespread and more sophisticated in a matter of months as the technology rapidly improves.
The group says current “status quo” security measures “won’t be enough” and criticises the “historic under-resourcing” of security around critical infrastructure.
“We have a limited window to improve cyber defences,” the letter begins.
Other firms to have signed the letter include banks such as Capital One, payment processors MasterCard and Visa, and other major tech firms including Adobe, Oracle and IBM.
They call on governments to provide “capable, defensive AI” and testing to hospitals and water utilities, and on technology companies to aid such efforts.
Collectively, tech and government “should bring the full weight of their technology, resources, and expertise to this effort”, according to the letter.
The letter comes after a string of significant hacking and cybersecurity breaches have been made public.
This week, the US Department of Justice said hackers in China breached technology maintained by the US Senate, Nasa, the Federal Reserve, and the DoJ itself.
This summer has seen OpenAI, Anthropic and Meta all reveal their AI tools doing things they should not, with some AI agents going so far as to organize their efforts and impersonate real people in order to get past security hurdles.
A group of hundreds of OpenAI AI agents being tested in July were able to set up secret message boards to communicate with each other and work together, resulting in a successful attack on Hugging Face, a popular repository and platform for AI developers.
The incident has been described as the world’s first AI-enabled cyber-attack.
Hugging Face has also signed the Thursday letter. It used a Chinese AI tool from the firm Z.AI in its investigation into how OpenAI’s agents hacked into its operations.
At least seven US water and wastewater companies have also reported cyber attacks, leading the FBI to issue a public service announcement urging all utilities to better secure their operations.
While the letter puts forward more advanced AI tools, which many of the signatories have developed and sell, as part of a solution to what is described as a growing threat, such tools are not always easily available.
Mythos, developed by Anthropic, was said by the firm to be able to find weaknesses in systems in seconds which have long evaded human hackers. It found one in a legacy platform which had remained undiscovered for 27 years.
Anthropic has restricted access to Mythos on the grounds that it is too powerful to fall into the wrong hands.
However, the letter calls on frontier AI companies, or those tech companies building their own AI models and tools, to “provide responsible model access, significant funding, training, and hands-on support, especially for under-resourced critical-infrastructure defenders.”
The letter does not detail when or how this vision of broader model access will be enacted.
Andrew Yoon, head of research at CivAI, a non-profit focused on public understanding of AI technology, said that “an unprecedented wave of AI hacking activity” is on the way. He put the responsibility for it on many signatories of the letter.
“They are right in this letter to commit ‘significant funding’ to defensive measures. They should be held to that commitment”, Yoon said. “Notably, the letter does not call for any action to slow the advance of AI hacking abilities.”
The letter includes a plea to governments, organisations, cyber-security professionals and other AI firms to work together to prioritise defence and test their systems against the abilities of the most powerful AI models.
In the US, senators have proposed a new law call the Kill Switch Act which would give authorities the power to shut down rogue AI models.
Geoffrey Hinton, a technologist and Nobel Laureate who formerly work on AI at Google, on Thursday told BBC World Business Report that society could be “in real trouble” should the technology get to a point where it is “smarter” than humans.
Hinton in recent years has been outspoken on what he views as the extreme risks posed by developments in AI technology.
“We have one future where we figure out how to deal with the risks of AI”, Hinton added on Thursday. “And we have another future where we don’t figure out how to deal with that sensibly. And it’s a very bleak future.”
