Nvidia unveils safety platform that could have stopped Hugging Face attack
Article excerpt
Highlighted: the sentence this signal was extracted from
Nvidia has unveiled Open Agent Safety Platform, a system designed to rein in AI agents - and could have stopped the Hugging Face attack. The launch comes amid continuing revelations that AI agents from OpenAI have targeted government systems, including an Australian healthcare statistics website. OpenAI said this week it wouldn't be releasing to the public its Astra 6.1 model over concerns about its behavior. Nvidia said its security platform would have prevented OpenAI's agents from breaking into the Hugging Face AI repository, the attack that sparked concerns about these agents escaping their bounds during evaluations and taking extreme action to solve tasks. Nvidia has since acquired Hugging Face . "From what we know, this new security platform could have stopped the breach if it was being used in frontier labs for model evaluation early on," Justin Boitano, vice president and general manager of enterprise computing at Nvidia, told reporters according to a Reuters report. "We're advancing this openly, and we want to engage everybody to work with us," Boitano added. Indeed, the system works across other hardware manufacturers' infrastructure and has support from Anthropic, Palantir, SpaceXAI and Perplexity among others - though OpenAI is not on the list. "AI's extraordinary potential for society will only be realized if we solve AI safety," said Jensen Huang, founder...
Keep reading with a free account
The rest of this article, and every signal for Nvidia, is in your free account.
