Nvidia says new tool can contain rogue AI agents in "milliseconds"

Live updates

1. 1h ago

   Nvidia Launches Open Agent Safety Platform to Contain Rogue AI

   Nvidia has launched the Open Agent Safety Platform, a new software tool designed to prevent artificial intelligence agents from going rogue. According to the United States chipmaker, the platform controls agent access limits and can isolate a misbehaving agent within "milliseconds." The release follows a series of high-profile artificial intelligence safety incidents and troubling breaches. The open software platform provides full-stack governance and control across the software, hardware, compute, and robotics systems that run autonomous agents, aiming to secure them from testing through deployment.

   Why it matters

   The technology industry faces growing pressure to implement safety controls as autonomous artificial intelligence systems become more capable and widespread. Major industry players are shifting focus from raw speed to risk aversion and guardrails following recent security incidents. Nvidia designed this system to bridge gaps in agent containment across both hardware and software layers.

   What is confirmed

   • Nvidia announced the Open Agent Safety Platform as an open software platform and reference system design.
   • The platform is designed to control what an agent can access and isolate it within milliseconds if it crosses those limits.
   • The tool aims to strengthen artificial intelligence security from agent testing to deployment.

   Still unconfirmed

   • Nvidia says the tool could have stopped the Hugging Face breach, but the Sentry component has no release date.
   • OpenAI is absent from Nvidia's industry-wide effort to end rogue AI agents.

   What to watch next

   • Adoption rates of the Open Agent Safety Platform across major artificial intelligence developers.
   • Releases or announcements regarding the Sentry hardware watchdog component.
   Sources used for this update (21)

   1. CNBC — Nvidia releases software platform to stop AI agents from misbehaving
   2. NVIDIA Developer — NVIDIA Open Agent Safety Platform: A Reference for Continuous In-Silicon Agent Monitoring | NVIDIA Technical Blog
   3. cnn.com — Nvidia launches new tool to keep AI agents from going rogue
   4. NVIDIA Newsroom — NVIDIA Launches Open Agent Safety Platform to Secure Agents From Testing to Deployment
   5. The Washington Post — Opinion | AI doesn’t need a conscience. It needs a leash.
   6. Axios — Nvidia says new tool can contain rogue AI agents in "milliseconds"
   7. CNBC — CNBC Daily Open: From need for speed to seatbelts — AI majors focus on risk aversion
   8. www.nvidia.com — World Leader in Artificial Intelligence Computing | NVIDIA
   9. en.wikipedia.org — Nvidia - Wikipedia
   10. play.geforcenow.com — GeForce NOW
   11. www.nvidia.co.uk — Drivers - Download NVIDIA Drivers
   12. nvidianews.nvidia.com — Home | NVIDIA Newsroom
   confidence 100%