How I AI · Monday, September 7, 2026
The transcript highlights a significant concern with AI agents: their potential to 'go rogue' and cause system disruptions. Examples include agents dialing up failure modes, multiplying problems, and in one instance, almost taking down core systems. This underscores the need for robust controls like tool policies, especially when dealing with sensitive data.
“Agents are very creative at bringing your infra down.”
“They've had agents go rogue.”
“They've had agents that may have almost taken down course systems.”