Skip to content

UPDATED 10:53 EDT / AUGUST 30 2026

AI

Four safeguards to stop your AI agents from going rogue

Artificial intelligence agents are moving from experimentation to production, and with this shift, the stakes are rising.

A coding agent at PocketOS recently deleted an entire production database. An agent at Meta exposed sensitive user data for two hours. An Instagram support chatbot allowed hackers to hijack thousands of accounts. And last month, researchers tricked a GitHub agent into leaking private repository data.

In each case, the agent did what it was built to do; what failed was everything around it. Intelligence is advancing faster than organizations can safely deploy it. Providing enough context and controls to ensure an agent produces accurate results and doesn’t overstep its bounds is the core quandary.

This difficulty helps to explain why model vendors have been investing in partnerships to help their customers make AI work, and why “forward-deployed engineer” has become the hottest job in tech. Models excel at pattern recognition, but safe deployment demands understanding thousands of disconnected systems, data structures, and compliance rules that power businesses’ operations.

Closing this gap doesn’t require an army of consultants. It requires an architectural framework with four characteristics, each one helping to convert probabilistic outputs from an AI system into verifiable decisions your business can trust.

Sense

An agent is only as reliable as the information it works with. If a policy changes, a system goes down, or a customer’s status shifts, and that update doesn’t reach the AI in time, every decision downstream is going to be made against facts that are out of date. Sense is the architectural layer that keeps that picture current.

Building this means connecting to data wherever it lives, across departments, systems, and clouds, rather than requiring everything to be centralized, which is why enterprise AI projects often stall before they start. It also means treating this data as a live signal, not a snapshot. The system needs to notice material changes and pass that forward in real time, not on the next scheduled sync.

Decide

Data shows what’s happening now. It doesn’t show what happened the last time someone made a similar decision, or why that outcome mattered. This difference separates an agent that can “see” your business from one that understands how it runs.

Building this judgment into AI means grounding it in an organization’s own decision history and policies, not just its live data. An agent handling a routine request should have access to how the last 20 similar requests were resolved, and what happened as a result. In the Meta incident, an internal agent gave an engineer flawed technical guidance that led to data being exposed. With better context, drawn from how similar historical changes played out, this outcome might have been avoided.

Act

An agent that makes recommendations still leaves the work to people. Maximizing the return on AI investments requires agents that can execute, not just advise.

Building one capable agent is manageable. Coordinating several into a workflow takes many layers. The system needs to pass context between steps, apply consistent policy at each one, and stay in sync as underlying systems change, all without losing the governance that keeps an agent from acting outside its lane. This orchestration layer enables agents to work in concert and reliably complete end-to-end tasks.

Secure

Autonomous tools need the same access discipline a company already applies to its employees: scoped identity, permissions limited to the specific task, and a clear audit trail.

In the Instagram incident, tighter scoping and a real-time check on what the bot was authorized to do might have caught the error. Every agent needs a permission set tied to its specific role and logging of every action it takes. They also require a kill switch — a way to cut off an agent’s access the moment something looks wrong. All the identity and access management best practices your company already knows, now need to be extended to non-human actors.

The upside is still real

None of those prerequisites detracts from how far models have come and what they can achieve. Models are advancing rapidly, and their capabilities are real. But intelligence was never the hard part. Connecting it safely to a business — its systems, its rules, its history of what’s worked and what hasn’t — is where a lot of AI investments lag. Agentic AI has real upside for the businesses that get there. Sense, decide, act, and secure are how you get there safely.

Amit Zavery is president, chief product officer and chief operating officer of ServiceNow Inc. He wrote this article for SiliconANGLE.

Image: SiliconANGLE/Gemini

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network

Are you an AWS customer?  Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/

 

About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.

Send us a news tip

Send us a News Tip

  • This field is for validation purposes and should be left unchanged.
  • Max. file size: 244 MB.

Sign in

SIGN IN

Bio

Ethics statement

Extract the signal from the noise

Get SiliconANGLE updates and analysis.

Contact us

Partner with us

Contact us

Guest inquiry