AI Agent Risk Calculator

How much harm could one of your AI agents do if it were manipulated or made a mistake, and what is missing to stop it? Answer 20 questions about one agent and get a 0-100 risk score, red flags and the controls to add.

How the AI agent risk score works

An AI agent is risky in proportion to what it can do and how little stops it. The calculator measures both. Part 1 adds up the agent's exposure: points for each capability that could cause harm, such as reading content from outside the company, reaching personal data, sending data out, changing records, paying, running code or deciding about people. Part 2 measures control coverage: the share of the relevant controls that are in place, weighted by how much each one matters.

Risk score = (exposure ÷ 25) × (1 − control coverage) × 100. Yes = full weight, Partial = half, No = 0. 0 is the lowest risk.

An agent that can do nothing harmful scores 0 whatever its controls. An agent that can do everything with no controls scores 100. The weights are our own judgement of how much each capability adds and each control removes, based on the OWASP Top 10 for LLM Applications 2025 and for Agentic Applications 2026 and the MCP security best practices.

Levels: Low below 20, Medium from 20, High from 40. Any high red flag makes the level at least High, and a critical red flag makes it Critical, whatever the score.

The 20 questions and their weights

Part 1 answers are Yes or No. Each Yes adds the points shown, up to 25.

Capability (part 1)PointsReference
Reads untrusted content3OWASP LLM01, ASI01
Accesses personal or confidential data3OWASP LLM02; GDPR Art. 5(1)(f)
Can send data outside3OWASP LLM02, ASI02
Can change or delete data2OWASP ASI02, LLM06
Can pay or commit3OWASP ASI02, LLM06
Runs code3OWASP ASI05, LLM05
Decides about people3GDPR Art. 22; AI Act Annex III
Uses third-party tools or other agents2OWASP ASI04, ASI07; LLM03
Acts without per-action approval3OWASP LLM06, ASI10

Part 2 answers are Yes, Partial or No. A control counts only when the agent has one of the capabilities it limits; the others are marked as not counted and left out of the coverage.

Control (part 2)WeightCounts whenReference
Own, narrowly scoped credentials3AlwaysOWASP ASI03; MCP scope minimization
Approval for high-impact actions3If: can send data outside, can change or delete data, can pay or commit, decides about peopleOWASP LLM06, ASI09
Approved and pinned tools2AlwaysOWASP ASI04, LLM03; OWASP MCP03, MCP04
Outbound destinations restricted2If: can send data outsideOWASP LLM02; MCP security best practices (SSRF, egress)
Every action logged2AlwaysOWASP MCP08; GDPR Art. 5(2)
Tested kill switch2AlwaysOWASP ASI10
Value, volume and rate limits2If: can send data outside, can change or delete data, can pay or commit, acts without per-action approvalOWASP LLM10, ASI08
Prompt injection tested2If: reads untrusted contentOWASP LLM01, ASI01
Sandboxed code execution3If: runs codeOWASP ASI05; MCP security best practices (local server compromise)
Registered with owner and risk assessment1AlwaysOWASP ASI10; NIS2 Art. 21(2)(a)
Data protection assessed2If: accesses personal or confidential data, decides about peopleGDPR Arts. 25, 35

Red flags

Some combinations matter more than an average can show, so the calculator also checks seven fixed rules. A red flag closes only when the control that answers it is fully in place; Partial is not enough.

Red flagSeverityWhen it is raised
Exfiltration pathCriticalReads untrusted content, accesses private data and can send data out, with neither approval nor restricted destinations fully in place
Injected instructions could change data or spend moneyHighReads untrusted content and can change data or pay, without approval
Code runs outside a sandboxHighRuns code, without a sandbox fully in place
Decisions about people without human reviewHighDecides about people and acts without per-action approval, without approval for high-impact actions
Borrowed or over-broad credentialsHighOwn scoped credentials answered No, and the agent can reach data, send it out, change it or pay
Autonomous agent without a kill switchHighActs without per-action approval, tested kill switch answered No
Unvetted third-party toolsHighUses third-party tools or agents, approved and pinned tools answered No

The first rule is the most important. An agent with untrusted input, private data and an outbound channel can be told by a single malicious email, ticket or web page to send that data to an attacker. The model cannot reliably tell instructions from data, so the fix is structural: remove one of the three capabilities, or put a person or a fixed allowlist between the agent and the outside world.

Worked example: a customer support agent

A support assistant reads incoming tickets (untrusted content), looks up customer records (personal data), replies by email (sends data out), uses a CRM connector from an MCP server (third-party tools) and replies on its own (no per-action approval). Its exposure is 3 + 3 + 3 + 2 + 3 = 14 of 25.

Ten controls are relevant; only the sandbox is not, because it runs no code. The agent has its own scoped credentials (3), approved and pinned tools (2) and is registered (1). Approval exists for some replies (Partial, 1.5 of 3), logging is partial (1 of 2) and data protection was assessed but has no DPIA yet (Partial, 1 of 2). There are no restricted destinations, limits, kill switch or injection tests. That is 9.5 of 21 points, a coverage of 45%.

Score: 14 ÷ 25 × (1 − 0.45) × 100 = 31, which alone would be Medium. But the exfiltration path is open (approval is only partial and destinations are not restricted), and the agent acts autonomously without a kill switch. The level is Critical. Requiring approval for every outgoing email that contains customer data, or limiting replies to the ticket's sender, closes the critical flag.

What this calculator is not

It is a structured self-assessment, not a scanner, a penetration test or an audit. It cannot see what your agent really does; it takes your word for it. Use it to decide where to look first and to explain the risk to management. For a full review of the MCP servers and tools an agent uses, the MCP Security Audit Kit has 57 checks with how to verify each one. To document the agent, its permissions and its risks, the AI Agent Governance Pack has a register, a delegation and permissions matrix and a risk assessment workbook.

The same rules are available to AI assistants as the agent_risk_check tool of the ClevSec MCP server, so an assistant can run the check for you and get the same result.

Frequently Asked Questions

Does this calculator scan or test my agent?

No. It works only from your answers about what the agent can do and which controls limit it. It does not connect to the agent, its tools or your systems. A real test means trying prompt injection and checking permissions in a test environment; the MCP Security Audit Kit lists those tests.

Why is my agent Critical when the score is low?

Because some combinations matter more than any average. An agent that reads outside content, can reach private data and can send data out can be made to leak that data by one malicious email or document, however good its other controls are. That exfiltration path makes the level Critical until approval for outbound actions or restricted destinations is fully in place. Read more in How to secure MCP servers and AI agents.

Why don't all 11 controls count for every agent?

A control only reduces risk if the agent has the capability it limits. A sandbox does nothing for an agent that never runs code, and restricted destinations do nothing for one that cannot send data out. Counting them anyway would reward agents for controls that are irrelevant to them. Credentials, approved tools, logging, a kill switch and a register count for every agent.

Why does Partial not close a red flag?

A partial approval step or a partly restricted outbound channel still leaves a path open, for example approval for some recipients but not others. Partial controls earn half their weight in the score, but red flags close only when the control is fully in place.

Is an agent that decides about people automatically unlawful?

Not automatically. GDPR Article 22 restricts decisions based solely on automated processing that have legal or similarly significant effects, with exceptions such as explicit consent or necessity for a contract, and then requires safeguards including the right to human intervention. Some uses, such as recruitment and creditworthiness checks, are also high-risk under AI Act Annex III, with deployer obligations from 2 December 2027. See AI agents and the GDPR.

Is my data stored?

No. The calculator runs in your browser and sends nothing to any server. Take a screenshot or note your results before leaving the page.

Related Articles

Related Tools

Sources

Disclaimer: This is a self-assessment for informational purposes only, based solely on your answers. It is not a security test or audit and does not constitute legal, regulatory or professional advice. Created by ClevSec, an independent studio of compliance and security tools.

Last updated: November 2026