Safeguard
AI Security•

Which vulnerability decisions should an LLM never make alone?

Models can draft and explain, but some calls need a named person: risk acceptance, exceptions, severity overrides and release blocks. A decision map.

Safeguard Security Team
3 min read

An LLM should not alone decide risk acceptance, exceptions, severity overrides, release blocks or customer-facing statements. These carry accountability, and a model cannot be accountable. Let it prepare the evidence and draft the wording, then have a named person decide and sign.

Sort decisions by consequence

Not every task needs the same oversight. Sort by what happens if the output is wrong.

DecisionWrong answer costsWho decides
Rewrite a finding summary for clarityLowModel drafts, author skims
Group duplicate alertsLow to mediumModel proposes, analyst confirms
Suggest a fix versionMediumModel proposes, tests and rescan confirm
Mark a finding as a false positiveMedium to highAnalyst, with code evidence
Accept a risk or grant an exceptionHighNamed owner, with expiry
Block or release a buildHighPolicy rule, exception by owner
Tell a customer they are not affectedHighSecurity lead, with evidence

Why accountability matters

Audits and customer reviews ask who made a decision and on what basis. "The assistant said so" is not an answer. A record with the evidence, the reviewer and the date is.

What to give the model

For the low-consequence rows, a model is a real time saver. Give it structured facts and ask for a short, plain summary. Ask it to list assumptions. Ask it to draft the exception request so the owner only has to check and sign.

What to record for each decision

  1. The finding and its source
  2. The evidence used, with dates
  3. Whether an assistant helped and in what step
  4. The decision and the person who made it
  5. An expiry or review date for any exception

Keep this in the ticket, not in a chat window that may be deleted.

Common failure modes

  • Rubber stamping. Reviewers approve model output without reading. Counter by sampling and re-checking a few each week.
  • Authority drift. A model's suggestion becomes the default because it is first in the ticket. Put the evidence first.
  • Silent scope growth. A pilot for summaries turns into auto-closing tickets. Write down what the model may do and revisit it.

For deeper treatment of oversight, see how much autonomy should an AI SOC agent have.

Try it yourself

Click through it at your own pace, or open it full screen.

Click through the workflow and mark which steps you would leave to a person.

Where Safeguard fits

Safeguard supports vulnerability management with policies, gates and compliance evidence automation, so decisions and their evidence are recorded in one place. Free scan: https://gold.safeguard.sh/scan.

Quick check

Can a model auto-close duplicate tickets?

Only if closing is reversible, logged, and sampled by a person. Start with proposing duplicates, not closing them.

Who owns a decision that an assistant helped with?

The person who approved it. Record their name.

Last reviewed: 19 October 2026.

Never miss an update

Weekly insights on software supply chain security, delivered to your inbox.

Self-healing security runs on Safeguard.

Your first fix PR is minutes away.

No sales call required, even your agent can complete the purchase over MCP.