Safeguard
Compliance•

NIST 800-53 CA-8 Penetration Testing and What to Show an Auditor

CA-8 asks for penetration testing by skilled people, beyond automated scanning. Here is what the control says, what evidence proves it, and how a small team can run it.

Safeguard Security Team
5 min read

CA-8 is the penetration testing control in the Assessment, Authorization, and Monitoring family of NIST SP 800-53 Rev 5. The base statement is short. You conduct penetration testing on the systems or components you choose, at a frequency you choose. Those two choices are organization defined, which means the control gives you the shape and leaves the scope and cadence to you.

800-53 binds US federal systems directly, and it reaches contractors and other organizations through contract terms. For everyone else it is a reference catalog. If you are a small or mid size company, the useful question is what a customer or auditor will accept as proof that you test your defenses the way an adversary would.

What the control asks

NIST's guidance draws a clear line between a vulnerability scan and a penetration test. A pen test goes beyond automated scanning and is run by people or teams with demonstrable skill in network, operating system or application level security. It can validate that a vulnerability is really exploitable, or measure how well a system resists an adversary within constraints of time, resources and skill.

The guidance also notes that results from vulnerability analysis can feed the test, and that testing can be internal or external, against hardware, software or firmware, and can cover physical as well as technical controls. A standard method starts with a pretest analysis using full knowledge of the system, identifies likely weaknesses, and then tests those. NIST calls out technology transitions, such as moving from IPv4 to IPv6, as a moment when testing matters more.

What it means in practice

For most companies this becomes four decisions.

  • Scope. Which systems are in the test? Start with the internet facing application and API, the authentication flow, and the environment that holds customer data.
  • Cadence. Annual is the common floor. Add a retest after major releases or architecture changes, which matches the guidance on transitions.
  • Tester. Someone with real offensive skill, who did not build the thing. That can be a specialist firm or a qualified internal team that sits apart from development.
  • Rules of engagement. Written permission, target list, time window, what is off limits, and who to call if something breaks.

A pen test that only reruns your scanner does not meet the intent. The tester should chain findings, try to get past controls you thought were solid, and report on impact.

Evidence to collect

An auditor or customer reviewer will usually ask for the following.

  • The signed scope and rules of engagement document, with dates.
  • The tester's report, including methodology, findings with severity, and the executive summary.
  • Proof of tester qualifications, such as the firm's profile or the individuals' certifications and experience.
  • A remediation tracker that links each finding to a ticket, an owner, a fix date and a retest result.
  • The retest report or letter showing high and critical findings were verified closed.
  • The test schedule or policy that sets the frequency, so the reviewer can see this is a program and not a one off.

Keep the full report restricted. Many customers accept a summary letter or an attestation of completion, and will sign an NDA to read the full document.

Common gaps

  • Calling a scanner export a penetration test. The guidance says the test goes beyond automated scanning.
  • A report with no remediation trail. Findings that sit open for a year read worse than the findings themselves.
  • Scope that excludes the system customers care about, often the newest service or the admin console.
  • No retest. Without it you cannot show the fix worked.
  • Tester independence is unclear. The person who wrote the code should not be the only one who attacks it.
  • Testing once, then shipping a rebuilt architecture without a new test.

How to implement it

Write a short policy that states scope tiers, the minimum cadence and the retest rule. Then pick a calendar slot, because tests that depend on someone finding time rarely happen.

Before the tester starts, clean up what a scanner can find. Fixing known vulnerable dependencies first means the paid hours go to logic flaws and chained attacks. Reachability analysis helps here, because it separates vulnerable code your application actually calls from vulnerable code that sits unused in a dependency tree.

Run the engagement, triage the report within days, and ticket every finding. Retest the high and critical ones, then file the closure evidence next to the report. If your assessor wants to see how findings flow into remediation, the vulnerability management view in the demo below shows one version of that loop.

The enhancements give you a ladder to climb as you mature. CA-8.1 covers an Independent Penetration Testing Agent or Team, CA-8.2 covers Red Team Exercises, and CA-8.3 covers Facility Penetration Testing. Most small companies stop at the base control and CA-8.1, and that is a reasonable place to be.

Click through it at your own pace, or open it full screen.

Quick check

Does a clean vulnerability scan satisfy CA-8?

No. The guidance describes penetration testing as going beyond automated vulnerability scanning, performed by people with demonstrable skill. A scan can feed the test, but it does not replace it.

What shows the testing was effective and not just performed?

A remediation tracker tied to the findings, plus a retest result that confirms the serious ones were fixed.

Sources

Never miss an update

Weekly insights on software supply chain security, delivered to your inbox.

Self-healing security runs on Safeguard.

Your first fix PR is minutes away.

No sales call required, even your agent can complete the purchase over MCP.