Safeguard
Supply Chain•

How do I test how fast a vendor flags new threats before I buy?

Reports score research claims on paper. Run a timed trial test: pick live advisories and measure how long each tool takes to flag them in your projects.

Safeguard Security Team
3 min read

Test it with a stopwatch. During the trial, pick advisories that appear while you are evaluating, note the time each is public, and record when each tool flags it in your projects. Analyst research cannot measure that on your estate, and speed to alert is easy to compare.

Why this is hard to learn from a report

A report can note that a vendor has a research team or a feed. It cannot say how quickly that feed reaches a customer's project, or whether the alert is tied to the right component in your build. Those depend on your inventory and the vendor's matching logic.

Set up a fair test

  1. Same inventory. Give every tool the same repositories.
  2. A watch list. Subscribe to public sources. CISA's Known Exploited Vulnerabilities catalog is one, and it tells organizations to use it as an input to prioritization.
  3. A log. For each new advisory affecting a package you use, write down when it was published and when each tool alerted.
  4. A relevance check. For each alert, note whether the tool linked it to the right project and version.
  5. A noise check. Note alerts that were wrong or irrelevant.

What to measure

  • Time to flag. Minutes or hours between public disclosure and an alert in your account.
  • Accuracy of match. Did it name the right package and version range?
  • Prioritization. Did it show whether the issue is known to be exploited, or whether your code reaches the component? EPSS is a public signal that estimates the probability a CVE will be exploited in the next 30 days, so ask which signals the tool shows.
  • Actionability. Did the alert include a fix version or next step?

Cover the quiet period

Advisories for your stack may not appear during a two week trial. If so, add a retrospective test. Take three recent advisories you know about, and ask each vendor to show when and how they would have flagged them. Treat the answers as claims, then verify against dated public records.

Zero-day claims

Some vendors say they find issues before public disclosure. Ask for specific examples with dates, and check them against public records. Do not accept a count of discoveries as proof. Ask how a discovery reaches your account and how fast.

Try it yourself

Open the demo and watch how a new threat appears and what the view shows you first. Think about which fields you would compare across tools.

Click through it at your own pace, or open it full screen.

Safeguard offers zero-day discovery, SBOM and dependency scanning and reachability analysis, and the free scan at gold.safeguard.sh/scan can be pointed at your own repository.

Quick check

How long should I watch for new advisories?

Two to four weeks usually catches several. Add a retrospective test if the window is quiet.

Is faster always better?

Fast is only good if the alert is accurate and relevant. Count wrong alerts too.

Sources

Last reviewed: 19 October 2026.

Never miss an update

Weekly insights on software supply chain security, delivered to your inbox.

Self-healing security runs on Safeguard.

Your first fix PR is minutes away.

No sales call required, even your agent can complete the purchase over MCP.