Safeguard
Industry Analysis•

Should teams be ranked on a security leaderboard?

A security leaderboard that ranks teams by vulnerability counts tends to hide problems instead of fixing them. Here is what to show in its place.

Safeguard Security Team
4 min read

Usually not. A public ranking of teams by findings or fix speed pushes people to hide, reclassify, or avoid scanning instead of reducing risk, and it compares teams with very different systems. Show each team its own trend over time, and let leaders look at the whole picture privately.

What goes wrong with rankings

Ranking works in a sport because every team plays the same game under the same rules. Engineering teams do not. A payments service with ten years of history and a new internal tool will never produce the same number of findings, even with equal discipline.

DORA's guidance on delivery metrics lists several pitfalls that map directly onto a security leaderboard. It warns against competing: the goal is to improve your own team over time, not to beat other teams. It warns against disparate comparisons, because a mobile app and a mainframe system should not be put on one scale. And it warns against siloed ownership, since isolating teams with specific metrics can lead to friction and finger pointing.

Add the general effect described by Goodhart's law, and the leaderboard becomes a prize for whoever games the number best.

Common ways a leaderboard gets gamed

  • Teams stop onboarding new repositories, because a new scan adds findings and drops them down the table.
  • Severity gets argued down, one ticket at a time.
  • Findings move into an accepted risk status so they no longer count.
  • The easiest team to score well is the one with the smallest, newest codebase, which says nothing about care.

The cost is not only bad data. A team that learns that honest scanning makes it look worse will scan less. You lose coverage, which is the thing you needed most.

What to show instead

Instead ofUseReason
Team rank by open findingsEach team's own trend lineCompares like with like
Single score per teamTwo or three paired metricsHarder to game, richer picture
Public shaming listPrivate review with each team leadKeeps focus on help, not blame
Findings per teamExposure window for exploited or reachable issuesTracks risk, not volume

If leaders want to know where to send help, give them a view that lists the oldest unresolved high risk items by service, with the owner and the blocker. That is a work queue, not a leaderboard.

If you already have a leaderboard

  1. Stop publishing the rank. Keep the data.
  2. Replace it with a trend per team and a short note on what changed.
  3. Add the counter metrics next to it: exceptions, severity changes, and scan coverage.
  4. Tell teams in plain words that the change is to protect honest reporting.
  5. Check coverage a month later. It should rise, not fall.

Try it yourself

Click through it at your own pace, or open it full screen.

Watch how findings change over time for one project, and notice how much more useful a trend is than a rank.

Safeguard's continuous monitoring and policy features can track findings per project over time, which suits a per-team trend view. A free scan is available at https://gold.safeguard.sh/scan.

Quick check

Can a leaderboard motivate teams in a healthy way?

It can for a short, well framed campaign, but it rarely lasts. Comparisons across unlike systems feel unfair, and people respond by optimizing the score.

How do we find the teams that need help without ranking?

List the oldest high risk items with owners and blockers, and talk to the leads privately. Offer time and tooling rather than a place on a table.

Sources

Last reviewed: 19 October 2026.

Never miss an update

Weekly insights on software supply chain security, delivered to your inbox.

Self-healing security runs on Safeguard.

Your first fix PR is minutes away.

No sales call required, even your agent can complete the purchase over MCP.