Bernalo · case studies Get in touch →
← All case studies
QA & testing

A defect list isn't a defect analysis.

A redesign of the outstanding defects section from the UK government's official Test Completion Report template — the same document used in Case Studies #2 and #6, this time its defect log.

Same official DDTS template as Case Study #2, a different section. Illustrative example data — the template has no real project attached.

The pattern

A defect list exists to support a release decision, but a flat table of IDs and severities treats every row as equally worth attention. Whether a defect matters depends on its release impact, not just its severity label — and that judgment is exactly what the template leaves out.

Exhibit G

Section 4.2: defects outstanding

Test Completion Report (TCR) Template
Digital, Data & Technology Services (DDTS), published via Contracts Finder, UK Government.
Before
Defect idSeverityAgreed action
DEF-014LowDeferred
DEF-021MediumFix in patch
DEF-033HighWorkaround agreed
DEF-040LowDeferred
...no indication of which, if any, block release
After
0 of 6 defects are release-blocking
High — 1, workaround agreed and verified
Medium — 2, fix scheduled for next patch
Low — 3, deferred by agreement
Full defect log with IDs remains in the Test Management Tool.
PDF ↗ Read the full template

See also Exhibit A (exit criteria) and Exhibit F (UAT results) — three separate weak sections in the same official document.

What changed
  • 01

    Release impact stated directly

    "0 of 6 are release-blocking" answers the question the list was collected to answer.

  • 02

    Grouped by severity, not listed by ID

    The shape of remaining risk is visible in one glance instead of row by row.

  • 03

    Nothing lost, only reordered

    The full defect log with individual IDs stays exactly where the template already puts it — the Test Management Tool.

Why this matters

Severity isn't the same as impact

A "High" defect with a verified workaround and a "Medium" defect with no fix scheduled carry very different weight at release time. Stating that difference explicitly is the actual work of a defect analysis — a severity column alone is just a log.

Have a report like this?

Send the page. I'll show you what it could look like.

If you've got a defect log, bug triage report, or QA summary where severity data exists but release impact doesn't, I'll take one page and redesign it — no cost, no obligation — the same way as above.