Skip to content
Lesson 10 of 10intermediate9 min read

Usability Testing

Usability testing is watching representative people attempt real tasks with a design, in order to find the problems the team can no longer see.

01

Definition

Usability testing is a method in which people who resemble the intended users attempt defined tasks with a design while an observer watches and, usually, asks them to think aloud. It is evaluative rather than exploratory: the design already exists in some form, and the question is whether it works. The facilitator gives a task and a realistic scenario, then stays quiet, resisting the strong urge to help. What is recorded is behavior — where people hesitate, what they click, what they misread, where they give up — alongside their commentary. The output is a prioritized list of problems, not a verdict or a score.

02

Why It Exists

Testing exists because designers and engineers cannot un-know their own product. Having built the structure, they can no longer perceive an ambiguous label or an unexpected sequence, because they already know the answer. This is not a matter of skill; expertise reliably removes the ability to simulate a newcomer. Testing exists too because internal disagreement is otherwise unresolvable: arguments about whether a flow is confusing can continue indefinitely until three people in a row fail at the same step, at which point the argument ends. And it exists because fixing a discovered problem before release is dramatically cheaper than supporting it forever afterward.

03

Examples

  • Five people attempting to change a delivery address in a checkout, with the facilitator recording where each hesitates.
  • A test on paper before any code exists, checking whether the sequence of questions makes sense.
  • A remote unmoderated study where participants record themselves completing tasks, useful for scale but weak on why.
  • A test with participants using screen readers or switch access, which routinely finds failures sighted testing misses.
04

History

Testing method comes from experimental psychology and human factors, where measuring operator performance on defined tasks was standard practice. The think-aloud protocol used in usability work derives from protocol analysis in cognitive psychology, notably the methods described by K. Anders Ericsson and Herbert Simon. Jakob Nielsen argued that small samples find most problems and that frequent cheap tests beat rare expensive ones, a position that made testing practical for ordinary teams. Steve Krug's Don't Make Me Think and Rocket Surgery Made Easy pushed further, advocating regular sessions with a few participants, run by the team itself, with fixes applied immediately rather than compiled into reports.

05

In Modern Design

Remote testing platforms have made recruitment fast and geography irrelevant, and unmoderated studies allow larger samples at low cost. The trade-off is context and depth: you see a screen and hear a commentary, but you do not see the room, the interruption, or the document the person needed and could not find. Analytics, session replay and experiments have partly displaced small-sample testing in organizations that prefer numbers, though these answer different questions — what and how often, rather than why. Consent, recording and privacy obligations have grown, and accessibility testing with people who use assistive technology is increasingly treated as a required part of the practice, not an add-on.

06

Real-World Example

Steve Krug's central argument is that testing does not need to be an event. A team can test three people on a Thursday morning, watch together, agree on the single most serious problem before lunch, and fix it the same week. The value is not statistical; five participants will not tell you what proportion of users struggle. What they will tell you, reliably, is that a label is ambiguous or a step is missed, because the same failure appears in the second and third session. The common failure mode is the opposite pattern: a large formal study, a long report circulated weeks later, and no change to the product.

07

Key Principles

  • Test tasks, not opinions — ask people to do something, never whether they like it.
  • Recruit people who resemble real users, including those who struggle with technology.
  • Stay quiet; the instinct to help destroys the finding you came for.
  • Small samples find problems; they cannot measure how widespread a problem is.
  • Watch what people do and weigh it above what they say about what they would do.
  • Test early and often with fixes applied between rounds; a report nobody acts on is wasted effort.

Why it matters

Usability testing is the discipline's cheapest reality check and the fastest route to changing a team's mind. Watching one person fail at a step you designed is more persuasive than any amount of argument, which is why sessions should be observed by engineers and decision-makers rather than summarized to them. It also matters for equity: unless people with low confidence, older participants, and users of assistive technology are in the sample, their failures remain invisible and the product is optimized for the people who were already fine. Testing does not tell you what to build, but it reliably tells you what is broken, which is more than most methods deliver.

Then vs Now

Then

Testing was a formal laboratory exercise with recruited participants, one-way mirrors, recorded performance measures and a written report.

Now

Teams run frequent small moderated sessions and cheap remote studies, observe together, fix between rounds, and increasingly test with assistive technology users as standard.

Try it yourself

Recruit three people who have never used a product you know well. Write two realistic tasks, phrased as goals rather than instructions — find out whether this service covers your postcode, rather than click the coverage checker. Sit beside each person, ask them to think aloud, and say almost nothing beyond what are you thinking now. Record where each hesitated, what they misread, and where they gave up. Afterward list every problem you saw, mark those that appeared for more than one person, pick the single worst, and write the smallest fix. Then, if you can, make it.

Test yourself

5 questions, one at a time

Answers are revealed at the end, so you can think without being nudged.

Sources

  • Don't Make Me Think, Revisited: A Common Sense Approach to Web Usability — Steve Krug (2014) · Book
  • Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems — Steve Krug (2009) · Book
  • Usability testing methods and guidance · Institution