To main content

Outliers in usability testing: How to treat usability problems found for only one test participant?

Abstract

In usability testing, usability problems are often found for only one test participant. The literature does not help in deciding whether such single-user problems should be accepted or rejected as usability problems. To help us understand how such decisions are made in practical usability testing, 89 practitioners described how they dealt with single-user problems in their latest usability test. Single-user problems was accepted, rejected, or reported as outliers. This decision depended on problem severity, participant profile, sample size, and judgments on whether the problem is an artifact of the test situation.

Category

Academic chapter/article/Conference paper

Client

  • EU / COST IOC904
  • Research Council of Norway (RCN) / 193018

Language

English

Author(s)

Affiliation

  • SINTEF Digital / Sustainable Communication Technologies
  • University of Leicester
  • University of Copenhagen

Year

2012

Publisher

ACM Publications

Book

NordiCHI '12: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

ISBN

978-1-4503-1482-4

Page(s)

257 - 260

View this publication at Cristin