The Usability of Computerized Card Sorting: A Comparison of Three Applications by Researchers and End Users
Barbara S. Chaparro, Veronica D. Hinkle, and Shannon K. Riley
Journal of Usability Studies, Volume 4, Issue 1, November 2008, pp. 31-48
Abstract
This study reports on the usability of three commercially available electronic card sort applications (CardZort, WebSort, and OpenSort) by researchers (Study 1) and by end users (Study 2). Both groups of participants conducted a series of tasks representative of their user group with each program. Researchers focused on the set up and analysis of an open card sort exercise while end user participants conducted an open card sort. Task success, completion time, perceived difficulty, user satisfaction, and overall preference data was gathered for all participants. Results indicate different preferences for the two user groups. Researcher participants preferred WebSort for creating and analyzing the card sort, and end user participants preferred OpenSort for completing the card sort exercise. Usability issues related to each program are discussed.
Practitioner's Take Away
- It is important to test the usability of electronic card sorting programs with both end users and researchers. They have different needs and opinions as to which program is best. End users prefer the dynamic nature and ease of use of OpenSort while researchers prefer the easy set up and result analysis of WebSort.
- The most important functions to researchers are being able to quickly (a) import lists of items from other applications (i.e., word processor) for study set up and (b) import user data for analysis.
- The most important functions to end users are (a) intuitive drag-and-drop of the cards, (b) simultaneous group naming, and (c) being able to see all cards and groups at once.
- This study was limited to a simple card sort for end users and to a basic set up and analysis for the researcher. The results may vary when more complicated sorts and analyses are attempted.
- Practitioners need to consider the test environment when deciding which program to use. Ease of use for end users, for example, may be more critical when testing remotely.
- There are other electronic card sort tools available that were not included in this study. More evaluations like this are needed!
Article Contents
- Introduction
- Methods - Study 1
- Results - Study 1
- Discussion - Study 1
- Methods - Study 2
- Results - Study 2
- Discussion - Study 2
- Conclusion
- References
Download Article