Tutorials

This tutorial provides attendees with an understanding of usability evaluation methods. It surveys the more popular methods used today, demonstrates the techniques, identifies appropriate usages, and drives home an understanding of the pros and cons of each approach. Attendees will be able to try out and compare techniques with mentoring.

PARTICIPANT KNOWLEDGE AND EXPERIENCE EXPECTED

This tutorial is geared for people who are new to the area of usability engineering and for usability engineers who have not yet explored the wide range of usability evaluation methods other than usability testing.

GOALS FOR THE SESSION:

UPA has a constant influx of people of varied backgrounds transitioning into/or relatively new to usability engineering. The session goal is to survey a range of usability methods, in a condensed one-day session, reinforcing the strengths, weaknesses, and appropriate applications of each. Participants will learn more about the methods through the class participation exercises where each participant will have an opportunity to sample one or more of the methods, compare the data, and determine the product direction that is derived from each. Participants will “take away” a strong understanding of “how to” as well as “when to” apply these methods and “how to” effectively apply the results to their work.

HOW THIS TUTORIAL WILL BE CONDUCTED

The lecture will be handled primarily with presentation slides and paper hand-outs.

Participants will be divided into 3 groups and each group will perform a different category of evaluations on the same application. This hands-on exercise will be complemented by live mentoring during the evaluation sessions. Groups will come together to discuss their findings. This will lead into a discussion and comparison of the various types of problems identified by each method category as well as the strengths and weaknesses of each.

TUTORIAL SCHEDULE WITH TIME ALLOCATION

DETAILED DESCRIPTION OF TUTORIAL

Outline/sequence of events

Part I. Introductions and overview

(45 minutes)

• Background of presenters
• Round the room (who you are, why you chose this class, what you want to walk away with)
• Review the day's outline
• Usability evaluation defined
• Overview of 3 categories of evaluations
• Category I: Evaluations without users
• Category II: Evaluations with users
• Category III: Evaluations based on actual usage

Part II. Detailed Lecture on Evaluations Without Users

(45 minutes + 15 minute demonstration)

Category I: Evaluations without users

• Standards review

• Accessibility review

• Heuristic evaluation

• Cognitive Walkthroughs

Part III. Detailed Lecture on Evaluations With Users

(45 minutes + 15 minute demonstration)

Category II: Evaluations with users

• Usability testing

• Design reviews

• Design walkthroughs

• Co-discovery

Part IV. Detailed Lecture on Evaluations based on Actual Usage

(45 minutes + 15 minute demonstration)

Category III: Evaluations based on actual usage

• Click analysis

• Page or window count analysis

• Interviews

• Monitoring help-line calls

• Monitoring bulletin boards

• Surveys of users

Part V. Small Group Evaluations

(90 minutes)

• The class will be divided into groups.
• Each group will be guided to conduct one type of usability evaluation on the same application
• Groups will compile their results.
• Results will be presented.

Part VI. Concluding Session

(30 minutes)

The instructors will connect the power of the data to the strengths and weaknesses of each technique.

SPEAKER BIO

Dave Mitropoulos-Rundus

Senior Usability Architect
Compuware Corporation

Dave Mitropoulos-Rundus is responsible for driving usability improvement, user interface standardization, and 508 accessibility compliance across Compuware's products. He has held usability management, consulting, and sales positions in product development and in the external consulting organization at Compuware. Prior to joining Compuware, Dave was a human factors engineer for Eastman Kodak. Dave has designed user interfaces for hand-helds and kiosks and web sites and production machines, and has conducted evaluations in the lab, on the web, in the field, and in the homes of consumers. Dave is a frequent conference presenter and user interface design instructor, and he is a chapter author of the book, “Design by People for People.”

Dave has a Masters degree in Human Factors Psychology from Rensselaer Polytechnic Institute. Dave is an active member of ACM SIG-CHI, HFES, and UPA, and is president of the Southeast Michigan UPA Chapter.