UPA Home
     
     
   
   
   
   
   
   
   
   
     
 

Tutorial #19: Conducting a Hands-on Usability Study: A Participative Tutorial

Tuesday, July 9th, 8:30 AM - 5:00 PM

Keywords:

Professional development, Usability (lab) testing, Cost-justifying usability

Audience:

Beginner, Intermediate

Abstract:

This tutorial, a repeat performance from the 2000 and 2001 UPA Conferences, offers participants tips and techniques on conducting a usability test from planning to reporting. The tutorial includes multiple breakout sessions where participants draft the test plan, conduct the test, and discuss ways to share their results and adapt these strategies into their own organizations. Overall, participants will gain the skills and confidence required to improve their companies' products and bottom lines.

Length of Tutorial:

Full Day

System, Product, or Project Focus:

No specific system, product, or project orientation

Learning objectives:

By attending this session, new participants will gain the hands-on experience necessary to conduct a full-scale usability test. The tutorial includes multiple breakout sessions with participants drafting the test plan, conducting the test, and discussing ways to adapt these strategies into their own organizations. Once the usability study is completed, the group will discuss successes and areas for improvement. The key will be sharing as many tips and techniques from as many different perspectives as possible.

Detailed Description Of Material Covered By Tutorial And A Schedule Of Events With Time Allocation

This tutorial was offered at the 2000 and 2001 UPA conferences and was very well-received by attendees. By attending the 2002 session, new participants will also gain the hands-on experience necessary to conduct a full-scale usability test. The tutorial includes multiple breakout sessions with participants drafting the test plan, conducting the test, and discussing ways to adapt these strategies into their own organizations.

We will use brainstorming and lecturing techniques to share tips for convincing management to spend the time and the money to conduct a low-cost, formal usability test. We will also show data on reducing product costs by eliminating potential showstoppers during the development cycle and reveal how the bottom line will improve as a result.

This tutorial will benefit organizations wanting to undertake full-scale, low-cost formal usability testing on their hardware, software, or web-based products. Additionally, organizations wanting to validate their testing methodology will learn tips and techniques to create the initial design, setup, implementation, and follow-up of full-scale usability testing. Overall, participants will gain the skills and confidence required to improve their companies' products and bottom lines. We know that there are articles and some books available that describe the usability testing techniques we will discuss. There will also be other sessions that will talk in more depth about a number of components of this tutorial. But it is a very rare opportunity that users have the chance to learn by walking through a complete usability test from conception to completion, with the opportunity to shape the nature of that study throughout. This tutorial will invite users to discuss and relate their own experiences each step of the way. Attendees will leave the tutorial at the end of the day with a rich experience and some very concrete ideas about what to do when they return to their organizations to:
  • Convince management to allow them to integrate usability testing into product design
  • Be able to plan and conduct an effective usability study
  • Design and present the user findings to the product team in a way that has impact and will ensure required improvements are made.

Schedule:

  • 9:00 - 10:30 · Tutorial leaders introduce overall topic· Participants introduce themselves· Brainstorming/ice breaking exercise· PowerPoint introduction to Usability Case Study: Lecture/discussion on types of usability studies, costs, schedules, benefits of different approaches.
  • 10:30 - 10:45 - Break
  • 10:45 - 12:00 · Lecture/discussion: intro to the Usability Plan, necessary components, process.· Tutorial with 4 subgroups of participants. Each subgroup will design one section of the usability plan.
  • 12:00 - 12:30 · Reports from each subgroup to the entire group
  • 12:30 - 1:30 - Lunch
  • 1:30 - 2:30 · Lecture/discussion on Usability Testing Protocol: how to do what they're about to do; how to screen subjects, introduce test, record findings, debrief etc.· Second set of subgroups is formed to turn plan into reality. Roles are assigned for conducting the usability test, and like roles are grouped together to form subgroups.
  • 2:30 - 3:30 · Group conducts the usability test
  • 3:30 - 3:45 - Break
  • 3:45 - 4:30 · Group wrap-up/post mortem discussion on what usability techniques worked and what we could improve upon the next time. Includes discussion on how these techniques can be adapted into participants' own organizations.· Lecture/discussion of best ways of presenting usability findings (reports, presentations, videotape, shared testing experience, executive reports)
  • 4:30 - 5:00 · Combined presentation and discussion on how to convince management to integrate usability into the product development lifecycle.

Description Of Materials (Handouts)

Attendees will receive a workbook containing the presentation as well as sample materials for usability testing including a sample project plan, task questionnaires and other testing materials.

Maximum number of participants

50-75

Speaker Biographies:

Diana Wiffen
Quarry Integrated Communications
Phone: 888-743-4300 x2285
Fax: 519-743-3053
Email: dwiffen@quarry.com

As a senior member of the Quarry Interaction Design Group, Diana is a key player in Quarry's comprehensive usability and customer experience team. Using her extensive usability, interface design, and web assessment experience, Diana has worked on projects for clients such as FedEx, Sprint, MKS, HP and Clarica. Most recently, Diana was a core member of the team that worked with FedEx to design and develop interaction design standards that ensure a common look and feel and consistent customer experience across all their online shipping applications. Diana also brings her expertise to the following organizations as a:
Member of the Southwestern Ontario chapter of the STC
Member of the STC Usability SIG
Member of the UPA

Tobi Day-Hamilton
Quarry Integrated Communications
Phone: 888-743-4300 x2294
Fax: 519-743-3053
Email:tday-hamilton@quarry.com

As a senior member of Quarry's Interaction Design Group, Tobi is a key player in Quarry's comprehensive usability and customer experience team. Using her extensive usability and web assessment experience, Tobi has worked on projects for clients including FedEx, Philips, MKS, HP and Clarica. Tobi was part of the team that helped FedEx assess the ease-of-use of its corporate website and assisted them in refining the design of their web applications. As well, Tobi has been working with FedEx to integrate their brand with their digital applications through brand experience assessments.
Tobi also brings her expertise to the following organizations:
  • Member of the Southwestern Ontario chapter of the STC
  • Member of the STC Usability SIG
  • Member of the UPA
  • Member of the Toronto chapter of CHI

Quarry Integrated Communications is an award-winning integrated communications agency headquartered in Southwestern Ontario, with satellite offices in Dallas, TX and Memphis, TN. Quarry's Interaction Design Group works with international clients to develop strategies and implement tactics for improving the usability and customer experience of interactive products. Quarry designs and performs usability studies on low-, mid- and high-fidelity prototypes, both on-site and in their Brand Experience Lab.