IS214, Spring, 2004

TuTh 2-3:30 110 South Hall
Instructor: Nancy Van House
Office: 307A South Hall. Office hours: TBA

This page last revised 4/30/04; added links from accessibility speakers

Required readings are in reader; recommended generally are not.
‡ indicates readings not in reader but available on the web.
† indicates readings available on the web from campus ISP addresses, usually sources to which the campus library has electronic subscription, though most are also in the reader.
** indicates required readings NOT in reader.

Dates and topics subject to change. Will be adjusted based on how we progress.

•Reader at CopyCentral on Bancroft.

•JoAnn T. Hackos and Janice C.Redish. User and Task Analysis for Interface Design, New York: Wiley, c1998. $60 (referred to as H&R)

•Rubin, Jeffrey, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. Wiley, 1994 (Rubin)

NOT in local bookstores. We used both of these last year, so you may be able to find used copies.

Resources on writing.
+++++ Usability resources

Week & Date Topic Readings Notes/
Added Resources/
Recommended reading
(Generally not in reader)
1 Jan 20 & 22   Intro and overview: foundations of needs assessment, user-centered design, and usability Usability basics from

Vredenburg, K., Isensee, S., & Righi, C. (2002). User-centered design: an integrated approach. Upper Saddle River, NJ: Prentice Hall. ch 1, Taking Stock, Ch. 2, The Integrated Approach.

Preece, J., Rogers, Y., & Paine, L. (2002). Interaction design: beyond human-computer interaction. New York: J. Wiley & Sons. ch. 1: What is interaction design?

Look at interactive methods table from UsabilityNet ‡

Case study: †Marchionini, G. (2003). Digital government information services: the Bureau of Labor statistics case. interactions, 10, 18-27.
Monk, A. F. (2003). Fun, communication and dependability: extending the concept of usability. Closing Plenary at HCI2002‡

Nielsen's Usability 101


 assn 1
handed out
    The phases of design and usability IBM Ease of Use: User Engineering; Review the entire User Engineering part of this site. (not in reader)‡

Needs Assessment
J27 & 29
  competitor analysis Competitor analysis from
Competitor analysis from IBM
Bunnyfoot - Competitor analysis: an alternative approach.‡
   assn 1 due Tues 27th

Field studies

video postponed - date TBA

**JoAnn T. Hackos and Janice C.Redish. User and Task Analysis for Interface Design, New York: Wiley, c1998. $60 (H&R)
ch 1, Intro to User and Task Analysis for Interface Design:
ch 2, Thinking about Users.
ch 3, Thinking about Tasks.
ch 4, Thinking about the Users' Environment
recommended: ch 5. Making the Business Case for Site Visits

**Rubin, Jeffrey, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. Wiley, 1994; ch 6, Selecting and acquiring participants. (This applies to all kinds of participants in usability studies.)

Brun-Cottan Francoise & Wall, P. (1995). Using video to re-present the user. Communications of the ACM, 38, 61-71.†
Field Studies: The Best Tool to Discover User Needs
By Jared M. Spool

Field studies done right by Jakob Nielsen

Sample user/task matrices

Video highlights from a usability test from Classic Systems Solutions and from Bolt & Peters, and from user interviews by Sachs Insights.

Slides from a Bay/CHI talk by John Pinto on using video in usability

Video training (tentative)
Feb 3 & 5
  Ethics of working with users UC Berkeley Committee for the Protection of Human Subjects

Ethical Principles of Psychologists and Code of Conduct 2002; see especially sections on Privacy and Confidentiality.‡

STC usability SIG on ethics

Association for Computing Machinery (ACM) Code of Ethics and Professional Conduct

**Rubin Appendix: Human factors and ergonomics society code of ethics

Oliver K. Burmeister, "Usability Testing: Revisiting Informed Consent procedures for testing Internet sites", Australian Institute of Computer Ethics Conference, 11/12/2000.

American Anthropological Assn
informed consent

Ethics for usability testing (short)

Final Projects: submit a short (paragraph or so) report on what you will do and who your team is
    Ethnographic methods Blomberg, Jeanette, & others, "Ethnographic Field Methods and their Relation to Design." Douglas Schuler and Aki Namioka, eds. Participatory Design: Principles and Practices. Hillsdale, NJ: Lawrence Erlbaum Associates, 1993; p. 123-155. Read pp. 123-147; the rest is recommended.

Blomberg, Jeanette L. "Ethnography: aligning field studies of work and system design." in Monk, Andrew F., and G. Nigel Gilbert, eds., Perspectives on HCI: Diverse Approaches. ch 8, p. 173-197. Academic Press, 1995. Read sections 8.1-8.25; the rest is recommended.

David R. Millen. Rapid ethnography: time deepening strategies for HCI field research. Conference proceedings on Designing interactive systems : processes, practices, methods, and techniques: processes, practices, methods, and techniques. ACM, 2000.
Contextual Inquiry and Design
is a structured approach to ethnography for system design.
Very brief overview:
The key book on Contextual inquiry: H. Beyer and K. Holtzblatt. Contextual Design: Defining Customer-Centered Systems, 1998, Morgan Kaufmann Publishers.
F10 & 12
  Tu: reporting on projects

Th: survey pretest

  Assn 2 due Feb 12

Interview exercise
(assn 3)
Feb 17
  configuring users; interviewing **Grint, K. & Woolgar, S. (1997a). Configuring the user: inventing new technologies. In Grint & Woolgar, The machine at work: technology, work, and organization (pp. 65-94). Cambridge, UK: Polity Press

**H&R ch. 7-10 .
 slides from last year on interviewing  
Feb 19
  Interviewing (cont) Both handed out in class:

Michael Quinn Patton, Qualitative Research & Evaluation Methods (Thousand Oaks, Sage Publications 2001), “Qualitative Interviewing,” pp. 339-383

Richard Krueger, Developing Questions for Focus Groups (Thousand Oaks: Sage Publications 1997) “The Art and Mechanics of Asking Good Questions” pp 21-60.


Feb 24

  Focus groups David L. Morgan, Focus Groups as Qualitative Research, Sage, 1988; pp. 53-71, Conducting and Analyzing Focus Groups.

Krueger, Richard A., Focus Groups, 2nd ed. Sage, 1994; "Asking questions in a focus group." pp. 53-69
Resources on focus groups from STC Usability SIG

Set of articles on focus groups

Online focus groups: pro and con
 focus group exercise
Feb 26
  Guest speaker
Cathy Marshall, Microsoft
On using ethnographic methods -- readings have been emailed to class.   Assn 3
7a & 7b
Mar 2 & 4
  Scenarios and personas:"Useful to summarize and communicate qualitative findings. What is a scenario? from Information & Design.

Rosson & Carroll, Usability Engineering, ch. 1 - some of this is review, but pay attention to how they define scenarios.

Cooper, A. (1999). The inmates are running the asylum. Indianapolis: Sams. ch 11: Designing for people.

Pruitt, John and Grudin, Jonathan. Personas: Practice and Theory. 2002.
Personas: articles from Cooper Interaction Design: Kim Goodwin, Perfecting Your Personas;
Elan Freydenson, Bringing Your Personas to Life in Real Life

STC Usability SIG on personas and scenarios

Usability Assessment
Mar 9
Standards and guidelines
Mack & Nielsen, "Executive Summary," and Nielsen, Jakob, "Heuristic Evaluation," in Nielsen and Mack, Usability Inspection Methods, Wiley and Sons, 1994: chs 1 &r 2

Nielsen's 10 Usability Heuristics

Instone on Site Usability Evaluation and Site Usability Heuristics for the Web

First principles, AskTog

‡Standards and guidelines - a set of links from STC. Excellent source.

‡International standards for HCI and usability
Sample heuristics report from Barnum

Sample checklist
from InfoDesign

Sample test materials
from STC usability SIG: scroll down to Usability Checklists and Heuristic Reviews; include process for heuristics review and sample checklists 1 & 2

Heuristic Evaluation - A System Checklist
By Deniese Pierotti, Xerox Corporation

Research-based guidelines from (128 pp.). Doesn't print well - try this version instead.

Ass 4:


8b   Guest Speaker Maggie Law, MIMS grad; Interaction Designer, Peoplesoft   her slides

9a & b

Mar 16 & 18

  Usability metrics Babbie, Earl R. (2001) The Practice of Social Research, 9th ed., Wadsworth. Chapter 5: Conceptualization, operationalization, and measurement (or equivalent chapter from another social research methods text).

Robert Opaluch, "Usability Metrics". In Ratner, Julie, ed. Human Factors and Web Development, 2nd ed. Lawrence Erlbaum, 2003. p. 101-144.
   Assn 4
due Thurs 18th
  Usability testing **Rubin, Jeffrey. Handbook of Usability Testing (not in reader)
ch. 2, Overview of usability testing
ch. 5, Developing the Test Plan
ch. 7, Preparing the Test Materials
ch. 8, Conducting the Test
The rest of the book is recommended.

Dumas, Joseph S. and Janice C. Redish. A Practical Guide to Usability Testing:
ch. 11, Selecting and Organizing Tasks to Test
ch. 13, Deciding How to Measure Usability
Carol Barnum, Usability Testing and Research.
not as thorough as Rubin but covers more ground concerning usability in general.

Good summary based on Rubin

Common Industry Format for Usability Test Reports

Sample reports: DailogDesign; from Barnum

Sample test materials from STC usability SIG

usability labs from STC usability SIG
Usability test assignment


Remote testing

Remote Online Usability Testing: Why, How, and When to Use It by Dabney Gough and Holly Phillips

IBM, Experience remote usability testing, Part 1 part 2
Tullis, T., Fleischman, S., McNulty, M., & Bergel, M. An Empirical Comparison of Lab and Remote Usability Testing of Web Sites. (in reader)  
SPRING BREAK March 23 & 25
Mar 30
PROJECT REPORTS - update on all projects  
Apr 1

Peter Merholz,  
11 & 12a
Apr 6, 8

Survey data analysis
Dillman, Don A. (2000) Mail and Internet Surveys: the Tailored Design Method, 2nd ed. Wiley. chs. 2-3; 5. The rest of the book is recommended.

Web-based surveys:
Dillman, Don, and Dennis K. Bokwer. The web questionnaire challenge to survey methodologists.

Excellent collection of web survey resources collected by Rashmi Sinha

good Q&A on user surveys in usability

Survey resources from
slides 4/6
 12b & 13a
Apr 15 & 20
(dates may change)
  Universal usability: including accessibility, seniors and children, international usabiity W3C Quick tips

Theofanos Mary Frances & Redish Janice (2003). Bridging the gap: between accessibility and usability. interactions, 10, 36-51.

Ratner, Julie, ed. Human Factors and Web Development, 2nd ed. Lawrence Erlbaum, 2003:
1-Andrew Sears, "Universal Usability and the WWW." In p. 21-45.
2-Masaaki Kurosu, "A Cultural Comparison of Website Design from a Usability Engineering Perspective."

Nielsen, J. (2000). Designing Web usability. Indianapolis: New Riders. ch 6: Accessibility for users with disabilities. ch. 7: international usability.

W3C web accessibility initativeW3C Web Content Accessibility Guidelines 1.0 (not in reader)

Jacob Neilsen, International Web Usability Testing; Offshore Usability

Evers, Vanessa. Cross-cultural applicability of user evaluation methods: a case study amongst Japanese, North-American, English and Dutch users, CHI '02
Speakers April 20:
Ward Newmeyer, until recently campus compliance officer for the Americans With Disabilities Act, UC Berkeley

Adam Tanners, web designer, Disabled Students Program, UCB

Design/usability for children

Usability for young and old: STC Usability SIG

Section 508 standards

Resources on accessible web design including LOTS about color/color blindness

Bobby for testing sites

Good links on accessibility from

Alliance for technology access, How to design accessible sites

Interactions special issue on universal usability: †Winds of change: SPECIAL ISSUE: HCI in the developing world. interactions 10[2]. 2003.



Accessibility software (free trial versions available):
Screen-readers: Jaws and Window-Eyes
Screen magnifier: ZoomText

Resources for Web Accessibility
Apr 22
  Writing usability reports ‡Common Industry Format for Usability Test Reports

‡AskTog, 2001: How to Deliver a Report Without Getting Lynched
Sample reports  

Apr 27
  Managing Usability in Organizations Selections from Bias & Mayhew, Cost-Justifying Usability (distributed in class)  
Apr 29

(readings were originally scheduled for April 1, so that's where they are in reader -- between surveys and report writing)
Web credibility ‡Evaluating Web Pages, UC Berkeley Library (not in reader)

Web Credbility Guidelines, Stanford Web Credbility Project

Fogg, B. J. & and others (2001). What makes web sites credible? A report on a large quantitative study. In CHI 2001 (pp. 61-68). New York: ACM.

Fogg, B. J., Soohoo, C., Danielsen, D., Marable, L., Stanford, J., & Tauber, E. R. (2002). How Do People Evaluate a Web Site's Credibility? Results from a Large Study

Stanford, J., Tauber, E. R., Fogg, B. J., & Marable, L. (2002). Experts vs. Online Consumers: A Comparative Credibility Study of Health and Finance Web Sites New York: Consumer Web Watch.

Recommended: Constantinides, H. & Swenson, J. (2000). Credibility and medical web sites: a literature review. Comprehensive; applicable to many domains.
May 4   Project presentations

Nadine and Myra

May 6   Project presentations

Jesse and Vijay


[Links on these pages to commercial sites do not represent endorsement by the Univerity of California or its affiliates.] <--But, on the other hand, why would we put them here unless we thought they were useful? -- Thanks to Yale Braunstein.