IS214, Spring, 2004

TuTh 2-3:30 110 South Hall
Instructor: Nancy Van House
vanhouse@sims.berkeley.edu
Office: 307A South Hall. Office hours: TBA

This page last revised 4/30/04; added links from accessibility speakers

 
Required readings are in reader; recommended generally are not.
‡ indicates readings not in reader but available on the web.
† indicates readings available on the web from campus ISP addresses, usually sources to which the campus library has electronic subscription, though most are also in the reader.
** indicates required readings NOT in reader.

Dates and topics subject to change. Will be adjusted based on how we progress.

TEXTS:
•Reader at CopyCentral on Bancroft.

•JoAnn T. Hackos and Janice C.Redish. User and Task Analysis for Interface Design, New York: Wiley, c1998. $60 (referred to as H&R)

•Rubin, Jeffrey, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. Wiley, 1994 (Rubin)

NOT in local bookstores. We used both of these last year, so you may be able to find used copies.


Resources on writing.
+++++ Usability resources

Week & Date Topic Readings Notes/
Added Resources/
Recommended reading
(Generally not in reader)
Assns
1 Jan 20 & 22   Intro and overview: foundations of needs assessment, user-centered design, and usability Usability basics from usability.gov

Vredenburg, K., Isensee, S., & Righi, C. (2002). User-centered design: an integrated approach. Upper Saddle River, NJ: Prentice Hall. ch 1, Taking Stock, Ch. 2, The Integrated Approach.

Preece, J., Rogers, Y., & Paine, L. (2002). Interaction design: beyond human-computer interaction. New York: J. Wiley & Sons. ch. 1: What is interaction design?

Look at interactive methods table from UsabilityNet ‡

Case study: †Marchionini, G. (2003). Digital government information services: the Bureau of Labor statistics case. interactions, 10, 18-27.
Recommended:
Monk, A. F. (2003). Fun, communication and dependability: extending the concept of usability. Closing Plenary at HCI2002‡

Nielsen's Usability 101

 

 assn 1
handed out
             
    The phases of design and usability IBM Ease of Use: User Engineering; Review the entire User Engineering part of this site. (not in reader)‡

 
             
Needs Assessment
2
J27 & 29
  competitor analysis Competitor analysis from Usability.net
Competitor analysis from IBM
Bunnyfoot - Competitor analysis: an alternative approach.‡
   assn 1 due Tues 27th
             
   

Field studies

video postponed - date TBA

**JoAnn T. Hackos and Janice C.Redish. User and Task Analysis for Interface Design, New York: Wiley, c1998. $60 (H&R)
ch 1, Intro to User and Task Analysis for Interface Design:
ch 2, Thinking about Users.
ch 3, Thinking about Tasks.
ch 4, Thinking about the Users' Environment
recommended: ch 5. Making the Business Case for Site Visits

**Rubin, Jeffrey, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. Wiley, 1994; ch 6, Selecting and acquiring participants. (This applies to all kinds of participants in usability studies.)

Brun-Cottan Francoise & Wall, P. (1995). Using video to re-present the user. Communications of the ACM, 38, 61-71.†
Field Studies: The Best Tool to Discover User Needs
By Jared M. Spool

Field studies done right by Jakob Nielsen

Sample user/task matrices


Video highlights from a usability test from Classic Systems Solutions and from Bolt & Peters, and from user interviews by Sachs Insights.

Slides from a Bay/CHI talk by John Pinto on using video in usability


Video training (tentative)
             
3
Feb 3 & 5
  Ethics of working with users UC Berkeley Committee for the Protection of Human Subjects

Ethical Principles of Psychologists and Code of Conduct 2002; see especially sections on Privacy and Confidentiality.‡

STC usability SIG on ethics


Association for Computing Machinery (ACM) Code of Ethics and Professional Conduct


**Rubin Appendix: Human factors and ergonomics society code of ethics

Oliver K. Burmeister, "Usability Testing: Revisiting Informed Consent procedures for testing Internet sites", Australian Institute of Computer Ethics Conference, 11/12/2000.

American Anthropological Assn
informed consent

Ethics for usability testing (short)

Final Projects: submit a short (paragraph or so) report on what you will do and who your team is
           
    Ethnographic methods Blomberg, Jeanette, & others, "Ethnographic Field Methods and their Relation to Design." Douglas Schuler and Aki Namioka, eds. Participatory Design: Principles and Practices. Hillsdale, NJ: Lawrence Erlbaum Associates, 1993; p. 123-155. Read pp. 123-147; the rest is recommended.

Blomberg, Jeanette L. "Ethnography: aligning field studies of work and system design." in Monk, Andrew F., and G. Nigel Gilbert, eds., Perspectives on HCI: Diverse Approaches. ch 8, p. 173-197. Academic Press, 1995. Read sections 8.1-8.25; the rest is recommended.

David R. Millen. Rapid ethnography: time deepening strategies for HCI field research. Conference proceedings on Designing interactive systems : processes, practices, methods, and techniques: processes, practices, methods, and techniques. ACM, 2000.
Contextual Inquiry and Design
is a structured approach to ethnography for system design.
Very brief overview: http://www.incent.com/cd/cdhow.html
The key book on Contextual inquiry: H. Beyer and K. Holtzblatt. Contextual Design: Defining Customer-Centered Systems, 1998, Morgan Kaufmann Publishers.
 
           
4
F10 & 12
  Tu: reporting on projects

Th: survey pretest


  Assn 2 due Feb 12

Interview exercise
(assn 3)
           
 5a
Feb 17
  configuring users; interviewing **Grint, K. & Woolgar, S. (1997a). Configuring the user: inventing new technologies. In Grint & Woolgar, The machine at work: technology, work, and organization (pp. 65-94). Cambridge, UK: Polity Press

**H&R ch. 7-10 .
 slides from last year on interviewing  
           
5B
Feb 19
  Interviewing (cont) Both handed out in class:

Michael Quinn Patton, Qualitative Research & Evaluation Methods (Thousand Oaks, Sage Publications 2001), “Qualitative Interviewing,” pp. 339-383

Richard Krueger, Developing Questions for Focus Groups (Thousand Oaks: Sage Publications 1997) “The Art and Mechanics of Asking Good Questions” pp 21-60.

   
           

6a
Feb 24

  Focus groups David L. Morgan, Focus Groups as Qualitative Research, Sage, 1988; pp. 53-71, Conducting and Analyzing Focus Groups.

Krueger, Richard A., Focus Groups, 2nd ed. Sage, 1994; "Asking questions in a focus group." pp. 53-69
Resources on focus groups from STC Usability SIG

Set of articles on focus groups

Online focus groups: pro and con
 focus group exercise
             
6b
Feb 26
  Guest speaker
Cathy Marshall, Microsoft
On using ethnographic methods -- readings have been emailed to class.   Assn 3
due
           
7a & 7b
Mar 2 & 4
  Scenarios and personas:"Useful to summarize and communicate qualitative findings. What is a scenario? from Information & Design.

Rosson & Carroll, Usability Engineering, ch. 1 - some of this is review, but pay attention to how they define scenarios.

Cooper, A. (1999). The inmates are running the asylum. Indianapolis: Sams. ch 11: Designing for people.

Pruitt, John and Grudin, Jonathan. Personas: Practice and Theory. 2002.
Personas: articles from Cooper Interaction Design: Kim Goodwin, Perfecting Your Personas;
Elan Freydenson, Bringing Your Personas to Life in Real Life

STC Usability SIG on personas and scenarios

 
           
Usability Assessment
 
8a
Mar 9
  Walkthroughs:
Heurisitics
Standards and guidelines
Mack & Nielsen, "Executive Summary," and Nielsen, Jakob, "Heuristic Evaluation," in Nielsen and Mack, Usability Inspection Methods, Wiley and Sons, 1994: chs 1 &r 2

Nielsen's 10 Usability Heuristics

Instone on Site Usability Evaluation and Site Usability Heuristics for the Web

First principles, AskTog

‡Standards and guidelines - a set of links from STC. Excellent source.

‡International standards for HCI and usability
Sample heuristics report from Barnum

Sample checklist
from InfoDesign

Sample test materials
from STC usability SIG: scroll down to Usability Checklists and Heuristic Reviews; include process for heuristics review and sample checklists 1 & 2

Heuristic Evaluation - A System Checklist
By Deniese Pierotti, Xerox Corporation

Research-based guidelines from usability.gov (128 pp.). Doesn't print well - try this version instead.


Ass 4:
Heuristics
 

slides

           
8b   Guest Speaker Maggie Law, MIMS grad; Interaction Designer, Peoplesoft   her slides
           

9a & b

Mar 16 & 18

  Usability metrics Babbie, Earl R. (2001) The Practice of Social Research, 9th ed., Wadsworth. Chapter 5: Conceptualization, operationalization, and measurement (or equivalent chapter from another social research methods text).

Robert Opaluch, "Usability Metrics". In Ratner, Julie, ed. Human Factors and Web Development, 2nd ed. Lawrence Erlbaum, 2003. p. 101-144.
   Assn 4
due Thurs 18th
         
  Usability testing **Rubin, Jeffrey. Handbook of Usability Testing (not in reader)
ch. 2, Overview of usability testing
ch. 5, Developing the Test Plan
ch. 7, Preparing the Test Materials
ch. 8, Conducting the Test
The rest of the book is recommended.

Dumas, Joseph S. and Janice C. Redish. A Practical Guide to Usability Testing:
ch. 11, Selecting and Organizing Tasks to Test
ch. 13, Deciding How to Measure Usability
Carol Barnum, Usability Testing and Research.
not as thorough as Rubin but covers more ground concerning usability in general.

Good summary based on Rubin

Common Industry Format for Usability Test Reports

Sample reports: DailogDesign; from Barnum

Sample test materials from STC usability SIG

usability labs from STC usability SIG
Usability test assignment
    

ON YOUR OWN:

Remote testing

Remote Online Usability Testing: Why, How, and When to Use It by Dabney Gough and Holly Phillips

IBM, Experience remote usability testing, Part 1 part 2
Tullis, T., Fleischman, S., McNulty, M., & Bergel, M. An Empirical Comparison of Lab and Remote Usability Testing of Web Sites. (in reader)  
 
  
SPRING BREAK March 23 & 25
 
10a
Mar 30
PROJECT REPORTS - update on all projects  
10b
Apr 1

Peter Merholz, adapativepath.com  
   
11 & 12a
Apr 6, 8
  Surveys

Survey data analysis
Dillman, Don A. (2000) Mail and Internet Surveys: the Tailored Design Method, 2nd ed. Wiley. chs. 2-3; 5. The rest of the book is recommended.

Web-based surveys:
Dillman, Don, and Dennis K. Bokwer. The web questionnaire challenge to survey methodologists.

Excellent collection of web survey resources collected by Rashmi Sinha

good Q&A on user surveys in usability

Survey resources from usabilitynet.org
slides 4/6
           
 12b & 13a
Apr 15 & 20
(dates may change)
  Universal usability: including accessibility, seniors and children, international usabiity W3C Quick tips

Theofanos Mary Frances & Redish Janice (2003). Bridging the gap: between accessibility and usability. interactions, 10, 36-51.

Ratner, Julie, ed. Human Factors and Web Development, 2nd ed. Lawrence Erlbaum, 2003:
1-Andrew Sears, "Universal Usability and the WWW." In p. 21-45.
2-Masaaki Kurosu, "A Cultural Comparison of Website Design from a Usability Engineering Perspective."

Nielsen, J. (2000). Designing Web usability. Indianapolis: New Riders. ch 6: Accessibility for users with disabilities. ch. 7: international usability.

W3C web accessibility initativeW3C Web Content Accessibility Guidelines 1.0 (not in reader)

Jacob Neilsen, International Web Usability Testing; Offshore Usability

Evers, Vanessa. Cross-cultural applicability of user evaluation methods: a case study amongst Japanese, North-American, English and Dutch users, CHI '02
Speakers April 20:
Ward Newmeyer, until recently campus compliance officer for the Americans With Disabilities Act, UC Berkeley


Adam Tanners, web designer, Disabled Students Program, UCB


Design/usability for children


Usability for young and old: STC Usability SIG

Section 508 standards

Resources on accessible web design including LOTS about color/color blindness

Bobby for testing sites

Good links on accessibility from usability.gov

Alliance for technology access, How to design accessible sites

Interactions special issue on universal usability: †Winds of change: SPECIAL ISSUE: HCI in the developing world. interactions 10[2]. 2003.

ACCESS TO MULTIMEDIA TECHNOLOGY BY PEOPLE WITH SENSORY DISABILITIES

ACCESS TO THE INFORMATION SUPERHIGHWAY AND EMERGING INFORMATION TECHNOLOGIES BY PEOPLE WITH DISABILITIES  

Accessibility software (free trial versions available):
Screen-readers: Jaws and Window-Eyes
Screen magnifier: ZoomText

Resources for Web Accessibility
13b
Apr 22
  Writing usability reports ‡Common Industry Format for Usability Test Reports

‡AskTog, 2001: How to Deliver a Report Without Getting Lynched
Sample reports  
       
 

14a
Apr 27
  Managing Usability in Organizations Selections from Bias & Mayhew, Cost-Justifying Usability (distributed in class)  
         
14b
Apr 29
  Credibility

(readings were originally scheduled for April 1, so that's where they are in reader -- between surveys and report writing)
Web credibility ‡Evaluating Web Pages, UC Berkeley Library (not in reader)

Web Credbility Guidelines, Stanford Web Credbility Project

Fogg, B. J. & and others (2001). What makes web sites credible? A report on a large quantitative study. In CHI 2001 (pp. 61-68). New York: ACM.

Recommended:
Fogg, B. J., Soohoo, C., Danielsen, D., Marable, L., Stanford, J., & Tauber, E. R. (2002). How Do People Evaluate a Web Site's Credibility? Results from a Large Study


Stanford, J., Tauber, E. R., Fogg, B. J., & Marable, L. (2002). Experts vs. Online Consumers: A Comparative Credibility Study of Health and Finance Web Sites New York: Consumer Web Watch.


Recommended: Constantinides, H. & Swenson, J. (2000). Credibility and medical web sites: a literature review. Comprehensive; applicable to many domains.
 
           
May 4   Project presentations

Megan
Ed
Anita
Maria
Nadine and Myra

 
           
May 6   Project presentations

Patrick
Dan
Lucie
Jesse and Vijay

 
 



[Links on these pages to commercial sites do not represent endorsement by the Univerity of California or its affiliates.] <--But, on the other hand, why would we put them here unless we thought they were useful? -- Thanks to Yale Braunstein.