Syllabus

Last revised 11/20/071:20 pm

Readings

Many readings are are password-protected. In addition, if you are connecting from a non-UCB IP address, you need the Library Proxy Service to access readings from journals.

Books referred to:

Courage, C. & Baxter, K. (2005). Understanding your users: a practical guide to user requirements methods, tools, and techniques. San Francisco, CA: Morgan Kaufmann Publishers.
Hackos, J. T. & Redish, J. (1998). User and task analysis for interface design. New York: Wiley.
Kuniavsky, M. (2003). Observing the User Experience, , Morgan Kaufmann.

INTRODUCTION
1

Aug 28 & 30

Intro: concepts and methods
needs assessment and usability assessment methods overview

Ben Shneiderman and Catherine Plaisant, Designing the User Interface : Strategies for Effective Human-Computer Interaction, New York; Addison-Wesley, 2004
Sections 1.1-1.4

Kuniavsky Ch. 3 & 4

Usability basics from Usability.gov

Pls fill out and email me this student info sheet
FOCUSING ON PEOPLE
2

CHANGED 8/30/07

Sept 4 & 6

User-centered design, iterative development, and planning; Ethics of working with users; methods overview

Learning about users; user and task analysis

What do we mean by "users"?
How do we know who the users are or will be?
How does the concept of "the user" enter into needs assessment, requirements specific, design, and evaluation?

Competitor analysis: a good place to start for many reasons

 

Kuniavsky, Chs. 5-7

Courage & Baxter Chapter 3

Oudshoorn, Nelly, and Pinch, Trevor. "How Users and Non-Users Matter," p. 1-16. In: Oudshoorn and Pinch, eds. How Users Matter: the Co-Construction of Users and Technology. MIT Press, 2003.

Recommended: Grint, K. & Woolgar, S. (1997a). Configuring the user: inventing new technologies. In Grint & Woolgar, The machine at work: technology, work, and organization (pp. 65-94). Cambridge, UK: Polity Press.

Hackos and Redish, Ch 2, Thinking about Users, Ch 3, Thinking about Tasks, Ch 4, Thinking about the Users' Environment

Goto and Cotler, Chapter 10:  Analyzing Your Competition

Competitor analysis from Usability.net

IBM ease of use process navigator

Usability.gov process map, planning guide and learning about users

Usability.net methods table

Assn 1: Naive usability assessment due Tues 09/04

See also:

user-centered design slides

competitive analysis slides

configuring users slides

ethics of working with people

3a & b

Sept 11 & 13

Ethnographic methods in needs and usability assessment

Observation

Blomberg, J., Burrell, M., Guest, G. An ethnographic approach to design. In Jacko J. A., Sears A. (eds.). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. Lawrence Erlbaum Associates, Inc.: Mahwah, New Jersey, 2003.

David R. Millen. Rapid ethnography: time deepening strategies for HCI field research. Conference proceedings on Designing interactive systems : processes, practices, methods, and techniques. ACM, 2000.

Hugh Beyer and Karen Holtzblatt, Contextual Design, San Francisco; Morgan-Kaufman, 1998
Chapter 1 - Introduction

observation assignment assigned

fieldnotes slides

ethnography slides

4a

Sept 18

Ethnography (concl); Interviewing (begins)

Robert S. Weiss, Learning from Strangers - The Art and Method of Qualitative Interview Studies, New York: The Free Press, 1994
Chapter 3 - Preparation for Interviewing
4b Sept 20 Preliminary project review

observation assignment DUE

Preliminary project plan DUE - final project description.

 

5a

 

Sept 25

interviewing

Chapter 4 - Interviewing - Part 1
Chapter 4 - Interviewing - Part 2 - Examples of Interviewing
Chapter 5 - Issues in Interviewing

including card sorting Kuniavsky p. 192-199

 

Interviewing assn assigned

Card sorting slides

Interviewing slides

5b

Sept 27

Interviewing (cont)

Finish interviewing

Diary studies: Kuniavsky p. 369-385

Recommended: Carter, S. and Mankoff, J. 2005. When participants do the capturing: the role of media in diary studies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA, April 02 - 07, 2005). CHI '05. ACM Press, New York, NY, 899-908.

 
6a

Oct 2

Diary Studies

Begin focus groups (incl online)

 

 

David L. Morgan, Focus Groups as Qualitative Research, Sage, 1988; pp. 53-71, Conducting and Analyzing Focus Groups.

Krueger, Richard A., Focus Groups, 2nd ed. Sage, 1994; "Asking questions in a focus group." pp. 53-69 Rosenbaum, et. al., Focus Groups in HCI: Wealth of Information or Waste of Resources, CHI 2002

Online focus groups:pro and con

Remote Online Usability Testing: Why, How, and When to Use It by Dabney Gough and  Holly Phillips (is more about remote interviewing than about remote testing)

Diary study assignment OFFICIALLY assigned

diary studies slides

6b

Oct 4

Finish focus groups

Remote interviewing

Begin surveys

 

focus group slides

remote data collection slides

& 7a

Oct 9

Surveying

Survey sampling

Reporting survey findings


 

 

Any thorough text on sampling and survey sampling will do; here's an online source: Statistics: Power from Data from Statistics Canada. Read the entire chapter on Sampling Methods that starts here. These concepts underlie much of data collection for a variety of purposes. [check]

Babbie, Earl R. (2001) The Practice of Social Research, 9th ed., Wadsworth. Chapter 5: Conceptualization, operationalization, and measurement (or equivalent chapter from another social research methods text).

Kuniavsky, ch 11

Schneiderman, Section 4.4

Dillman,Don A. (2000) Mail and Internet Surveys: the Tailored Design Method, 2nd ed. Wiley. chs. 2-3; 5. The rest of the book is recommended.

Web-based surveys: Dillman, Don, and Dennis K. Bokwer. The web questionnaire challenge to survey methodologists. [check -- maybe change]

Examples of survey reports

Please looks through each of the links found on this page for example surveys: Survey resources from usabilitynet.org

Sources for questions:
http://www.gvu.gatech.edu/user_surveys/survey-1998-10/graphs/graphs.html#general Stopped in 1998 but source of pre-tested questions, e.g. demographics

http://www.pewinternet.org They often reproduce their questionnaires -- again a source of pre-tested questions.

http://www.digitalcenter.org/downloads/DigitalFutureReport-Year4-2004.pdf UCLA Digital Futures Project -- more recent report not available online.

Surveymonkey.com One of many online survey services. Many allow some free use that may be enough for your projects.

Recommended: Dillman,Don A. and Leah Melani Christian, Survey Mode as a Source of Instability in Responses across Surveys, Field Methods, February 2005

Interviewing assn DUE Oct 9

 

7b

Oct 11

Guest Lecture, Peter Merholz, Adaptive Path
Dealing with clients: the real world of usability

Diary Study due
8a Oct 16

Nancy away

Surveys continued

Questionnaire design and construction

Survey assn OFFICIALLY assigned

questionnaire design slides

FOCUSING ON SYSTEMS AND SERVICES
8b

Oct 18

Nancy away

Inspection Methods

 

 

finish up visualization discussion

Expert Inspection: Heuristics Evaluation & Cognitive Walk-thrus

Muller, Matheson, Page, and Gallup, Participatory Heuristic Evaluation, Interactions, Sep.-Oct., 1998

Mack & Nielsen, "Executive Summary," and Nielsen, Jakob, "Heuristic Evaluation," in Nielsen and Mack, Usability Inspection Methods, Wiley and Sons, 1994: chs 1 &r 2 AND pp. 105-118

Nielsen's 10 Usability Heuristics

Instone on Site Usability Evaluation and Site Usability Heuristics for the Web

First principles, AskTog

International standards for HCI and usability

Recommended:

visual reporting slides

heuristics slides

9a

Oct 23

Surveys again

 

 

Overview of quantitative data analysis

Review survey readings if necessary

 
9b

Oct 25
Project reports and discussion

 

Survey assn due Oct 25
10a & b

Oct 30 & Nov 1

Usability testing

Remote testing

 


Rubin, Jeffrey, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. Wiley, 1994 (Rubin). Specific readings: Chapter 2. Chapter 3, Chapter 5, Chapter 7, Chapter 8, Chapter 10

Robert Opaluch, "Usability Metrics". In Ratner, Julie, ed. Human Factors and Web Development, 2nd ed. Lawrence Erlbaum, 2003. p. 101-144.

Kuniavsky, Ch. 10

Susan Dray and David Siegel, Remote Possibilities: International Usability Testing at a Distance, Interactions, Mar.-Apr. 2004

Remote Online Usability Testing: Why, How, and When to Use It by Dabney Gough and Holly Phillips

IBM, Experience remote usability testing, Part 1

http://www.boxesandarrows.com/view/remote_online_usability_testing_why_how_and_when_to_use_it

Recommended:

 

 

REPORTING
11a Nov 6

Usability testing, cont

A little about reporting

 
11b Nov 8

Mobile usability

guest speaker: Anita Wilhelm, Mobile Product Manager, ScanR.com, SIMS grad

Schultz, D. 2006. 10 usability tips & tricks for testing mobile applications. interactions 13, 6 (Nov. 2006), 14-15.

Duh, H. B., Tan, G. C., and Chen, V. H. 2006. Usability evaluation for mobile device: a comparison of laboratory and field tests. In Proceedings of the 8th Conference on Human-Computer interaction with Mobile Devices and Services (Helsinki, Finland, September 12 - 15, 2006). MobileHCI '06, vol. 159. ACM, New York, NY, 181-186.

Hagen, P., Robertson, T., Kan, M., and Sadler, K. 2005. Emerging research methods for understanding mobile technology use. In Proceedings of the 19th Conference of the Computer-Human interaction Special interest Group (Chisig) of Australia on Computer-Human interaction: Citizens online: Considerations For Today and the Future (Canberra, Australia, November 21 - 25, 2005). ACM International Conference Proceeding Series, vol. 122. Computer-Human Interaction Special Interest Group (CHISIG) of Australia, Narrabundah, Australia, 1-10.

 

 
12

Nov 13

Coding and Frameworks; Scenarios, personas, use cases

Matthew B. Miles, A. Michael Huberman Qualitative Data Analysis: An Expanded Sourcebook, Sage, 1994: chapter 10, Making Good Sense. Photocopy handed out in class.

Recommended: "Demystifying data analysis", Rachel Hinman

Frameworks slides

Grounded theory slides
12

Nov 15

Reporting

Kuniavsky, ch 17

AskTog, 2001: How to Deliver a Report Without Getting Lynched

Jarrrett, Caroline. Better Reports: How to Communicate the Results of Usability Testing

Common Industry Format report format (see about CIF).

Some examples

NVH gone

Reporting slides

13a

Nov 20

Scenarios, personas, use cases

Rashmi Sinha, Persona Development for Information-rich Domains, CHI 2003

Pruitt, John and Grudin, Jonathan. Personas: Practice and Theory. 2002.Kentaro Go and John M. Carroll, The Blind Men and the Elephant: Views of Scenario-Based System Design, Interactions, Nov.-Dec. 2004

Cooper, A. (1999). The inmates are running the asylum. Indianapolis: Sams. ch 11: Designing for people.

What is a scenario? from Information & Design

Use cases from usability.gov and from Wikipedia

personas slides
13b Nov 22 Thanksgiving
  Nov 27 Accessibility

Aaron Marcus, Universal, ubiquitous, user-interface design for the disabled and elderly, Interactions, Mar.-Apr. 2003

Schneiderman, Ben. Universal Usability. CACM 43:5 200. p. 84- 91.

Browse the universalusability.org site and the W3C web accessibility initiative sites

W3C introduction to web acccessibility

W3C Quick tips

WAI guidelines and techniques

Section 508 standards

Recommended - on international usability:
Jacob Neilsen, International Web Usability Testing; Offshore Usability

Evers, Vanessa. Cross-cultural applicability of user evaluation methods: a case study amongst Japanese, North-American, English and Dutch users, CHI '02

 
14

Nov 29

"Doing User Research in the Real World"
Cyd Harrell
Director of UX Research
 
15 Dec 4 & 6: Project presentations

Tuesday 12/4

2:10 - 2:30 - Delphi
2:30 - 2:45 - Transit
2:45 - 3:05 - SitReps 
3:05 - 3:20 - Jaiku

Thursday 12/6

2:10 - 2:30 - RFID
2:30 - 2:50 - UCWise
2:50 - 3:10 - EngPathways
3:10 - 3:30 Course Evaluations

 
Final project write-ups due Monday, Dec. 10, 5 pm -- early submissions welcome.