Home

Assignment 1
Project Proposal

Assignment 2
Revised Proposal
Persona Explanation
Personas and Goals
Task Analysis
Interview Questions
Interview Summary

Assignment 3
Task Scenarios
Comp. Analysis
Primary Persona
Initial Designs

Assignment 4
Introduction
Prototype
Methods/Measures
Results/Discussion
Appendices

Presentation #1

Assignment 5
Interactive Prototype
Prototype Overview
Screen Shots
Inter. Scenarios
How to Use It

Assignment 6
Heuristic Evaluation

Assignment 7
Outside HE Update
New "Grid View"

Assignment 8
Introduction
Subjects/Methods
Test Measures
Results
Discussion
Experiment Design
Appendices

Presentation #2

Assignment 9
Overview
Personas/Scenarios
Final Design
Design Evolution
Appendices

Interactive Prototype

Work Distribution

Contact Us
is213-photocat@sims

SIMS 213, Spring 2005

 
ASSIGNMENT 8: PILOT USABILITY STUDY

Results

  Times Used
  View Date Links Popup Calendar Date Menus Save Bin as Album Share Bin Print Bin Location Menu Friends Menu
BULL'S EYE                  
Subject 1 4 0 4 3 0 2 0 3 1
Subject 2 4 0 3 2 0 1 0 0 0
Subject 3 4 0 3 0 1 0 0 1 0
TOTAL 12 0 10 5 1 3 0 4 1
                   
GRID                  
Subject 1 2 0 0 0 0 0 0 0 0
Subject 2 3 5 0 2 1 0 0 0 0
Subject 3 2 0 2 7 0 0 0 1 1
TOTAL 7 5 2 9 1 0 0 1 1
           
  View Date Links Popup Calendar Date Menus Save Bin as Album Share Bin Print Bin Location Menu Friends Menu
BULL'S EYE TOTAL 12 0 10 5 1 3 0 4 1
GRID TOTAL 7 5 2 9 1 0 0 1 1



  Time Spent
  Task 1 Task 2 Task 3 Task 4 Task 5
BULL'S EYE          
Subject 1 0:58 1:39 1:25 1:29 3:14
Subject 2 0:27 0:33 2:26 0:34 0:00
Subject 3 2:10 0:00 4:01 0:00 0:00
TOTAL 3:35 2:12 7:52 2:03 3:14
         
GRID          
Subject 1 0:00 0:00 1:37 0:00 1:02
Subject 2 0:00 2:70 0:00 0:44 1:39
Subject 3 0:00 1:48 0:00 4:01 2:50
TOTAL 0:00 4:18 1:37 4:45 5:31
           
           
  Task 1 Task 2 Task 3 Task 4 Task 5
BULL'S EYE TOTAL 3:35 2:12 7:52 2:03 3:14
GRID TOTAL 0:00 4:18 1:37 4:45 5:31




  TOTAL TIME SPENT ON ALL 5 TASKS AVERAGE TIME SPENT PER TASK
BULL'S EYE VIEW 18:16 3:39
GRID VIEW 15:31 3:06



Results Summarized

Overall, the Bullseye View was used more often than the Grid View. However, this could be explained by the fact that the subjects started in the bull's eye view for each task.

Summary of features used with respect to views:

  • Used More in Bull's Eye: Popup Calendar, Share Bin, Print Bin
  • Used Equally in both views: Save Bin as Album, Friends Menu
  • Used More in Grid: Date Links, Date Menus
  • Never Used in Either View: Print Bin

Summary of time spent with respect to tasks:

  • Spent More Time in Bull's Eye: Task 1, Task 3
  • Spent More Time in Grid: Task 2, Task 4, Task 5

The average time spent on each task was approximately equal.

Preference: Bull's Eye vs. Grid

In terms of the raw quantitative data above, the subjects didn't seem to clearly prefer one view over the other.

In our debriefing sessions, we asked the subjects what they thought of the two views.

Bull's Eye:

  • Subject #1: Thought the bull's eye offered a "good way to see a lot of information at one time."
  • Subject #2: Thought that determining which view was better depended on "what you want to do." The bull's eye was good for looking for a "specific date and time frame."
  • Subject #3: Thought the bull's eye was "good for finding photos around a particular activity"

Grid View:

  • Subject #1: Thought the grid view offered an easier way of finding specific pictures, especially in the final task where the subject needed to find a collection of outdoor photos.
  • Subject #2: Grid view had the advantage of letting you "see more of the picture."
  • Subject #3: The grid view was better for browsing, especially if you knew the photo had been taken on a particular day.

All three commented, either during testing or the debriefing, about the limitations posed by the small size of the thumbnails in the bull's eye. An important advantage of the grid view was that the grid thumbnails were larger.

The subjects didn't appear to have problems navigating by time in the bull's eye view. Subject #1 found the reverse chronological order of the grid view confusing.

Additional Results from Debriefing

"We have tried to build ways to eliminate the possibility of choosing days that don't have any pictures in them, in both the grid and the bullseye. Do you like this option, or did you not even notice?"

  • Subject 1: Didn't notice
  • Subject 2: No opinion
  • Subject 3: Didn't notice


"On the bullseye, would you want to see the radii of the bullseye collapse so that if there was a 'pie slice' that contained no pictures, it would no longer be there? I.e., do you only want to see on the bullseye dates that are there, or all the dates in that period of time--week, month, day?"

  • Subject 1: Approve
  • Subject 2: Approve
  • Subject 3: Strongly approve

"Did you like how Location menu affected the display of images on the screen?"

  • Subject 1: Strongly Approve
  • Subject 2: No opinion
  • Subject 3: Strongly approve

"Did you like how Friends menu affected the display of images on the screen?"

  • Subject 1: No opinion--doesn’t take pictures of people
  • Subject 2: Unclear on function of friends menu
  • Subject 3: No opinion