Tester 2: Observer’s worksheet: Task 1 Planning a Event

 

 

1.      Initial Procedure

 Subject proceeds smoothly within 1 minute

 

 Facilitator helps after one minute

 

 

2.      Think Out Loud

 


What ……Look through suggestions, cannot find right place…………………

………………………………………………… When ……8:09……..

What ………Hope to use the service without taking much time………

………………………………………………… When …8:10……..

What ………How much info am I to give out?…………

……Cannot recognize my button…… When …8:11……..

What ………Events related to current day?……

…No pop up help!!!……… When ……8:12……..

What ……I want a scratch paper……

………………………………………………… When ……8:15…..

What …Am I going to buy a ticket?……

…Can’t find how to choose event…… When …8:15…..

3.      Wrong Clicks (if any)

Where …my button………… When …8:11………..

Where ………………………………………… When …………………………………..

Where ………………………………………… When …………………………………..

4.      Observations

  1. Did the subject understand the task?

  Yes     Not really

2.      Did the subject need help to find information after one minute?

        Yes     Not really

3.      Did the subject follow correct procedure? Did she get disoriented?

        Yes     Not really

4.      Did the subject come up with other needs during the process?

  Yes     Not really

5.   Did the subject use the E-mail list, or went to other places

 e-mail list     Others: …location…..

6.   Was it easy for the subject to add their choices to the list? And send to friends?

       Yes     Not really

 

 

 

Want more category for friend’s taste. Location, style, mood, etc

Add to mySFnight needs sign up?

Confused add my email list

Email list = email address list?

Wording confusing.

Observer’s worksheet: Task 2 Signing up MySFnight

 

 

  1. Initial Procedure

 Subject locate MySFnight button in reasonable time

 

 Facilitator helps or intervenes

 

 

  1. Think Out Loud

 


What ………Too many things, needs double check………………

………………………………………………… When …8:40…..

What ……Prefer personal style of interaction……………

………………………………………………… When …………………………………..

What ………Can I change options later?………………

………………………………………………… When ……8:45…..

What ……Newsletter is sent by email?…………………

………………………………………………… When …8:47……..

What ………Don’t know if I have finished.……………

………………………………………………… When ……8:48……..

What ………………………………………………………………………………………

………………………………………………… When …………………………………..

  1. Wrong Clicks (if any)

Where ………………………………………… When …………………………………..

Where ………………………………………… When …………………………………..

Where ………………………………………… When …………………………………..

  1. Observations
  1. Did the subject understand the task?  Yes     Not really
  2. Did the subject notice the personal area in the homepage?  Yes     Not really
  3. Did the subject need help to find information after 1 minute?  Yes     No
  4. Which procedure did the user follow in the beginning? …………………………..
  5. Did the subject come up with other needs during the process?  No     Yes, …………………………………………………………………………………..
  6. Does the user see the two kinds of newsletter/registration; How confusing is this? ……………………Yes……………………..
  7. What type of facial expressions does the user make during the process: bored, smiling, uncertain, frowning, etc  ……………………Good………………….
  8. What type of body language does the user make: shuffling, scratching their heads, or putting hand on chin ………………..………No………………………

 

  1. Time taken:

7 minutes
Observer’s worksheet: Task 3 Using MySFnight

 

 

  1. Initial Procedure

 Subject figures out how to use MySFnight button in reasonable time

 

 Facilitator helps or intervenes

 

 

  1. Think Out Loud

 


What ………I don’t understand what is minimize?……………

………………………………………………… When …8:56…..

What ……Weeks are relative to current week?………

………………………………………………… When ……8:57………..

What ……Need I add something to my profile before proceed?………………

………………………………………………… When …9:01……..

What ………I need visual feedback.…………

………………………………………………… When ……9:02……..

What ……I don’t understand move to my pick.………………

………………………………………………… When ……9:03………..

What ………Difference of recommend and my pick?……………

…What’s select?…………… When ……9:04……..

  1. Wrong Clicks (if any)

Where ………………………………………… When …………………………………..

Where ………………………………………… When …………………………………..

Where ………………………………………… When …………………………………..

  1. Observations

1.                  If the user uses the personal area, or would tend to go to the other areas

Yes

2.                  How easy is it for the user to add their own choices, and do other tasks such as sending to friends              a little hard

3.                  Other needs that may come up when performing the task.            No

4.                  What type of facial expressions does the user make during the process: bored, smiling, uncertain, frowning, etc                confused

5.                  What type of body language does the user make: shuffling, scratching their heads, or putting hand on chin…              No