Go back to Prototype & Usability Testing >> Results

 

 

LOG RECORDS

The log records testers’ response and critical incidents took place in the process of entire interview, including the test proper and the debriefing session afterwards, and some of the immediate thoughts of the observers.

 

 

Subject 1’s log

 

Task 1

 

1. Subject takes some time to browse without going to subscribe anything

2. Finds an event and wants to send to friends

3. Checking some bars and events and uses 'Add to my list' without trouble

4. Viewing 'My List' and finds comments, starts reading, even wants to write her own

5. Uses 'send to friends'

6. Complaining displayed things too small to locate (thoughts: we need to do adjustment!)

 

Task 2

1. Finds newsletter and hits 'GO' without a scratch, within a few seconds

2. Reading welcome page (Rosa) and decides to sign up MySFnight

3. Creating MySFnights with ease

4. Mentioned in real world she wouldn't sign up any newsletter

 

Task 3

1. Trying and browsing, looks a bit lost

2. Hits 'Change your preference twice' but finds nothing to customize at that time, wrong entry

3. Asking 'where is it adding to? To where?'

4. Confused with the consequence of her clicking (thought: user expectation revisited)

 

Debriefing session in tester's own words:

 

The customization area is not very clear to user until ...

Too small, too un-prominent, too tiny little thing, should be put in front

Often doesn't mean anything too me ...

When I provided info for further customization, I kind of assumed that in the future I will be able to log on to get my page. (Thoughts: user has different expectation about log on process.)

Default settings are considerate and good.

"E-mail to my friends" would be more clear.

Kind of hard to figure out what's good to set up MySFnight, 'My picks event', ...

I don't care my own reviews, but I want to read reviews from other people. (Thoughts: change that!)

Why DJ's?

Not very useful to send entire my list to friends, cause no one is going out every night.

I didn't see some of the options actually available. (Thoughts: visibility again!)

Personalize? Customize? None sounds too technical to me. (Thoughts: her case is

Maybe you can use 'Calendar' in word. (Thoughts: should think about it.)

Options and services should be present to user in clear words. Maybe be boring, but personally I would like that way.

 

Subject 2’s log

 

Task 1

1. Taking time to figure out interface

2. Going to “happening in SF”, trying to locate things on Tuesday. (thoughts: calendar or anything relates with date is really a must!)

3. Clicks Event page, browses, saying OK, back, clicks Bar page, OK again, adds to My List. Repeating this cycle for several times

4. Sending the list to friends

 

Task 2

1. Hesitating on signing up newsletters. Referring to e-vite case to raise e-mail related privacy issue

2. Still mindful about e-mail

3. When setting out to try newsletter, found difficult to find the button (thoughts: maybe should move upward a bit)

 

Task 3

1. Going out to schedule an event, found the button with easy

2. Saying couldn’t understand what ‘greeting name’ is (thoughts: change!)

3. Maybe more genres are needed

4. Don’t know what this box is for. Hit anyways ....

5. Send what? Confused with sending My List ....

 

Debriefing session in tester's own words:

 

Color actually won't help user distinguish it's customized or not, not even editor’s pick looks changed. (Thoughts: tend to agree. Change in color too subtle to be noticed.)

May be Editor's Jazz picks for (my name), would be better. (Thoughts: Once thought about that. Tradeoffs, need consideration.)

No (my name), no personalization. I want my name put in the personalized page.

Editor’s choices? What if more editors? Critics?

Maybe more navigation bar to ease user.

Greetname, hum, no. (Thoughts: agreed. Already decided to change.)

Not picking means I won’t get that information later? Mmmm ...

No number should be mentioned in instruction, basically

What if we get to the end of a month? Only a few days shown up? Or ongoing? (Thoughts: ongoing)

Maybe just make a 5-week calendar and put this week on top.

Supporting band for their live performance maybe a good idea on value chain. Even records company.

Difference between published material and web page in customization.

 

Subject 3’s log

 

Task 1

1. Select a day and chose an event type at the Homepage.

2. At the search result, saw some events and want to send three of them.

3. Asked if she could send from this page, since the small event description at the search result was enough to take a decision.

4. Since it wasn’t available, asked from where it would be available. Then went to event profile.

5. Not sure if want to Start a List to My Friends [we had changed the name as suggested by one tester, but at the end it was not a good one]

6. Asked what kind of feedback would get. The View My List button highlight was not enough.

7. Wanted to see the list.

8. Send the list to friends, the browser open with the tester message, and the tester asked why there wasn’t a easy way to enter the friends addresses. The tester wanted to have a agenda inside at MySfnight, to be able to organize according to friends’ taste: the dancing class listing, the Jazz listing etc.

 

Task 2

1.      At the homepage, looked around to look for the Newsletter signup. [We had moved the Newsletter sign up to the top of the lateral navigation at this point]. The tester first start to look at the left bottom.

2.      Type the e-mail and press Go.

3.      The feedback newsletter seemed confused to the tester, when read the last part of the message, saying that if the user would like to receive a more specific newsletter would sign-up MySfnight. There it was said that the user would receive a e-mail confirmation, and that would be able also to remove the name from the newsletter.

4.      Wanted to know if decided to sign up to MySfnight would receive two e-mail messages. Would prefer to click to a link, go to a second page, and from there have the two options available.

5.      Went to the Registration page. Specified the options. Checked at the privacy policy. Asked if those preferences would be used in MySFnight. Then saw it was said there.

6.      Crick at the button to Create MySFnight.

 

 

Task 3

1.      After the tester having Create MySFnight, the tester saw the own name in the gray small area of the homepage.

2.      Click at Go to MySFnight. At the beginning like the idea of a calendar [we had changed the name for The Month Calendar, as the other testers were calling].

3.      Marked some options and clicked at view marked. Mentioned that this would show the ones would like.

4.      Tried to understand what was my picks, and how could add to there.

5.      Asked about using the Select Event, and how could add an event from there.

6.      Ask about  Add to My List and why would use from there.

 

 

Debriefing session in tester's own words:

I would like to select a venue or event form the search results. Why I have to go to another page if there is a good description here, I suppose. A icon near each event would be good to just click and add to my list. Also this would solve your problem with finding the right word to this list thing. [Thoughts: This was a good idea, and we should think how to make without overwhelm the search results with too much information. But it is a legitimate need, specially for those who are in a hurry, or know a little about the event.]

What happens after the listing? I want to go to the list and then go back to the search result. It is complicate. Or maybe have the feedback in the results page.

I want to have at MySFnight my body list, and be able to send to them. I don’t want to use the browser. I am lazy, don’t include address there.

[if you don’t include at your browser, would you include at MySfnight?]

I want more automated.

[Thoughts: different needs: one tester want to use the browser to guarantee more privacy to the friends, gave the example of evite.com, and the problems of using people e-mails. Other user did not think at that moment about privacy, and was more concern in efficiency for organizing party. We should consider those needs, and reflect more about it.]

 

Two newsletter descriptions in the same page is confusing. Also the layout is not helping. [We then create a line between the two descriptions]. I want to know the options before start a newsletter. Go to a separate page with two descriptions would be better.


It is not clear how to add events or a venue from there [even with the text added there, I know still confusing, we did not have time to make better between sections]. It is confusing see that button Add to My List from there. What about having in the left navigation bar all those options “Add..”, “Send…” etc, it will be in every page. [Well… then another suggestion came..] Maybe an icon would solve all this problem of labeling, and it could have in each event or venue, from any place. At MySfnight would each event would have a small icon to Add to My List and the checkbox to be marked. Much better than having to mark and Add or Send to my friends.