Our system is a walk-up station inside McDonald's restaurant. The system is for you to order McDonald's food electronically, and operates on a touch screen. We have produced a prototype of the interface to be tested on users. However, please note that:

• The food pictures we use in this prototype are not the real images of the items, and the menu and price information might not reflect McDonald's current menu.
• We ask you to use the mouse to simulate the 'touch' on the screen, but you should comment our design based on the fact that it is implemented on a touch screen.
• On the first page, 'Start[Sp]' means the word 'Start' written in Spanish, and 'Start[Ch]' means the word 'Start' written in Chinese.
• The payment systems are not real. You can assume that they always work.

Before we can start, we also need to know you are OK with this testing by signing our consent form.

The testing session should take about 45 minutes.

Instructions

• Please 'think aloud' while you are testing our system. Say anything that you want to do or anything that you are thinking about.
• Feel free to ask questions during the test, but we may not answers some of them since we want to know how you interact with our system without getting hints from us.
• First, you can do anything you want with the system. Then, we are going to ask you to follow three scenarios. [Explain each of the task scenarios one by one after the participant finish the previous task.]
• You can choose any type of payment you want.
• After the testing, we will ask you some questions regarding your experience using our system.

Follow-Up Interview Questions

Critical Incident Logs and Interview Results

Direct
 

Participant	Task Scenario	Time to Finish (Minutes)	Number of Errors	Description of Error	# of Re-tries
1	Quick BigMac	1	1	Couldn't find "Big Mac"	2
1	Many Items	2.7	2	Couldn't find "Ketchup" Happy Meals and Happy Meals Toys Mixed Up	4, 2
1	Toys and Allergy	3.5	1	Couldn't find "No Pickles"	3
2	Quick BigMac	N/A	0	-	-
2	Many Items	N/A	2	Took a very long time trying to figure out where the ketchup is in the menu (which is actually not in the menu, but in the item detail screen) in order to ask for more ketchup Took a very long time trying to figure out how to remove an item from the order summary and did not succeed.	He did not succeed    He did not succeed
2	Toys and Allergy	N/A	0	-	-
3	Quick BigMac	N/A	0	-	-
3	Many Items	N/A	1	Did not know which food category comes with toys	2
3	Toys and Allergy	N/A	0	-	-

Comments:

• It makes the ordering a bit faster.
• "Woa, this page is too much" (The menu page is too cluttered.)
• One participant did not know that there were special request options.
• A participant paused for a while, trying to figure out how to order an item. He did not at all notice the instruction ('Touch the picture to order') on the top.
• Two participants said that the function of 'Options' button was not obvious.

Indirect
 

Participant	Task Scenario Number	Time to Finish (Minutes)	Number of Errors	Description of Error	# of Re-tries
1	Quick BigMac	0.7	0	-
1	Many Items	1.3	1	"Start Over" button is mixed with "Next" button	1
1	Toys and Allergy	1.5	0	-	-
2	Quick BigMac	N/A	0	-	-
2	Many Items	N/A	0	-	-
2	Toys and Allergy	N/A	0	-	-
3	Quick BigMac	N/A	0	-	-
3	Many Items	N/A	0	-	-
3	Toys and Allergy	N/A	0	-	-

Comments:

• "More like talking to someone at the cashier. More like real-world situation."
• "I like this version much better because it showed her what kind of special requests could be made. Also, the flow of food purchasing process was more like the usual way customers talked to the person at the cashier."
• The menu page is still a cluttered, but less than the direct version.
• One participant said that he still needed to think a little bit before figuring out that he can add the quantity of an ordered item on the Order Summary through the 'Edit' button, as opposed to through placing another order of the same item.
• One participant suggested changing the word 'Edit' into 'Change Order'
• One participant suggested changing the word 'Remove' into 'Cancel'
• One participant said that he wants to see all available sizes for French Fries on the menu page.

Overall

• All participants like the 'indirect' version better
• It is easy to find particular items in the menu after some practice.
• All participants said that the main menu page is too crowded
• It's not obvious that the tabs are to be selected.
• The pictures are too small.
• "Do I have to click the button 10 times to buy a quantity of 10 of an item?"
• One participant thought that New Tastes Menu should be put in an upper position in the menu bar at the left, and that there should be some animations to inform the customers about special promotions.
• One participant thought that our system could help speeding up the whole ordering process as customers did not need to stay in long lines if they already knew what they wanted to order, and that customers did not have to talk to the people at the cashier to order so it should reduce the possibilities of miscommunication.
• One participant thought that the system could help the customers who wanted to make large-quantity orders because they could keep track of their orders easily.
• There could be more special requests like no mayonaise and no cheese.
• The icons feedback on special requests are really necessary and cool!
• One participant would like to see the toys that they get in the Order Summary
• One participant suggested that the interface should have buttons of categories on one screen and items of each category in the next screen (hierarchical menu).
• One participant said that he would like to see an abbreviated Order Summary on the Payment Choice screen
• One participant suggested displaying fewer food items on the Main screen and presenting the menu of certain categories that has a lot of food items using vertical tabs or just simply separate them into two categories (Extra Value Meal 1-5, Extra Value Meal 6-10)
• Two participants preferred to have the complete price list on the Item Detail screen as long as it makes the Main Menu screen less cluttered.
• One participant said that he did not even need the price on the main menu page at all since he already had a sense of the price range of fast food items.
• One participant would like to see french fries with pictures in all sizes on the menu display.
• Ratings in the scale of 1-10 are:
• 1st participant: 9 for appearance, 7.5 for ease of use
• 2nd participant: 8 for appearance, 6 for ease of use
• 3rd participant: 6 for appearance, 7.5 for ease of us