SIMS 213 * SIMS * UC Berkeley
 
NAMES ACCESS PROJECT: Task Analysis | Heuristic evaluation | Pilot user study | Prototypes: Lo-fi > First > Second > Third


Heuristic Evaluation
Completed by Rosalie Lack, Joanne Miller, Sally Thomas

1. [H1 Visibility of system status] (Severity 2)
Difficult to determine status of location in relation to the top navigation frame. Although the main window indicates the placement, there doesn't appear to be any reflection of the location in the top frame.
[Found by 1 evaluator]

2. [H8 Aesthetic and minimalist design] (Severity 2)
If it was determined that the advanced search feature was not frequently used, I would delete it as a selection from the top navigation frame. Keeping it accessible as a link from the home page is probably sufficient. It remaining as a selection on the top frame makes it a primary selection. Probably better for users to consciously select it after they determine they need more options than the initial search provides. (See related issue for problem #8)
[Found by 1 evaluator]

3. [H2 Match between system and the real world] (Severity 3)
The hierarchy of the information architecture was unclear. The options on the top navigation bar don't appear in any logical order. The horizontal arrangement of terms made it appear that they were initially in sub-relationship order, but then maybe they were each individual selections. A site map would help, but also a graphic depiction of the relationship of selections on top frame would be helpful.
[Found by 1 evaluator]

4. [H2 Match between system and the real world] (Severity 2)
The term "search services" might be confusing to users initially. The users may think of "search" in terms of their broader efforts to locate information about individuals, which might include traveling to specific locations. It might be misleading to offer "search services" for this reason. It might be helpful to specify that the search services are in relation to this site only, and are only online searches.
[Found by 1 evaluator]

5. [H2 Match between system and the real world] (Severity 3)
Use of term "Form 4387"--is user supposed to know what a "form" is (it might be more clear the selection produced something, but in its current state it’s not clear what a “form was.  The user might expect to access images (such as photos) but maybe all the options are registration forms? Most people do not think of a scanned text document as an image although technically it is one. It might help to have a list of the different types of images available under each collection, so when you choose "Auschwitz Haftlingsperonalbogen Collection" you get to select "forms" vs "photographs" vs. any other kind of image.
[Found by 3 evaluators]

6. [H2 Match between system and the real world] (Severity 3)
Browse "sources." What is a "source" here? Is it the provenance of a document (a collection) or a person? Because names of people were listed, it was confusing. The user might expect a type of source to be listed, or a collection. Because the title "Browse sources" appears in the box with names—it might be better if that title to be in the box where the collections are listed. Or change the title to say "Browse names by source."
[Found by 1 evaluator]

7. [H1 Visibility of system status] (Severity 3)
This may not be implemented yet, but when you select a different collection, the arrow should move to that selection, to reflect that you have made that selection.
[Found by 2 evaluators]

8. [H6 Recognition rather than recall] (Severity 3)
The "Home" page is also the primary search page, which may be confusing to people if they are elsewhere in the site, and want to go back to the search page, but forgot that Home is the search page. How about deleting "Advanced search" from top navigation bar and renaming "Home" with "Home (Search)."
[Found by 1 evaluator]

9. [H1 Visibility of the System Status and H10 Help and Documentation] (Severity 3)
The thesaurus functionality is not clearly described. Should the user type a name, then choose thesaurus and they will be presented with a list of names or is it a backend functionality that automatically looks up the term in a thesaurus. (The main reason that it is not clear is because it is not currently implemented. However since a thesaurus is such a specialized tool that can easily confuse the average person this seemed worth pointing out). [Related to problem #10]
[Found by 1 evaluator]

10. [H2 Match between system and the real world] (Severity 3)
On the Advanced Search page, the user has a choice between Soundex and Thesaurus when selecting the Birthplace. It is not clear what the difference between the Soundex and Thesaurus choices might be. Also, the user might not understand why a thesaurus is useful, and why one is necessary for a city name. [Related to problem #9]
[Found by 1 evaluator]

11. [H1. Visibility of System Status and H5 Error Prevention] (Severity 2)
There are several pages where the name of the current page is hyperlinked. For example, the Home page link is linked while you are home (if the user clicks Home while at the Home page, nothing happens.). Another example is on the Search Results pages when you are in a persons’ record that name is still hyperlinked.
[Found by 1 evaluator]

12. [H5 Error Prevention] (Severity 2)
In the Search Results screen, in the left-hand frame it is unclear what is hyperlinked with regards to the image icons. Because it says “click” next to the defined icons at the top of the left frame, the user may become confused when clicking the icon doesn’t produce any results.
[Found by 1 evaluator]

13. [H1 Visibility of the System Status & H9 Help users recognize, diagnose, and recover from errors] (Severity 2)
In the “save results” feature it is unclear where “mysearchresults” will go; how the user will find them again. It is unclear to the user what the difference is between “Click here for confirmation” and “Save.”
[Found by 2 evaluators]

14. [H2 Match between the System and the Real World] (Severity 2)
On the Make Connection page the following two sentences are unclear. “Web site visitors can identify these connections by the document icon provided next to the individual's name in search results. Please fill out one form for each individual.” First of all if by “web site visitor” that means me, say “you”. Also how does the document icon convey any information? And in the next sentence, does each entry constitute a form or is the page a form?
[Found by 1 evaluator]

15. [H4 Consistency and standards] (Severity 1)
Inconsistent use of labels - sometimes surname is used and at other times last name.
[Found by 1 evaluator]

16. [H1 Visibility of the System Status] (Severity 1)
The Advanced Search Page – It is unclear what “none” means on the advanced search. If the user leaves it as “select search option” or changes it to “none”, will there be a difference in the search results?
[Found by 2 evaluators]

17. [H2 Match between the System and the Real World] (Severity 1)
On the Search Results page, “click for more records” could be ambiguous. You don’t actually get more “records” you get more information. “Records” seems like a database term, not a term that the average person might use.
[Found by 1 evaluator]

18. [H3 User control and freedom and H5, Error prevention] (Severity 1)
On the Soundex results page the user cannot unclick “Select all” (probably just a technical oversight).
[Found by 1 evaluator]

19. [H8 Aesthetic and minimalist design] (Severity 2)
Frames do not fully appear on a smaller (15”) screen. If users will be accessing the site from home this may be a major concern.
[Found by 1 evaluator]

Overall Recommendations:
We think this is an excellent start, and it’s very evident that a lot of thought has gone into it. There are a few terms and labels that could be better defined, that will clear up some potential confusion for the users. We are concerned about the scalability of some of the browse functions—for example, the “browse by collection”: we would imagine that there will be at least hundreds, if not thousands, of records for each collection, which will make a browse list very difficult to handle. Because the frames might be problematic on smaller screens, we discussed the possibility of removing the top frame and/or the bottom revised search frame. As long as there’s a link to “Home” on each of the pages, users will have a way to access the primary categories of interest.


NAMES ACCESS PROJECT: Task Analysis | Heuristic evaluation | Pilot user study | Prototypes: Lo-fi > First > Second > Third
 
SIMS 213 * SIMS * UC Berkeley
Please send questions to Suzanne Ginsburg at ginsburg@sims.berkeley.edu
Last modified on April 8, 1999