Appendix 1

Experimental Design

Setup of Evaluation

Points to Note

Analysis

Evaluation Sheet

Personal Details

Task Analysis


Experimental Design

A1. Setup of Evaluation

  1. fingerprint reader is set up on tabletop, attached to laptop. Seat is placed so that the fingerprint reader will be directly in front of the test subject (i.e. centered, as opposed to left or right). Ask the test subject to sit down.
  2. Ask the test subject if he/she is right- or left-handed and ask what finger he/she would like to enroll, explaining that any finger can be chosen.
  3. Explain to the test subject why the test is being carried out.
  4. Explain to the test subject that he/she will firstly be asked to guess how the fingerprint reader should be used, without instructions. Highlight that this is to test if the design of the fingerprint reader is self-explanatory. It is in no way a test of the subject's ability. 
  5. Read out the onscreen instructions (if necessary) and ask the test subject to attempt to enroll a fingerprint on the basis of these instructions.
  6. Provide more detailed instructions (if necessary) and ask the test subject to attempt to enroll a fingerprint on the basis of these instructions.

A2. Points to Note

  1. Once the test subject has tried one fingerprint reader he/she might automatically assume that the next fingerprint reader works in the same way. Similarly, it may influence the success of the subsequent scans, as the test subject will be able to draw on prior experience. Therefore, to minimise bias, the order in which each test subject encounters the three fingerprint readers will be randomized.

A3. Analysis

  1. Which finger did the test subject choose to scan and is the test subject right- or left-handed?
  2. What motion did the test subject produce on first contact with the fingerprint reader (i.e. pressed finger on top, swiped finger etc.)?
  3. Any comments made by the test subject during the course of the evaluation.
  4. Was the scan successful on first try (instructions not read out)?
  5. Was the scan successful on first try after the instructions were read out?
  6. Was the scan successful on first try after more detailed instructions were provided?
  7. Did the test subject know how to interact with the fingerprint reader (instructions not read out)? (e.g. Did the test subject know to swipe rather than press finger?)
    Did the test subject know how to interact with the fingerprint reader after instructions were read out?
  8. Did the test subject know how to interact with the fingerprint reader after more detailed instructions were provided?
  9. Did the test subject know that the finger has to be scanned 3/4 times to enroll?
  10. Once the test subject knew how to interact with the fingerprint reader, and one scan was successful, did the test subject successfully enroll one fingerprint?
    When a scan was unsuccessful did the test subject recognize this? (i.e. was the system feedback sufficient?)
  11. When a scan was unsuccessful did the test subject know what the problem was?

Evaluation Sheet

A. Personal Details

  1. Test Subject name:
  2. Year of Birth:
  3. Gender: M/F
  4. Do you have a visual impairment?
  5. What is the cause of your visual impairment?
  6. Where in your field of view do you have residual vision?
  7. Do you wear glasses or contacts?
  8. If so, for what do you wear them?
  9. Glasses/Contacts: worn/not worn
  10. Where test was done

B. Task Analysis

Task
IBM
Hamster
Microsoft
1. Automatically knew which finger motion to use
     
2. Automatically knew how to interact with the scanner
     
3. Knew how to interact with scanner after manufacturer's instructions were provided
     
4. Knew how to interact with scanner after more detailed instructions were provided
     
5. Success on first go of first scan
     
6. Success after manufacturer's instructions were provided
     
7. Success after more detailed instructions were provided
     
8. Automatically knew to provide more than one scan for enrolment procedure
     
9. Once the procedure was understood, were the following scans successful?
     
10. When a scan was unsuccessful, did the test subject recognise this?
     
11. When a scan was unsuccessful, did the test subject know what the problem was?
     

 

Return to Contents Page