Oct 10 - HCIL, QUIS: The Questionnaire for User Interaction Satisfaction

QUIS: The Questionnaire for User Interaction Satisfaction

Subjective evaluation is an important component in the evaluation of workstation usability.
We have developed and standardized a general user evaluation instrument for interactive computer systems. The methods of psychological test construction were applied in order to ensure proper construct and empirical validity of the items and to assess their reliability. A hierarchical approach was taken in which overall usability was divided into subcomponents which constituted independent psychometric scales. For example, subcomponents include character readability, usefulness of online help, and meaningfulness of error messages.

Evaluation on these scales is assessed by user ratings of specific system attributes such as character definition, contrast, font, and spacing for the scale of character readability.

The purpose of the questionnaire is to:
1. guide in the design or redesign of systems,
2. give managers a tool for assessing potential areas of system improvement,
3. provide researchers with a validated instrument for conducting comparative evaluations, and
4. serve as a test instrument in usability labs. Validation studies continue to be run. It was recently shown that mean ratings are virtually the same for paper versus computer versions of the QUIS, but the computer version elicits more and longer open-ended comments.

The QUIS is licensed through the Office of Technology Liaison. Short and long paper versions are available as well as online versions that run in Windows and Macintosh environments, and now in HTML. The QUIS is currently licensed to dozens of usability labs and research centers around the world.

Related Papers:
Slaughter, L., Norman, K.L., Shneiderman, B. (March 1995) Assessing users' subjective satisfaction with the Information System for Youth Services (ISYS),VA Tech Proc. of Third Annual Mid-Atlantic Human Factors Conference (Blacksburg, VA, March 26-28, 1995) 164-170.CS-TR-3463, CAR-TR-768
Chin, J. P., Diehl, V. A, Norman, K. (Sept. 1987) Development of an instrument measuring user satisfaction of the human-computer interface, Proc. ACM CHI '88 (Washington, DC) 213-218. CS-TR-1926, CAR-TR-328

Participants:
Kent Norman, Department of Psychology
Ben Shneiderman, Computer Science
Ben Harper, Department of Psychology

Source: http://www.cs.umd.edu/hcil/quis/

Oct 8 - QUIS: QUestionnaire for Interaction Satisfaction

Questionnaire for User Interface Satisfaction

Please rate your satisfaction with the system.
Try to respond to all the items.
For items that are not applicable, use: NA

Likert Scale:
0
1
2
3
4
5
6
7
8
9
NA

OVERALL REACTION TO THE SOFTWARE
1. .......... > terrible > wonderful
2. .......... > difficult > easy
3. ........... > frustrating > satisfying
4. ........... > inadequate power > adequate power
5. ........... > dull > stimulating
6. ........... > rigid > flexible

SCREEN
7. Reading characters on the screen > hard > easy
8. Highlighting simplifies task > not at all > very much
9. Organization of information > confusing > very clear
10. Sequence of screens > confusing > very clear

TERMINOLOGY AND SYSTEM INFORMATION
11. Use of terms throughout system > inconsistent > consistent
12. Terminology related to task > never > always
13. Position of messages on screen > inconsistent > consistent
14. Prompts for input > confusing > clear
15. Computer informs about its progress > never > always
16. Error messages > unhelpful > helpful

LEARNING
17. Learning to operate the system > difficult > easy
18. Exploring new features by trial and error > difficult > easy
19. Remembering names and use of commands > difficult > easy
20. Performing tasks is straightforward > never > always
21. Help messages on the screen > unhelpful > helpful
22. Supplemental reference materials > confusing > clear

SYSTEM CAPABILITIES
23. System speed > too slow > fast enough
24. System reliability > unreliable > reliable
25. System tends to be > noisy > quiet
26. Correcting your mistakes > difficult > easy
27. Designed for all levels of users > never > always

List the most negative aspect(s):
1 ....................................................
2 ....................................................
3 ....................................................

List the most positive aspect(s):
1 ....................................................
2 ....................................................
3 ....................................................


Questionnaire for User Interface Satisfaction
Based on: Chin, J.P., Diehl, V.A., Norman, K.L. (1988) Development of an Instrument Measuring User Satisfaction of the Human-Computer Interface. ACM CHI'88 Proceedings, 213-218. ©1988 ACM. [Abstract] Copying without fee is permitted provided that the copies are not made or distributed for direct commercial advantage, and credit to the source is given. ©1986-1998 University of Maryland.

Source: http://hcibib.org/perlman/question.cgi?form=QUIS