20100923 - Rihal, ..Objective & Subjective Usability

Relationship between certain objective performance measures and subjective usability by Rihal, Saravjit Singh, Ph.D., Texas A&M University, 2001 , 190 pages; AAT 3011790 My Interest: (1) Selecton of 6 objective usability characteristics. (2) Selection of 1 subjective usability characteristic, i.e. Satisfaction. (3) Pair-wise comparison. (4) Shortlisting of objective usability characteristics from 6 to 4. Action: to read the Dissertation in future. Motivation The nature of the relationship between objective and subjective usability measures is thought to be a positive one, though little else is known. It is this relationship that is to be investigated in this study. Research Objective The objective is to determine a "figure of merit" (FOM) incorporating the most important objective usability characteristics that can successfully predict the satisfaction characteristic. Methodology The usability literature was surveyed to determine the most commonly cited objective and subjective usability characteristics and measures. Six objective usability characteristics were determined to be important: Learnability, Relearnability, Guessability, Flexibility, Effectiveness, and Efficiency. These objective characteristics coupled with Satisfaction, were presented to experts for pair-wise comparison to determine the perceived importance of each characteristic to usability as a whole. Analysis of Data A rank order of the characteristics was obtained and a Kendall's Coefficient of Concordance (Kendall's W) was calculated to determine the level of agreement between the rankings. Little agreement was found among the rankings. One by one, the characteristics were dropped from consideration and the Kendall's W was recalculated to find the combination of characteristics with the highest amount of agreement among the experts. At the end of this process only four objective characteristics remained: Effectiveness, Efficiency, Guessability and Learnability. Methodology A web-based usability evaluation study was then performed during which measures of the four characteristics were automatically taken and collected, and compared against the satisfaction measure obtained from the participants of the study. Results show that the objective characteristics are independent of each other and could predict the satisfaction characteristic. Comments: In other words, when the objective usability characteristics are high, satisfaction (subjective usability characteristic) is also high. Conclusion/Discussion Based on the findings of this study, two proposals are made for a relative Figure of Merit (FOM). Both FOMs are constructed using the four objective characteristics as determined by the paired comparison; one involves summation, the other multiplication. Both FOMs allow differentiation between the websites and seemingly achieve the objective of predicting user satisfaction. Comments: Blurr. Wonders what he is talking about when he writes about FOM. Comments: Year 2001. Softcopy is scanned version; difficult to copy & paste, difficult to blog about it.

Oct 20 (part 2): "Usability Evaluation" related Dissertations

Khartabil, Rana. User-Centered Design and Evaluation of a Dynamic Biochemical Pathway Visualization Tool. [Thesis ,Master in Computer Science] The University of Ottawa, Ottawa, Ontario, Canada. 2005.

Lee, Minseok. Usability of Collaboration Technologies. [Dissertation, PhD] Purdue University, West Lafayette, Indiana. Aug 2007.

Li, Qian. Integrating Usability into Use Cases: A Methodology for User Interface Design. [Dissertation, PhD] The University of Connecticut. 2003.

Ling, Chen. Advances in Heuristic Usability Evaluation Method. [Dissertation, PhD] Purdue University, West Lafayette, Indiana. Dec 2005.

Loser, Marilyn Maguire. Computer Conference Message Navigation, Structure and Organization: Usability Evaluation of A Spatial Interface. [Dissertation, PhD in Organizational Learning & Instructional Technology] The University of New Mexico, Albuquerque, New Mexico. July 2001.

Rihal, Saravjit Singh. Relationship between Certain Objective Performance Measures and Subjective Usability. [Dissertation, PhD] Texas A&M University. May 2001.

Roberts, Vera Louise. Methods for Inclusion: Employing Think Aloud Protocols in Software Usability Studies with Individuals who are Deaf. [Thesis, PhD] University of Toronto. 2004.

Somervell, Jacob. Developing Heuristic Evaluation Methods for Large Screen Information Exhibits Based on Critical Parameters. [Dissertation, PhD in Computer Science and Applications] Virginia Polytechnic Institute and State University. June 22, 2004.

Takeshita, Harumi. Usability Evaluation for Handheld Devices: Presenting Clinical Evidence at the Point of Care. [Thesis, Master of Applied Science] University of Toronto. 2003.

Yang, Lan. Pilot Usability Study of UI Prototype for Collaborative Adaptative Decision Support in Neonatal Intensive Care Unit. [Thesis, M.A.Sc. (Electrical Engineering)] University of Ottawa, Ottawa, Ontario, Canada. 2005.

Oct 20....downloaded dissertations (part 2)