20100922 - Dykstra, Domain-specific Heuristic Checklist

A comparison of heuristic evaluation and usability testing: The efficacy of a domainspecific heuristic checklist by Dykstra, Dean Julian, Ph.D., Texas A&M University, 1993 , 228 pages; AAT 9410761 My Interest: (1) Calendar Checklist = UET = domain-specific heuristics checklist. (2) Comparison methodology of the 3 usability evaluation methods. (3) Results comparison – software developers vs usability professionals. Action: To read this Dissertation in future. Motivation The need for cost-effective usability evaluation has led to the development of alternative usability methods. Reducing the number of participants in a usability test or using heuristic evaluation are the two approaches most often associated with discount methods. Research Objective In this dissertation, an alternative heuristic method was developed based on the concept of a double specialist (knowledge of usability techniques and of a software product domain). Double specialists were previously shown to provide heuristic evaluation superior to that of regular usability professionals, primarily because of their knowledge of usability problems typically found within the given domain. Similar knowledge, based on competitive usability testing, was used to devise a domain-specific heuristic checklist. Context The product domain chosen for the research was online calendars. The calendar checklist was compared to general heuristics and to streamlined usability testing with two usability test subjects. Comments: 3 evaluation types were probably: (1) calendar checklist (domain-specific heuristics checklist), (2) general heuristics, (3) streamlined usability testing. Methodology Fifteen software developers and fifteen usability professionals were each randomly assigned to one of the three evaluation methods. They were then provided with a previously unseen software calendar and were asked to find as many usability problems as possible. Results Discussion Participants using the calendar checklist found more total problems, and a significantly higher percentage of user-oriented problems and severe problems than did those using the general heuristic method, suggesting that domain-specific heuristics do provide an improved heuristic approach. Streamlined usability testing, however, was found to be the most effective discount usability method. Usability professionals and software developers did not differ in their ability to find user-oriented or severe problems. Conclusion It was concluded that when time and resources permit, usability testing is the method of choice. When user testing is not feasible, however, domain-specific heuristics may provide results approaching the effectiveness of the double specialist. Comment: I enjoy reading this Abstract; written beautifully and systematically.

Oct 20 - ProQuest dissertation search "Usability Evaluation"

Oct 20 - Keywords were "Usability Evaluation." Continued to search and download, as continuation from Oct 15.

Al-Nuaim, Hana Abdullah. Development and Validation of a Multimedia User Interface Usability Evaluation Tool in the context of Educational Web Sites. [Dissertation, Doctor of Science] George Washington University. Jan 31, 2000.

Andre, Terence S. Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems. [Dissertation, PhD in Industrial & Systems Engineering] Virginia Polytechnic Institute and State University, Blacksburg, Virginia. April 3, 2000.

Baker, Kevin F. Heuristic Evaluation of Shared Workspace Groupware based on the Mechanics of Collaboration. [Thesis, M.Sc.] University of Calgary, Calgary, Alberta, Canada. May 2002.

Capra, Miranda G. Usability Problem Description and the Evaluator Effect in Usability Testing. [Dissertation, PhD in Industrial & Systems Engineering] Virginia Polytechnic Institute and State University, Blacksburg, Virginia. March 13, 2006.

Chang, Yaowen. A Theory-based Usability Study of the Mouseover Abstract Interface. [Dissertation, Doctor of Education] Columbia University. 2005.

Clapsaddle, Donna J. Measuring Usability: Categorically Modeling Successful Websites Using Established Metrics. [dissertation, Doctor of Professional Studies in Computing] Pace University. May 2004.

Dykstra, Dean Julian. A Comparison of Heuristic Evaluation and Usability Testing: The Efficacy of a Domain-specific Heuristic Checklist. [dissertation, PhD] Texas A&M University. Dec 1993.

Elgin, Peter D. VALIDATING THE USER-CENTERED HYBRID ASSESSMENT TOOL (USER-CHAT): A COMPARATIVE USABILITY EVALUATION. [Dissertation, PhD] Kansas State University, Manhattan, Kansas. 2007.

Faulkner, Laura Lynn. Structured Software Usability Evaluation: An Experiment in Evaluation Design. [Dissertation, PhD] University of Texas at Austin. May 2006.

Govindaraju, Majorkumar. Development of Generic Design Guidelines to Manufacture Usable Consumer Products. [Dissertation, PhD] University of Cincinnati. 1999.

Hebb, Christopher Louis. Website Usability Evaluation using Sequential Analysis. [dissertation, PhD] Indiana University, Bloomington. May 2005.

Ho, Janet Chingyun. Evaluation of A Virtual Campus: Bell University Labs. [Thesis, Master of Applied Science] University of Toronto. 2000.

Hu, Xiangqun. Development and Evaluation of a Web-based Architectural Design Tool. [Thesis, Master of Computer Science] Technical University of Nova Scotia, Halifax, Nova Scotia. 1997.

Ivory, Melody Yvette. An Empirical Foundation for Automated Web Interface Evaluation. [Dissertation, PhD in Computer Science] University of California at Berkeley. Fall 2001.

Jenkins, Lillie Ruth. DESIGNING SYSTEMS THAT MAKE SENSE: WHAT DESIGNERS SAY ABOUT THEIR COMMUNICATION WITH USERS DURING THE USABILITY TESTING CYCLE. [Dissertation, PhD] the Ohio State University. 2004.

Jobrack-McDaniel, Naomi Ruth. Remote versus Laboratory Usability Evaluations with Static versus Interactive Graphical User Interfaces. [Thesis, M.A.] San Jose State University. May 1999.