20100924 - Eden, Distributed Cognitive Walkthrough...usability evaluation

The distributed cognitive walkthrough: The impact of differences in cognitive theory on usability evaluation by Eden, Joel Uzi, Ph.D., Drexel University, 2008 , 158 pages; AAT 3308596 My Interest: 1) Comparison method of Cognitive Walkthrough & Distributed Cognitive Walkthrough. 2) Cognitive walkthrough. 3) Distributed cognitive walkthrough. 4) First experimental study. Action: Medium-low priority to read the Dissertation in future. Motivation A primary goal of usability related fields is the creation of products andservices that conform to or leverage theoretical views of human cognition. Therefore, most usability related methodologies are directly based on theories of human cognition. Existing user-centered design (UCD) methods are based on cognitivist theoretical views, which hold that the locus of cognition is the brain. Opposing post-cognitivist views within the cognitive science field, such as distributed and extended cognition are not represented in current UCD methods. Research Goal Our research represents a first step towards understanding the impact of differences between these opposing theories of cognition on usability evaluation and design. Research Questions In examining the differential impact of opposing cognitive views (cognitivist versus post-cognitivist), three main research questions were explored using two experimental studies. Methodology – First Study The first experimental study explored the impact of walkthrough evaluation methods with a focus on an individual user versus a focus on interaction between internal and external resources, and the number of users in a scenario on the actionability, usability relevance, and reported severity of usability evaluations. Usability evaluations were conducted by 42 participants using either the Cognitive Walkthrough (representing cognitivist theoretical views) or the Distributed Cognitive Walkthrough (novel method developed as part of this research, representing the distributed and extended cognitive views) with scenarios set in a coffee shop. Results Discussion – First Study Use of two-way ANOVA showed a significant increase in all three dependent measures (actionability, usability relevance, and reported severity), with use of the Distributed Cognitive Walkthrough method over the Cognitive Walkthrough method. Methodology – Second Study A second experimental study explored the impact of materiality of artifacts (paper cup versus digital interface) on the actionability, usability relevance, and reported severity of usability evaluations. Usability evaluations were conducted by 22 participants using the Distributed Cognitive Walkthrough with scenarios set in a coffee shop that focused on either a paper coffee cup or a digital order tracking system interface. Results Discussion – Second Study Use of ANOVA showed a significant increase in reported severity for scenarios with the digital interface over scenarios with the paper cup. While differences in actionability and usability relevance by materiality were non-significant, interesting aspects of the differences are discussed. Discussion Beyond the individual results stated above, our findings suggest that an increased focus on the interaction of internal and external cognitive resources and variation in materiality of these resources during evaluation can result in making useful, yet invisible resources more visible, with respect to how an activity is being accomplished. This aspect of addressing the paradoxical invisibility of useful and usable artifacts is a key contribution of this research, showing how even simple differences in evaluation and design methods can aid in making visible these complex interactions between internal and external resources for cognition. Comments: Softcopy Dissertation is scanned version; cannot copy & paste; cannot easily blog about it.

Oct 15 - "Usability Questionnaire" & "Usability Evaluation" -ProQuest Dissertation Search

Oct 15 - Search dissertations with keywords "Usability Questionnaire" and "Usability Evaluation" at ProQuest.

Eden, Joel Uzi. The Distributed: Cognitive Walkthrough: The Impact of Differences in Cognitive Theoruy on Usability Evaluation. [Thesis, PhD] Drexel University. May 2008.

Fu, Limin. Usability Evaluation of Web Page Design. [Thesis, PhD] Purdue University. May 1999.

Howarth, Jonathan Randall. Supporting Novice Usability Practitioners with Usability Engineering Tools. [Dissertation, PhD in Computer Science & Applications] Virginia Polytechnic Institute and State University, Blacksburg, Virginia. April 13, 2007.

Olarte Enciso, Nadia Elizabeth. Development and Usability Heuristic Evaluation of an Application in PDA for Supporting Physicians Tasks at the Point of Care. [Project, M.E. in Computer Engineering] University of Perto Rico, Mayaguez. 2007.

Rawls, Charles L. Jr. PERFORMANCE SUPPORT AND USABILITY: AN EXPERIMENTAL STUDY OF ELECTRONIC PERFORMANCE SUPPORT INTERFACES. [Dissertation, Doctor of Education] University of Central Florida, Orlando, Florida. 2005.

Ryu, Young Sam. Development of Usability Questionnaires for Electronic Mobile Products and Decision Making Methods. [Dissertation, PhD in Industrial & Systems Engineering] Virginia Polytechnic Institute and State University, Blacksburg, Virginia. July 2005.

Schnitman, Ivana. The Dynamics Involved in Web-based Learning Environment (WLE) Interface Design and Human-Computer Interactions (HCI): Connections with Learning Performance. [Dissertation, Doctor of Education in Technology Education] West Virginia University, Morgantown, West Virginia. 2007.

Young, Deborah Elspeth. Evaluation of Dust Control Technologies for Drywall Finishing Operations: Industry Implementation Trends, Worker Perceptions, Effectiveness and Usability. [Dissertation, PhD in Industrial & Systems Engineering] Virginia Polytechnic Institute and State University, Blacksburg, Virginia. August 3, 2007.

Zhikute, Lina. Design and Evaluation of a Siebel Basic Navigation Course. [Thesis, M.A. (Educational Technology)] Concorda University, Montreal, Canada. April 2006.