20101013 - Fisher, Usability Testing...online course development

Usability testing: A model for improved online course development? by Fisher, Elizabeth Anne Bandy, Ph.D., The University of Alabama, 2009 , 196 pages; AAT 3385370 My Interest: 1) Usability testing. 2) Online course development. 3) UCD – user-centred design. 4) Usability testing protocol. Action: To read the Dissertation in future. Motivation According to the literature, usability testing as part of a user-centered design framework has been the industry standard for assessing the usability of products for quite some time. Business and industry and some governmental agencies routinely implement usability testing to test their products. Consequently, the literature is rich in this area. Despite the tremendous growth in online learning, little research has been conducted regarding the implementation of usability testing in academia, especially in regard to the development of online coursework. Research Goal Using the qualitative research paradigm, this study investigated the effectiveness of implementing usability testing as part of a user-centered design framework into the development of an online course for providing a model for improved course design. Methodology To implement the qualitative research design, a single, evaluative case study approach was employed. Usability testing was applied as part of a UCD framework, which calls for iterations of testing that inform changes in course design in a cyclic fashion. Data were collected during the spring 2009 semester at a major research university in the southeast. Fourteen participants from the freshmen student population took part in the study. Each participant was observed while completing five predefined tasks and corresponding surveys, which comprised a test session. One round consisted of 3 to 5 study participants each completing a test session. Data were collected through video recordings, surveys, observer logs, and journaling through four rounds. Findings Findings indicate that usability testing as part of a UCD framework may provide a model for improved online course design. 2. LITERATURE REVIEW 12 a. Introduction 12 b. Evolution of Distance Education and Online Learning 12 c. Usability Defined 15 d. Usability Testing Defined 16 e. Evolution of Usability Testing 17 f. Usability Testing Approaches 19 g. Usability Testing Models 21 h. Considerations for Usability Testing 28 i. User-Centered Design as a Framework 34 j . Summary 42 3. METHODOLOGY 44 a. Introduction 44 b. Researcher Positionality 45 c. Course Selection 46 d. Research Design 48 e. Rationale for Research Design 48 f. Research Question 50 g. Population and Sample 50 h. Instrumentation 51 g. Data Collection Procedures 56 h. Data Analysis 61 i. Summary 62 4. PRESENTATION OF DATA 63 a. Introduction 63 b. Demographics 64 c. Setting 65 d. Usability Testing Protocol 66 e. Summary 121