December – 2014

Promoting Distance Learners’ Cognitive Engagement and Learning Outcomes: Design-Based Research in the Costa Rican National University of Distance Education

Joo photo Andres photo Shearer photo

K. P. Joo1, Carmen Andrés2, and Rick Shearer3
1Korea National Open University, Korea, Republic of, 2The Costa Rican National University of Distance Education, 3The Pennsylvania State University, United States

Abstract

To explore effective learning design for students’ cognitive engagement, a design-based case study was conducted in a quality control course in the Costa Rican National University of Distance Education between the 2011 and 2012 academic years. The course was revised for the 2012 provision in terms of the assignment structure, the number of face-to-face sessions, and facilitation strategies. This study documents how the course redesign impacted the distance learners’ cognitive engagement and learning outcomes. Theories of cognitive engagement and transactional distance informed the design-based investigation. Research findings indicate that the design revisions positively influenced both students’ cognitive engagement and learning outcomes within this distance higher education context; however, the student performance represented by their assessment grades might not always reflect this improvement.

Keywords: Distance higher education; transactional distance; cognitive engagement; learning outcomes; design-based research

Introduction

Design-based research integrates empirical investigation with theory-based learning design (Swan, Mattews, Bogle, Boles, & Day, 2012). The ultimate goal of design-based research is to improve students’ learning in real-world educational environments through systematic innovations (Wang & Hannafin, 2005). Since research and development simultaneously occur through continuous cycles of design, enactment, analysis, and redesign in a design-based research project (Cobb, 2001), this approach enables educators to elucidate “how, when, and why educational innovations work in practice” (The Design-Based Research Collective, 2003, p. 5). Particularly, design-based research entails the study of learning in context through systematic design and instructional strategies (Brown, 1992). It thus leads to “contextually-sensitive design principles and theories” (Wang & Hannafin, 2005, p. 7), which also can create a number of meaningful implications for distance education.

The purpose of this study is to report on the first cycle of a design-based research process for designing, implementing, and revising a quality control course in the Costa Rican National University of Distance (Universidad Nacional Estatal a Distancia in Spanish). Considering the iterative nature of design-based research and the dual purpose to redesign the course and to create design principles (Swan et al., 2012; Wang & Hannafin, 2005), the study documents the design changes made for the 2012 course provision and their effect on students’ cognitive engagement and learning outcomes. The target course has been provided at an undergraduate level in a hybrid format; it features field trips related to students’ individual research projects as well as a series of supplementary face-to-face classes.

Lauzon (1992) pointed out that one of the fundamental challenges for distance educators is to “search out means of reducing structure and increasing dialogue so that learners may move from being simply recipients of knowledge to actively embracing and working with objective knowledge to make it their own” (p. 34). In an attempt to improve the course quality through ongoing design experiment, we attempted to determine how the redesign influenced the pedagogical processes and outcomes in this specific context of open and distance higher education. The quality control course in the Costa Rican National University of Distance Education was chosen for this design-based research because the course involved multiple pedagogical elements which might illuminate how the changes intended to enhance the course quality influenced students’ learning experiences.

The conceptual framework of the research is described in Figure 1. After reviewing the student survey results compiled after the 2011 course, we redesigned the course structure and content with two guiding theories of cognitive engagement and transactional distance in order to facilitate engagement with learning. More specifically, the assignment structure, facilitation strategies, formats of supplementary face-to-face sessions, and examination contents were redesigned in the line with the two theories. Subsequently, we examined the impact of the design changes in terms of the students’ cognitive engagement and performance as well as knowledge development.

Figure 1

Theoretical Frameworks

Cognitive Engagement

Given complex online learning environments, how distance learners engage in a specific educational circumstance and attendant instructional materials has been posited as a significant research inquiry because learners’ cognitive engagement is pivotal for any distance educational pedagogy. Distance learners’ engagement in and/or commitment to learning has been examined along with diverse pedagogical issues, such as learning effectiveness (Swan, 2003), student satisfaction (Sun, et al., 2008; Shea, Pickett, & Pelz, 2003), learning motivation (Hoskins & Van Hoof, 2005), and learning strategies (Brown, Meyers, & Roy, 2003; Stoney & Oliver, 1999). Cognitive engagement, as a theoretical construct, bridges among those heterogeneous conceptions in explicating how distance learners experience a learning context while accounting for their individual experiences and characteristics (Biggs, 1987). Since “the integration and utilization of students’ motivations and strategies in the course of their learning” are the key to a successful distance education pedagogy (Richardson & Newby, 2006, p. 23), a conceptualization of cognitive engagement in relation to online course design supports effective teaching strategies, high learner motivation, and productive distance education pedagogy.

The term cognitive engagement was first coined by Corno and Mandinach (1983) to investigate students’ learning in relation to the pedagogical process as well as individual characteristics. As cognitive engagement affects the amount and quality of effort that students exert in classroom activities, it indicates the level and/or kind of their motivations (Corno & Mandinach, 1983). Corno and Mandinach (1983) further argued that self-regulated learning is a representative form of cognitive engagement that leads students to a higher level of thinking. The conception of cognitive engagement has been used in various areas, such as literacy (Guthrie, 1996), multimedia (Bangert-Drowns & Pyke, 2001; McLoughlin & Luca, 2000; Stoney & Oliver, 1999), and mathematics (Henningsen & Stein, 2002; Marks, 2000). These primary inquiries encompass cognitive abilities, affective motivations, and learning experiences as defining aspects of students’ cognitive engagement.

In the current study, cognitive engagement was regarded as one significant indicator of students’ learning motivation in the context of open and distance higher education. The students revealed varying amounts and kinds of motivation and strategy in their learning tasks. This phenomenon can be further explained along with the distinction between deep and surface engagement with their learning (Biggs, 1987; Craik & Lockhart, 1972). Deep engagement is associated with intrinsic motive to create a more complex knowledge structure by means of one’s existing knowledge and pedagogical materials (Biggs, 1987; Kardash & Amlund, 1991). On the other hand, surface engagement involves mere memorization, simple reproduction, and other kinds of superficial engagement with learning materials, such as just re-reading textbooks or class notes (Walker, Greene, & Mansell, 2006). Whereas surface engagement frequently results in unmet learner needs or underachievement in learning tasks, deep engagement with learning can be embodied in students’ thoughtful cognitive processing and self-regulatory strategies (Corno & Mandinach, 1983; Greene & Miller, 1996; Wolters & Benzon, 2013). Furthermore, the students’ experience of deep cognitive engagement is more likely to influence their future use of meaningful strategies that they develop through the learning process (Schunk, 1991).

In addition to individual motivation, interaction also plays a crucial role in the students’ engagement with learning. In most educational environments, a classroom culture has a significant impact on the conditions that either restrict or improve certain pedagogical strategies and particular types of interaction among the pedagogical subjects (Edwards & Mercer, 1987). That is, cognitive engagement of students can be influenced by certain teaching strategies and interactions in the educational context (Blumenfeld, Puro, & Mergendoller, 1992). Moore (1989) identified three major categories of interaction in any pedagogical context: learner-teacher, learner-content, and learner-learner. The learning (re)design in this research thus included various strategies to promote interaction among the students (e.g., by changing discussion assignments) as well as between the students and the instructor (e.g., by increasing the number of face-to-face sessions). Interaction between the students and learning content was accounted for through variations in lesson units and reading assignment.

To this end, the changes made to improve students’ cognitive engagement was assessed through course content reviews, such as discussion forums, assignments, and the mid and post self-assessments as well as the Cognitive Engagement/Transactional Distance (CE/TD) survey implemented at the end of the course. Survey questions particularly focused on the themes of e-learning, metacognitive ability, and self-regulation, which were specifically intended to capture transactional distance perceived by the students and to gauge their cognitive engagement in learning.

Theory of Transactional Distance

To further promote various interactions through our course (re)design, the theory of transactional distance (or transactional distance theory) was considered. Moore (1997), the pioneer of this theory, defined transactional distance as “a concept describing the universe of teacher-learner relationships that exist when learners and instructors are separated by space and/or by time” (p. 22). Most importantly, the concept of transactional distance denotes the psychological, rather than physical, distance among the pedagogical subjects. This observation is premised with physical separation between individuals that creates “a psychological and communications space to be crossed, a space of potential misunderstanding between the inputs of instructor and those of the learner” (Moore, 1997, p. 22). One of the fundamental theoretical implications of transactional distance is that an educational exchange among the pedagogical subjects, which is facilitated by educational mediations, can reduce miscommunication or psychological disconnection in order to lead to an effective educational transaction (Shearer, 2009).

In a nutshell, the theory of transactional distance concerns the pedagogical phenomenon of interaction between teachers and learners, or among learners themselves, in the distance educational context primarily influenced by diverse relations between dialogue and structure. More specifically, the structure consists of course design elements, such as learning objectives, activities, assignments, and assessments, whereas dialogue refers to the meaningful communication between the pedagogical subjects. Moreover, the theory accounts for the importance of autonomy, which indicates a learner characteristic in line with the degree of self-control or self-management in learning (Moore, 1997; Shearer, 2009). The theory thus allows us to elucidate how relations among the three fundamental variables in distance educational settings can “describe the extent to which course components can accommodate or be responsive to each learner’s individual need” (Moore & Kearsley, 1996, p. 200).

Even though Gorsky and Caspi (2005) pointed out that few studies had carried out empirical research to test the validity of the theory’s central constructs—dialogue, structure, and learner autonomy—a number of empirical studies have recently utilized the theoretical framework to scrutinize various pedagogical phenomena in online and distance educational settings internationally (e.g., Falloon, 2011; Flowers, White, & Raynor Jr., 2012; Hussein-Farraj, Barak, & Dori, 2012; Larkin & Jamieson-Proctor, 2013; Shaw & Chen, 2012). Goel, Zhang, and Templeton (2012) re-examined the core tenets of transactional distance theory in order to illuminate the congruence between the theory’s face and empirical validities. Their findings attest that the theoretical underpinnings are empirically valid in explaining the participants’ e-learning experiences (Goel, Zhang, & Templeton, 2012).

At a macro level, transactional distance theory helps us to understand how the three variables interact in the context of distance education (Shearer, 2009). As discussed by Moore (1980; 1997) and supported by Saba and Shearer (1994) and Shearer (2009), transactional distance or psychological separation is diminished when dialogue is high and structure is low. However, in the occasion that learners are highly autonomous, low dialogue does not necessarily exasperate the transactional distance. These relationships imply that a high level of dialogue may not always be required by autonomous learners for their effective learning. The relationships among the three variables are visualized in Figure 2.

Figure 2

In the process of designing a distance education course, Moore (1997) listed six fundamental components that could substantially alleviate or aggravate the transactional distance: (1) organizing the presentation of information; (2) supporting the learner’s motivation; (3) stimulating analysis and criticism; (4) giving advice and counsel; (5) arranging practice, application, testing, and evaluation; and (6) arranging for student creation of knowledge. These design elements have commonalities in some epistemological purviews of cognitive engagement, especially in terms of learning motivation and pedagogical strategies. Our research explores connections between design and students’ learning experiences through a redesign of the course as guided by the two theoretical frameworks.

Course Redesign

To examine the relationship between course design and learning processes/outcomes, the research team focused on the review and revision of a hybrid, though mostly online, undergraduate course in engineering developed in line with the two guiding theories.

Educational Settings

The Costa Rican National University of Distance Education was established in 1977. It is a public higher education institution created with a pedagogical model of open and distance education within the national university system of Costa Rica. This open and distance higher education institution generally requires high school diplomas for admission; however, some programs also implement placement tests as they provide professional certificates such as the English/French language teacher certificate and the industrial engineering professional certificate. Because a majority of the students pursue higher education degrees through this open educational opportunity, the institution’s chief goal is to help disadvantaged adult groups participating in higher education. Approximately 3,000 students in diverse social groups are admitted to the institution annually.

This design-based research was conducted with the Quality Control course that is offered in the Agroindustry Engineering program once a year. The overarching course mission is to develop necessary skills for students to use key quality control methods and statistical techniques as well as total quality standards in a variety of food production stages, which leads to constant quality control and improvement. The course involves multiple hands-on activities entailing a high level of statistical exercises. Communication between the instructor and the students in those class activities are very important because students need an effective guide when they face difficulties at a distance. The regular quota enrollment of this course is 30. 31 students registered, and 29 students completed the course in 2011; 26 students registered and completed the course in 2012.

Course Revisions

The Quality Control course consists of four units (see Table 1). The course generally involves four types of evaluation: two exams, case study, a research project (plant tour), and participation (i.e., discussion forums and communications). In the case study, students are asked to present a problem case that a food factory may confront in its production lines, usually related to statistics and control graphs. Students should identify specific non-conformities that might cause the problems and provide adequate resolutions, using either their own experiences or readings. The case study covered 20% of the total grade in both 2011 and 2012. Additionally, students are required to visit food factories for their research projects, which is designed to improve their skills in identifying and analyzing major problems in real industrial context. The research report is expected to clearly demonstrate their observations of the circumstances, specific problems identified, possible solutions based upon statistical analyses, and reflections. While 25% of the total grade was allocated to the research project in 2011, 30% of the total grade was evaluated by the research project in 2012.

Table 1

After the 2011 course provision, the department decided to redesign the quality control course according to two reviewers’ comments and the results of the CE/TD survey. The pedagogical issues identified through these review processes are threefold. First, the course structure needed a revision as the majority of students pointed out problems that stemmed from giving them flexibility to explore broad topics to be covered in the course. This problem led us to rethink the amount of knowledge and information that students must focus on in their learning. Particularly, for those who had less statistical skills and experiences, this problem appeared even more salient. Second, the students highlighted the necessity to promote communications between the instructor and themselves, especially when they had confronted difficulties with the assignments and examinations. Some students at a distance requested a video conference with the instructor to grapple with this issue. Third, more clearly stated guidelines were requested for the assessment activities. In particular, many students reported that the instructions for the research project and exams were so ambiguous that the instructor should have provided more precise and concrete information.

Those issues mainly highlighted the needs for improvement in assignments, communication, facilitation, and assessment. Thus, the course revisions for the 2012 version centered on restructuring the reading assignments, increasing the number of face-to-face classes, employing facilitation strategies through diverse communication channels, and recalibrating the foci of the examinations. The specific changes made between 2011 and 2012 are described in Table 2.

Table 2

Taken together, the design changes for the 2012 course provision were grounded in the two guiding theories of cognitive engagement and transactional distance. The improvements were intended to promote the students’ deep engagement in their learning and to reduce the transactional distance between the instructor and the students.

Methodology

Research Questions

As noted earlier, the research reported in this study drew upon a design-based approach to a Quality Control course in the Costa Rican National University of Distance Education. The primary focus of the investigation was comparing learning experiences and outcomes of two student cohort groups in 2011 and 2012. The course redesign was based upon the cognitive engagement (CE) and transactional distance (TD) frameworks for the purpose of promoting the course quality and student learning. The following research questions informed the research:

Preliminary Findings

The preliminary findings of this research included results from the review of the 2011 course. At the end of the 2011 course, the students’ learning was evaluated by two evaluation methods: (1) final course grades based upon student participation, the case study, the research project, and two written exams and (2) self-evaluation sent to the students in the Moodle platform. Figure 3 describes the range of grades per each assessment in 2011.

Figure 3

Students gained higher scores in the assessments of the forum and the research project, whereas they accomplished relatively low scores in the first and second exams. This analysis highlights the gap between their motivation or cognitive engagement, which is represented by the discussion forum and the research project scores as well as the learning outcomes measured by the written exams. Despite the gap, a positive correlation between cognitive engagement and learning outcomes was observed; that is, the more a student was engaged in the course, the higher scores he/she attained in the exams (Spearman’s rho = 0.78). In total, a third of the students obtained final grades between 71% and 90% in 2011.

In 2012, the students were also required to complete an online self-checklist (Appendix B) where they were asked to reflect upon the improvement of their knowledge and skills in regards to the subject. This self-assessment encompassed three topics (i.e., descriptive and inferential statistics, control graphics and other techniques, and normalization and quality administration) and 13 yes/no question items. In sum, the students marked “yes” on 54% of the question items.

Data Collection and Analysis

This design-based research was adapted to explore the effects of course revisions on students’ cognitive engagement and learning outcomes. Even though the research team used some qualitative data such as reviewers’ comments and course materials in the process of this design-based research, the students’ grades, surveys, and self-assessment conducted in 2012 were three major methods for data collection and analysis.

The participants were distance learners in the Quality Control course in 2011 (n = 31) and 2012 (n = 26). The research team reviewed both versions of the 2011 and 2012 Quality Control course, including instructional content as well as student materials (e.g., discussions, communications, assignments, exams, etc.). The structural changes made for the 2012 course were primarily determined by the review of the 2011 course. Learning outcome measures included scores on each assessment method as well as the final course grades. On the one hand, the first exam measured students’ learning of quality control systems, elementary statistics, and process control graphs, whereas the second exam tested their knowledge about standards, norms, quality engineering, and quality administration. The case study aimed to assess the students’ abilities to apply relevant statistics and process control graphics, and the research project represented the course goal of analyzing the quality management process in a real situation.

In order to evaluate students’ cognitive engagement and experiences of transactional distance, all students were asked to complete the CE/TD survey that was composed of 5-point Likert questionnaires concerning e-learning, course content and structure, facilitation and communication, metacognition and self-regulation, and overall course feedback. This survey was initially validated by a previous study (Andrés, Menacho, & Rey, 2010) that used a Delphi method to select pertinent question items to measure cognitive engagement and transactional distance in the context of distance higher education. Additionally, every student in both 2011 and 2012 was asked to submit the self-assessment of their knowledge and skills developed through this course.

A quasi-experimental approach was employed to compare students’ grades before and after the course revisions. That is, the revisions were posed as the independent variables while the dependent variables were students’ scores in the series of course assessment methods. Additionally, a two-sample t test was applied to the CE/TD survey results (Appendix A) in order to verify if there was a significant difference between 2011 and 2012 (p < 0.0001). The students completed a self-checklist (Appendix B) to measure their own knowledge development at the end of 2012. The statistical program used for the analyses was InfoStat, a free software program last updated on Oct 17, 2010.

Results

Given the small sample size, the students’ cognitive engagement measured by the survey and learning outcomes measured by their performance in each assessment could not be statistically generalized. Nevertheless, descriptive statistics show that students’ cognitive engagement and performance were notably improved after the course redesign (t (30) =22.09, p < 0.0001). In particular, the students perceived that course content and their engagement in the units were significantly improved along with the course revisions (Figure 4).

Figure 4

In terms of students’ performance, the most contiguous difference was observed in Exam 1 and the case study, which supported the revision of the course assignments and the increased number of face-to-face sessions.

Figure 5

Figure 5 indicates students’ average scores in each assessment between 2011 and 2012. Positive influence of the course redesign on the student scores were observed in every assessment except Exam 2. The decreased average scores in Exam 2 could be partially due to the higher-level statistical analysis required for the 2012 exam. The 2011 exam was more theoretical, whereas the 2012 exam had more application-level questions.

Table 3

The final grade mean in 2011 was 6.90, with a standard deviation of 1.93. On the other hand, the final grade mean in 2012 after the redesign was 7.10, with a standard deviation of 2.07. The difference was statistically significant: t(30) =18.19, p<0.0001. In other words, the 2012 course revisions were effective for assessment performance. To this end, the result shows how the revisions oriented toward reducing the transactional distance between the instructor and students as well as promoting students’ cognitive engagement for the 2012 course enhanced the quality of the course.

The result of the self-checklist completed by the 2012 students also reflected this positive impact of the course redesign. Even though the self-checklist is subjective and constructivist by nature, the fact that a majority of the students in 2012 checked off most key subject areas of the course as well understood attests to effective facilitation of students’ development as intended by the design changes. Over 80% of the students answered “yes” to more than 12 out of 16 checklist items, and only 2 student marked “yes” to less than 8 questions. Since the self-checklist was not provided to the students in 2011, this result is not comparable between the two student cohort groups.

In summary, the improvement of the learning processes and outcomes measured by the CE/TD survey and the checklist assessment suggest that interventions aimed to enhance students’ cognitive engagement as well as reduce the transactional distance led to positive learning processes and outcomes in this open and distance higher education context. Therefore, these design-based research findings seem to correspond to the theoretical assumptions of cognitive engagement and transactional distance.

Discussion and Conclusion

Linking online learning design to students’ motivation and learning outcomes is a persistently significant quest for distance education researchers and scholars. To further develop our knowledge regarding these constructs, this study attempted to measure the impact of the course redesign in terms of cognitive engagement and transactional distance as experienced by distance learners in an institution of open and distance higher education. Results of the study indicate that, taken together, the revisions based upon the theories of cognitive engagement and transactional distance could be linked to the improvement of students’ motivation and learning outcomes.

This finding suggests a need to consider the specific implications of the range of educational contexts in which learning in distance higher education takes place. The theory of transactional distance (Moore, 1980) was employed to examine the educational context, especially by accounting for the multiple relationships between learners or between teacher and learners. More specifically, the study exemplifies that the changes in the facilitation strategies and the increased number of face-to-face sessions could lead to improved dialogue, which results in the reduction of psychological distance among the pedagogical subjects and the students’ cognitive engagement in this distance higher education context.

Furthermore, the 2012 revisions oriented toward clarifying learning tasks by changing the structure enhanced learning outcomes. This result might contradict the theoretical assumption of transactional distance, which is grounded in the inverse relation between dialogue and structure in a distance education course (Dron, Seidel, & Litten, 2004). However, as Moore (1977) previously noted the possibility of high dialogue and high structure (as in correspondence programs) or low dialogue and low structure (as in self-directed independent programs), the desired balance between dialogue and structure is only reliable when it is based on the educational sophistication of the learner and the subject content (Moore, 1997). Given the learner characteristics (i.e., mostly part-time distance adult learners and transitioning or returning college students) and the subject content that requires high-level statistical skills and hands-on exercises in the current research, the heightened level of the structure in lessons, assignments, and assessments of the 2012 course had a positive impact on dialogue, which made students feel less transactional distance.

More significantly, “[a] delicate balance between course structure and dialogue of the instructor and learners is critical for online learner success” (Murphy & Cifuentes, 2001, p. 298). Previous studies that investigated the role of course structure in student satisfaction and perceived learning in online learning environments, such as Shea, Pickett, and Pelz (2003) and Stein, Wanstreet, Calvin, Overtoom, and Wheaton (2005), also support reduced transactional distance with high structure and high dialogue. By tightening the structure, the course redesign consequently promoted the level of student motivation and adaptability of content, which resulted in deeper cognitive engagement and richer learning outcomes among the student group.

To sum up, this design-based research reaffirms the strong correlation of less transactional distance with productive learning outcomes recently attested by Benson and Samarawickrema (2009) and Flowers, White, and Raynor (2012). Specifically, this study implies that the learning context for distance higher education is highly dependent on the learning design delicately prepared to support learners’ characteristics as well as dialogue. Since an effective instructional systems design model considers various aspects of the learning context, such as process, systems, outcomes, and delivery (Morrison, Ross, & Kemp, 2010), transactional distance in relation to those heterogeneous design elements can inform future design-based research studies that are similar in context to the one examined in the current research. To this end, drawing upon the lessons that we have obtained through the first cycle of this design-based research, we will investigate how the combination of those multiple pedagogical components can be optimized to reduce the transactional distance in this specific context of open and distance education in the next cycle of course redesign.

References

Andrés, C., Menacho, R., & Rey, A. (2010). Influencia que ejerce el ac¬ceso y dominio de las TIC en la motivación de los estudiantes en tres cursos de la Escuela de Ciencias Exactas y naturales. XV Congreso Internacional de Tecnología y Educación a distancia. San José, Costa Rica: UNED.

Bangert-Drowns, R. L., & Pyke, C. (2001). A taxonomy of student engagement with educational software: An exploration of literate thinking with electronic text. Journal of Educational Computing Research, 24(3), 213–234.

Benson, R., & Samarawickrema, G. (2009). Addressing the context of e-learning: Using transactional distance theory to inform design. Distance Education, 30(1), 5–21.

Biggs, J. B. (1987). Student approaches to learning and studying. Hawthorn, Victoria, Australia: Australian Council for Educational Research.

Blumenfeld, P. C., Puro, P., & Mergendoller, J. R. (1992). Translating motivation into thoughtfulness. In H. H. Marshall (Eds.), Redefining student learning: Roots of educational change (pp. 207–240). Norwood, NJ: Ablex.

Brown, A. L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. The Journal of the Learning Sciences, 2(2), 141–178.

Brown, G., Meyers, C., & Roy, S. (2003). Formal course design and the student learning experience. Journal of Asynchronous Learning Networks, 7(3), 66–76.

Cobb, P. (2001). Supporting the improvement of learning and teaching in social and institutional context. In S. Carver & D. Klahr (Eds.), Cognition and instruction: Twenty-five years of progress (pp. 455–478). Mahwah, NJ: Erlbaum.

Corno, L., & Mandinach, E. B. (1983). The role of cognitive engagement in classroom learning and motivation. Educational Psychologist, 18(2), 88–108.

Craik, F. M., & Lockhart, R. S. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11(6), 671–684.

Dron, J., Seidel, C., and Litten, G. (2004). Transactional distance in a blended learning environment. ALT Journal, 12(2), 163–174.

Edwards, D., & Mercer, N. (1987). Common knowledge: The development of understanding in the classroom. London, England: Methuen.

Falloon, G. (2011). Making the connection: Moore’s theory of transactional distance and its relevance to the use of a virtual classroom in postgraduate online teacher education. Journal of Research on Technology in Education, 43(3), 187–209.

Flowers, L. O., White, E. N., & Raynor, J. E., Jr. (2012). Examining the transactional distance theory in a web-enhanced biology course. Journal of Studies in Education, 2(3), 144–154.

Goel, L., Zhang, P., & Templeton, M. (2012). Transactional distance revisited: Bridging face and empirical validity. Computers in Human Behavior, 28(4), 1122–1129.

Gorsky, P., & Caspi, A. (2005). A critical analysis of transactional distance theory. The Quarterly Review of Distance Education, 6(1), 1–11.

Greene, B. A., & Miller, R. B. (1996). Influences on achievement: Goals, perceived ability, and self-regulation. Contemporary Educational Psychology, 21(2), 181–192.

Guthrie, J. T. (1996). Educational contexts for engagement in literacy. Reading Teacher, 49(6), 432–445.

Henningsen, M. A., & Stein, M. K. (2002). Supporting students’ high-level thinking, reasoning, and communication in mathematics. In J. Sowder and B. Schappell (Eds.), Research, reflection, and practice (pp. 46–61). Reston, VA: National Council of Teachers of Mathematics.

Hoskins, S., & van Hoof, J. (2005). Motivation and ability: Which students use online learning and what influence does it have on their achievement? British Journal of Educational Technology, 36(2), 177–192.

Hussein-Farraj, R., Barak, M., & Dori, Y. J. (2012). Lifelong learning at the Technion: Graduate students’ perceptions of and experiences in distance learning. Interdisciplinary Journal of E-Learning & Learning Objects, 8, 115–135.

Kardash, C. M., & Amlund, J. T. (1991). Self-reported learning strategies and learning from expository text. Contemporary Educational Psychology, 16(2), 117–138.

Larkin, K., & Jamieson-Proctor, R. (2013). Transactional distance theory (TDT): An approach to enhancing knowledge and reducing anxiety of pre-service teachers studying a mathematics education course online. In V. Steinle, L. Ball, & C. Bardini (Eds.), Mathematics education: Yesterday, today and tomorrow. Proceedings of the 36th annual conference of Mathematics Education Research Group of Australasia. Melbourne, VIC: Merga.

Lauzon, A. C. (1992). Integrating computer-based instruction with computer conferencing: An evaluation of a model for designing online education. American Journal of Distance Education, 6(2), 32–46.

Marks, H. M. (2000). Student engagement in instructional activity: Patterns in the elementary, middle, and high school years. American Educational Research Journal, 37(1), 153–184.

McLoughlin, C., & Luca, J. (2000). Cognitive engagement and higher order thinking through computer conferencing: We know why but do we know how? Proceedings from the 9th Annual Teaching and Learning Forum. Retrieved from https://otl.curtin.edu.au/professional_development/conferences/tlf/tlf2000/mcloughlin.html

Moore, M. G. (1977). A model of independent study. Epistolodidaktika, 1, 6–40.

Moore, M. G. (1980). Independent study. In R. Boyd, J. W. Apps, & Associates (Eds.), Refining the discipline of adult education (pp. 16-31). San Francisco, CA: Jossey-Bass.

Moore, M. G. (1989). Three types of interaction. The American Journal of Distance Education, 3(2), 1–6.Moore, M. G. (1997). Theory of transactional distance. In D. Keegan (Eds.), Theoretical principles of distance education (pp. 22–38). New York, NY: Routledge.

Moore, M. G., & Kearsley, G. (1996). Distance education: A systems view. Belmont, CA: Wadsworth.

Morrison, G., Ross, S., & Kemp, J. (2010). Designing effective instruction (6th ed.). New York, NY: John Wiley & Sons.

Murphy, K. L., & Cifuentes, L. (2001). Using Web tools, collaborating, and learning online. Distance Education, 22(2), 285–305.

Richardson, J. C., & Newby, T. (2006). The role of students’ cognitive engagement in online learning. American Journal of Distance Education, 20(1), 23–37.

Saba, F., & Shearer, R. L. (1994). Verifying key theoretical concepts in a dynamic model of distance education. The American Journal of Distance Education, 8(1), 36–59.

Schunk, D. H. (1991). Self-efficacy and academic motivation. Educational Psychologist, 26(3-4), 207–231.

Shaw, J. P., & Chen, J. (2012). Transactional distance and teaching presence in e-learning environments. International Journal of Innovation and Learning, 11(1), 44–59.

Shea, P. J., Pickett, A. M., & Pelz, W. E. (2003). A follow-up investigation of “teaching presence” in the SUNY learning network. Journal of Asynchronous Learning Network, 7(2), 61–80.

Shearer, R. L. (2009). Transactional distance and dialogue: An exploratory study to refine the theoretical construct of dialogue in online learning (Doctoral dissertation). The Pennsylvania State University. University Park, Pennsylvania, USA. Retrieved from https://etda.libraries.psu.edu/paper/10196/5490

Stein, D., Wanstreet, C., Calvin, J., Overtoom, C., & Wheaton, J. (2005). Bridging the transactional distance gap in online learning environments. American Journal of Distance Education, 29(2), 105–118.

Stoney, S., and R. Oliver. (1999). Can higher order thinking and cognitive engagement be enhanced with multimedia? Interactive Multimedia Electronic Journal of Computer-Enhanced Learning, 2(7). Retrieved from http://imej.wfu.edu/articles/1999/2/07/index.asp

Sun, H., Chen, A., Ennis, C. D., Shen, B., & Martin, R. (2008). Conception of ‘‘fun”: Validating sources of situational interest in elementary school physical education. Research Quarterly for Exercise and Sport, 79(1), 62–70.

Swan, K. (2003). Developing social presence in online discussions. In S. Naidu (Ed.), Learning and teaching with technology: Principles and practices (pp. 147–164). London, UK: Kogan.

Swan, K., Mattews, D., Bogle, L., Boles, E., & Day, S. (2012). Linking online course design and implementation to learning outcomes: A design experiment. The Internet & Higher Education, 15(2), 81–88.

The Design-Based Research Collective (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8.

Walker, C. O., Greene, B. A., & Mansell, R. A. (2006). Identification with academics, intrinsic/extrinsic motivation, and self-efficacy as predictors of cognitive engagement. Learning and Individual Differences, 16(1), 1–12.

Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53(4), 5–23.

Wolters, C. A., & Benzon, M. B. (2013). Assessing and predicting college students’ use of strategies for the self-regulation of motivation. The Journal of Experimental Education, 81(2), 199–221.

Appendix A

Quality Control Course CE/TD Survey

Name:

Date:

Questions asking about your experience of this distance education course are categorized into five topic areas as below. Please provide your answers to the questions.

*1: Strongly Disagree, 2: Disagree, 3: Neutral, 4: Agree, and 5: Strongly Agree

Appendix A

Appendix B

Quality Control Course Knowledge Self-Checklist

Name:

Date:

Appendix B

© Joo, Andrés, Shearer