Evaluation of a Novel Biochemistry Course-Based Undergraduate Research Experience (Cure)

Course-based Undergraduate Research Experiences (CUREs) have been described in a range of educational contexts. Although various learning objectives, termed anticipated learning outcomes (ALOs) in this project, have been proposed, processes for identifying them may not be rigorous or well-documented, which can lead to inappropriate assessment and speculation about what students actually learn from CUREs. Additionally, evaluation of CUREs has primarily relied on student and instructor perception data rather than more reliable measures of learning. This dissertation investigated a novel biochemistry laboratory curriculum for a Course-based Undergraduate Research Experience (CURE) known as the Biochemistry Authentic Scientific Inquiry Lab (BASIL). Students participating in this CURE use a combination of computational and biochemical wet-lab techniques to elucidate the function of proteins of known structure but unknown function. The goal of the project was to evaluate the efficacy of the BASIL CURE curriculum for developing students' research abilities across implementations. Towards achieving this goal, we addressed the following four research questions (RQs): RQ1) How can ALOs be rigorously identified for the BASIL CURE; RQ2) How can the identified ALOs be used to develop a matrix that characterizes the BASIL CURE; RQ3) What are students' perceptions of their knowledge, confidence and competence regarding their abilities to perform the top-rated ALOs for this CURE; RQ4) What are appropriate assessments for student achievement of the identified ALOs and what is the nature of student learning, and related difficulties, developed by students during the BASIL CURE? To address these RQs, this project focused on the development and use of qualitative and quantitative methods guided by constructivism and situated cognition theoretical frameworks. Data was collected using a range of instruments including, content analysis, Qualtrics surveys, open-ended questions and interviews, in order to identify ALOs and to determine student learning for the BASIL CURE. Analysis of the qualitative data was through inductive coding guided by the concept-reasoning-mode (CRM) model and the assessment triangle, while analysis of quantitative data was done by using standard statistical techniques (e.g. conducting a parried t-test and effect size). The results led to the development of a novel method for identifying ALOs, namely a process for identifying course-based undergraduate research abilities (PICURA; RQ1; Irby, Pelaez, & Anderson 2018b). Application of PICURA to the BASIL CURE resulted in the identification and rating by instructors of a wide range of ALOs, termed course-based undergraduate research abilities (CURAs), which were formulated into a matrix (RQs 2; Irby, Pelaez, & Anderson, 2018a,). The matrix was, in turn, used to characterize the BASIL CURE and to inform the design of student assessments aimed at evaluating student development of the identified CURAs (RQs 4; Irby, Pelaez, & Anderson, 2018a). Preliminary findings from implementation of the open-ended assessments in a small case study of students, revealed a range of student competencies for selected top-rated CURAs as well as evidence for student difficulties (RQ4). In this way we were able to confirm that students are developing some of the ALOs as actual learning outcomes which we term VLOs or verified learning outcomes. In addition, a participant perception indicator (PPI) survey was used to gauge students' perceptions of their gains in knowledge, experience, and confidence during the BASIL CURE and, therefore, to inform which CURAs should be specifically targeted for assessment in specific BASIL implementations (RQ3;). [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]