Search

Cost-effectiveness analysis (CEA) provides partners with information for allocating limited budget resources. Challenges in conducting CEAs include collecting data across multiple sources, introducing cost ssumptions, and delivering the results to partners. This paper introduces strategies to address these challenges using the example of the Strengthening Accountability to Reach All Students (STARS) project, a government-implemented differentiated instruction project in Ghana. To implement the programme for one school year, including opportunity costs related to training, the differentiated instruction plus basic management arm cost $48 per child, while the differentiated instruction plus basic and enhanced management training arm cost $84 per child. [ABSTRACT FROM AUTHOR]

Angoff-based standard setting is widely used, especially for high-stakes licensure assessments. Nonetheless, some critics have claimed that the judgment task is too cognitively complex for panelists, whereas others have explicitly challenged the consistency in (replicability of) standard-setting outcomes. Evidence of consistency in item judgments and passing scores is necessary to justify using the passing scores for consequential decisions. Few studies, however, have directly evaluated consistency across different standard-setting panels. The purpose of this study was to investigate consistency of Angoff-based standard-setting judgments and passing scores across 9 different educator licensure assessments. Two independent, multistate panels of educators were formed to recommend the passing score for each assessment, with each panel engaging in 2 rounds of judgments. Multiple measures of consistency were applied to each round of judgments. The results provide positive evidence of the consistency in judgments and passing scores. [ABSTRACT FROM AUTHOR]

This study compared short-form constructed responses evaluated by both human raters and machine scoring algorithms. The context was a public competition on which both public competitors and commercial vendors vied to develop machine scoring algorithms that would match or exceed the performance of operational human raters in a summative high-stakes testing environment. Data (N = 25,683) were drawn from three different states, employed 10 different prompts, and were drawn from two different secondary grade levels. Samples ranging in size from 2,130 to 2,999 were randomly selected from the data sets provided by the states and then randomly divided into three sets: a training set, a test set, and a validation set. Machine performance on all of the agreement measures failed to match that of the human raters. The current study concluded with recommendations on steps that might improve machine-scoring algorithms before they can be used in any operational way. [ABSTRACT FROM AUTHOR]

In the contemporary university the large classes associated with many core units mean that tutorials are often taken by many part-time sessional who are typically employed on a casual basis, paid an hourly rate and not paid to attend the lectures. Given this situation, unit coordinators are often responsible for another phase in curriculum development, namely constructing written tutorial plans that outline the tutorial processes and explicate some of the central ideas and knowledge from the lectures. These plans are designed to be informative for the tutors as well as providing a guide for the teaching and learning in the tutorials. In this paper, using analytical tools made available in Critical Discourse Analysis, I analyse a written tutorial plan as an example of a university curriculum text. The analysis opens up new ways of seeing these texts and for reviewing and critiquing my university teaching practice. [ABSTRACT FROM AUTHOR]

Effective self-reflection is a key component of excellent teaching. We describe the types of self-reflection identified in tutors' reflective statements following a peer observation of teaching exercise. We used an adapted version of the categories developed by Grushka, McLeod and Reynolds in 2005 to code text from 20 written statements as technical (26% of comments), practical (36% of comments) and critical (33% of comments). Tutors also wrote about the affective aspects of the exercise and the majority of such comments were positive. Most tutors reflected in a holistic way about their teaching, noting the importance of getting the technical aspects right while also being concerned about pedagogical matters and issues beyond the classroom. The exercise was an effective way to prompt tutors to reflect on their teaching and helped tutors articulate and formalise their learning from the peer observation activity. Suggestions for further exploration of the reflective practice of tutors are provided. [ABSTRACT FROM AUTHOR]

Student retention in higher education might be prioritised by funding authorities and universities but robust measurement of non-completion is elusive. This investigation explores untapped data sources to enrich understanding of non-completion. The analysis features the main undergraduate course in a part of a large UK university with retention concerns. Three data sources were explored; Registry, course administration and electronic information systems. Discrepancies emerged in data from them, with students' electronic engagement data revealing withdrawal patterns not evident in the other sources. The departures profile revealed by the information systems data is used to conjecture association between type of departure and stage of departure drawing on time-based retention models. The analysis also draws on material from focus groups of course administrators and tutors. The results demonstrate a new way of pinpointing and quantifying non-completion over time, electronic footprint analysis, which provides an additional basis for formulating and monitoring retention strategies. While not explaining why individuals withdraw, they reveal more about when they appear more likely to do so. Using data already captured they constitute feasible means of improving retention. [ABSTRACT FROM AUTHOR]

Collaborative learning through case-based or problem-based learning (PBL) scenarios is an excellent way for students to acquire knowledge and develop decision-making skills. However, the process is threatened by the movement towards more self-directed learning and the migration of students from campus-based to workplace-based learning. Paper-based PBL cases can only proceed in a single direction which can prevent learners from exploring the impact of their decisions. The PREVIEW project, outlined in this article, trialled a replacement to traditional paper PBL with virtual patients (VPs) delivered through a virtual world platform. The idea was that an immersive 3D environment could provide (a) greater realism (b) active decision-making and (c) a suitable environment for collaboration amongst work-based learners meeting remotely. Five VP scenarios were designed for learners on a Paramedic Foundation Degree within the virtual world second life (SL). A player using the MedBiquitous VP international standard allowed cases to be played both within SL and on the web. Three testing days were run to evaluate the scenarios with paramedic students and tutors. Students unfamiliar with the SL environment worked through five PBL scenarios in small groups, shadowed by 'in-world' facilitators. Feedback indicated that the SL environment engages students effectively in learning, despite some technology barriers. Students believed SL could provide a more authentic learner environment than classroom-based PBL. [ABSTRACT FROM AUTHOR]

The article discusses the significance of sport education to achieve an autonomy-supportive fitness curriculum for teachers to achieve their own obstacle- course fitness unit in the U.S. Sport education can be accomplished through integration of direct instruction, cooperative small-group work, and peer teaching. A season planning which was structured on a three-day instructional rotation including teacher instruction, team practice, and team competition is presented. Also discussed are recommendations which might be useful for teachers in promoting autonomy features in sport education.

The article discusses the significant task development that teachers of physical education subject need to follow to achieve active responses from students and to convey the total idea of the subject's content. These methods include celebration which is the appreciation of student performance through a minimal accountability or feedback, and the calibration which refers to the proper sequencing of lessons and subject matter allocated for the particular day. Also presented are examples of tasks in which the celebration and calibration approaches are applied.

In a simulated last-minute test preparation scenario, the authors examined the extent to which practice can influence accuracy of self-assessment, overall test performance, and memory of a familiar knowledge domain. They simulated test preparation by exposing students to practice questions, allegedly from a study guide. The test preparation consisted of either answering questions (retrieval practice) and then checking the correctness of the answers or reviewing questions along with their answers (review-only practice). Immediately after either form of practice, students took a test with questions whose content was conceptually related to the practice test questions. In this study, both forms of practice had a beneficial effect on self-assessment prior to the test and on overall test performance. When the authors examined specific memory responses, they found practice to benefit the frequency of correct responses that students defined as experiences of remembering and knowing. The effect of practice was not modulated by the recency of the acquisition of the domain being tested (at least within the time span of an academic semester). [ABSTRACT FROM AUTHOR]

Standard setting methods such as the Angoff method rely on judgments of item characteristics; item response theory empirically estimates item characteristics and displays them in item characteristic curves (ICCs). This study evaluated several indexes of rater fit to ICCs as a method for judging rater accuracy in their estimates of expected item performance for target groups of test-takers. Simulated data were used to compare adequately fitting ratings to poorly fitting ratings at various target competence levels in a simulated two stage standard setting study. The indexes were then applied to a set of real ratings on 66 items evaluated at 4 competence thresholds to demonstrate their relative usefulness for gaining insight into rater “fit.” Based on analysis of both the simulated and real data, it is recommended that fit indexes based on the absolute deviations of ratings from the ICCs be used, and those based on the standard errors of ratings should be avoided. Suggestions are provided for using these indexes in future research and practice. [ABSTRACT FROM AUTHOR]

Achieving learning standards is at the forefront of current educational philosophy, and is the goal of sound educational practice. That “all children can learn” and there will be “no child left behind” presume that teaching and assessment practices must benefit all children. Agreement in principle is nearly universal. Practical implementation, however, is another matter. One philosophy of learning and instruction that has a long history of targeting instruction and achievement for all students is mastery learning. This article examines (a) fundamental tenets that mastery learning is built upon, (b) the clear connection between learning standards and mastery learning, and (c) how mastery is often erroneously implemented. It then outlines the defining features of mastery and how to implement them. These defining features include developing clear objectives, setting a mastery standard, using criterion-referenced assessments, and grading incentives for students to learn beyond initial mastery. [ABSTRACT FROM AUTHOR]

The article provides information on how educators develop concept-focused teaching. It cites that most common problem in science learning is that educators tend to teach the subject focusing on the topic and not on the concept. As a consequence, educators tend to teach vague ideas to the students and sometimes they tend to miss crucial concepts of the subject. The article provides ways on how teachers could teach science related topics to the students. It further advises educators that they should teach the students beyond the objectivity of science.

The authors examined how the regular use of Monte Carlo Quizzes, learning logs, or non-random quizzes impacted student completion of assigned reading and preparedness for class. A questionnaire was used to gather data on student perceptions and self-reported reading behavior in response to each of the methods over the course of a semester. Results suggested that students in classes that used the learning log method were more motivated to complete readings, felt better able to contribute to class discussions, and were more likely to recommend the assessment method than students in classes that used the other methods. [ABSTRACT FROM AUTHOR]

This article presents a study in which applications were integrated in the Multivariable Calculus course at the Technion in the framework of supplementary tutorials. The purpose of the study was to test the opportunity of extending the conventional curriculum by optional applied problem-solving activities and get initial evidence on the possible impact of the tutorials on students' beliefs about the value of learning mathematics with applications. The study lasted three semesters and consisted of three experiments in which supplementary tutorials were offered in different forms: a weekly evening meeting for interested students, a weekly extra hour added to the conventional calculus class, and a workshop which introduces mathematics concepts from the application perspective. The study reveals: (1) significant positive effect of the tutorials on the students' beliefs (in all three experiments); (2) statistically significant advantage of the group involved in the tutorials in relation to the group that learned in the conventional way (second experiment); (3) students' positive evaluation of the workshops for better understanding the course lectures (third experiment). Grounding on the study experience, we propose for further discussion a stage model of the applied problem solving cycle. [ABSTRACT FROM AUTHOR]

The purpose of this study was to evaluate the moderating effects of learning-teaching fit and cross-cultural differences on the relationships between expatriate training and training effectiveness. Survey methodology was adopted to obtain data from the opinions of expatriates in foreign companies within Taiwan and China. Quantitative data analyses were adopted to answer the study research questions. Results of this study revealed that perceived needs for expatriate training have significant impacts on the training effectiveness of expatriates. The level of fit between the expatriate's learning style and the instructor's teaching method, and the degree of perceived cross-cultural differences between parent country and host country could moderate the effectiveness of expatriate training. These results implied that expatriates who perceived higher levels of fit between their learning styles and instructor teaching method, perceived lower cross-cultural differences and perceived higher demand for training tended to achieve higher training effectiveness. [ABSTRACT FROM AUTHOR]

This paper outlines a model for online course design aimed at the mainstream majority of university academics rather than at the early adopters of technology. It has been developed from work at Coventry Business School where tutors have been called upon to design online modules for the first time. Like many good tools, the model's key strength is its simplicity, but this simplicity springs from an extensive application of current theoretical thinking on the pedagogy of networked collaborative e-learning. The model forces consideration of some of the key features of online design, and steers the designer away from creating the impoverished online learning experience that can result from an undue emphasis on course content alone. The paper builds on the work of Fowler and Mayes (2000) by examining the underpinning theory surrounding three basic ingredients of an online learning experience and the crucial role played by dialogue and discussion within a social constructivist paradigm of learning. [ABSTRACT FROM AUTHOR]

This study investigates the study orientations of students in a two-year follow-up in two Finnish universities that had different tutoring systems. Both universities offered tutoring of first-year students by senior students, but one also offered tutoring by staff members. The study orientations of students were assessed on the basis of their responses to 77 statements covering four domains: learning approaches, conceptions of learning, regulation processes, and general study orientations. Results showed that students tutored by staff (n = 70) were more self-regulated and put greater emphasis on practical knowledge and cooperation in learning than did students who did not have staff tutoring (n = 55). Differences between the groups suggest that the staff-tutoring system was positively related to students' study orientations. [ABSTRACT FROM AUTHOR]

This paper presents an illustration of how the regression-discontinuity design can be used to obtain an unbiased estimate of the causal effect of participating in a university remedial English program on first-year grade point average. First-year grade point averages were collected for 197 first-time, full-time university students, along with the scores they received on an English placement examination, and a measure of remedial program assignment. Regression discontinuities indicate that first-year grade point averages were approximately 0.392 points higher for students who participated in a remedial English program as compared to equivalent students who did not participate in the remedial program. We also present various threats to validity and limitations of the regression-discontinuity design. [ABSTRACT FROM AUTHOR]

This article examines how frequency of assessment impacts learning in an undergraduate biology course employing a student-centered, active-learning pedagogy. Student performance on course assessments was slightly better under the high-frequency versus traditional examination schedule. Lack of a statistically significant difference in achievement, in contrast to previous studies, may be a consequence of the format of the assessments. Frequent assessment also appeared to have altered the predictive relationship between the GPA of a student and their performance in this course. In general, students perform best on factual-recall-type assessments compared to assessments that require higher order thinking skills, independent of the examination schedule. The conclusion from this study is that the most effective pedagogy is one that combines student-centered, active-learning with frequent assessment.

A percentage of students believe that the final exam is the signal to forget what was taught in prerequisite classes. This can be a serious problem when subsequent courses rely on this information. However, with some imagination and time, an instructor can create an hypermedia tutorial for review that students actually might enjoy using. Hypermedia applications are not used widely in many disciplines, but are accepted readily by a generation of students raised on television, and are an effective method for presenting different types of information and providing both supplemental and remedial information to students. The author discusses hypermedia and provides several ideas that could be developed into hypermedia supplements for marketing classes. In addition, he discusses an application used in an upper division class and presents student reaction. The author concludes with a brief discussion of hardware, software, and lime commitment required to develop hypermedia applications. [ABSTRACT FROM AUTHOR]

The article focuses on formative assessment probes in the Uncovering Student Ideas in Science series of the National Science Teachers Association (NSTA). Types of materials students think interact with magnets will be determined under the formative assessment probe Can You Pick It up With a Magnet?.

The article discusses the content for high school art courses in the U.S. It is stated that high school preparation for the advanced study encountered in college may stop the student by ignoring fundamental principles. It is suggested to avoid too difficult techniques although ignoring the technical difficulties of some mediums can also lead to the misguidance of creative activity. A core curriculum for instruction should include painting, sculpture, drawing, design and art history. The mediums that should be used must be simple to handle and capable of spontaneous expression and sustained development.

Introduction: The ability to deliver the traditional apprenticeship method of teaching clinical skills is becoming increasingly more difficult as a result of greater demands in health care delivery, increasing student numbers and changing medical curricula. Serious consequences globally include: students not covering all elements of clinical skills curricula; insufficient opportunity to practise clinical skills; and increasing reports of graduates’ incompetence in some clinical skills. Methods: A systematic Structured Clinical Coaching Program (SCCP) for a large cohort of Year 1 students was developed, providing explicit learning objectives for both students and paid generalist clinical tutors. It incorporated ongoing multi-source formative assessment and was evaluated using a case-study methodology, a control-group design, and comparison of formative assessment scores with summative Objective Structured Clinical Examination (OSCE) scores. Results: Students demonstrated a higher level of competence and confidence, and the formative assessment scores correlated with the Research students’ summative OSCE scores. SCCP tutors reported greater satisfaction and confidence through knowing what they were meant to teach. At-risk students were identified early and remediated. Discussion: The SCCP ensures consistent quality in the teaching and assessment of all relevant clinical skills of all students, despite large numbers. It improves student and teacher confidence and satisfaction, ensures clinical skills competence, and could replace costly OSCEs. [ABSTRACT FROM AUTHOR]