Search

Research on assessment in the field of doctoral education remains an underexplored domain, particularly concerning the preconfirmation or probationary stage of candidature, when attrition is at its highest. We propose that the use of rubrics in this preconfirmation stage has the potential to improve feedback literacy and overall progression to completion. While rubrics have been commonplace in undergraduate education for over two decades, their application in doctoral education remains rare. While it has been argued that the variability in doctoral assessment may not align with rubrics, customizing discipline-specific rubrics could provide clarity for students and supervisors, helping them better understand the expectations and standards. A review of existing studies on the use of rubrics in doctoral education highlights the need for further research in this area. We conclude by raising the overarching research question of whether rubrics have a place in doctoral education at the preconfirmation or probationary stage of candidature. [ABSTRACT FROM AUTHOR]

Background: The analytical rubric serves as a permanent reference for guidelines on clinical performance for undergraduate dental students. This study aims to assess the rubric system used to evaluate clinical class II composite restorations performed by undergraduate dental students and to explore the impact of gender on overall student performance across two academic years. Additionally, we investigated the relationship between cumulative grade point averages (CGPAs) and students' clinical performance. Methods: An analytical rubric for the assessment of clinical class II composite restoration in the academic years of 2022/2023 and 2023/2024 was used by two evaluators. These two evaluators were trained to use the rubric before doing the evaluations. The scores were based on a 4-point scale for the evaluation of five major parameters for pre-operative procedures (10 points), cavity preparation (20 points), restoration procedures (20 points), and time management (4 points). At the same time, chairside oral exam parameter was 15 points based on a 5-point scale. Descriptive statistics were calculated for the different analytical rubric parameters, and the independent t-test was used to compare the scores between the student groups and the evaluators. Other tests, such as the Kappa test and Pearson's correlation coefficient, were used to measure the association among CGPA, evaluators, and gender participants. Results: The overall score out of 69 slightly increased for females/males (61.28/59.42) and (61.18/59.49) in the 2022/2023 and 2023/2024 academic years, respectively, but the differences were not statistically significant. In the 2022/2023 academic year, female students scored significantly higher than male students in pre-operative procedures, as evaluated by both evaluators (p = 0.001), and in time management, as assessed by both evaluators (p = 0.031). The Kappa test demonstrated a moderate to substantial level of agreement between the two evaluators in both academic years. Strong and significant correlations were noted between students' CGPA and some tested parameters (p = 0.000). Conclusion: The overall performance was very good and high among both genders, but it was marginally higher among females than among males. This study found some differences in performance between male and female students and variability in the evaluations by the two raters ranging from moderate to substantial agreement and similar performances for students with different CGPA. [ABSTRACT FROM AUTHOR]

This research aimed to develop formative assessment rubrics for enhancing students' performance on Thai percussion instruments using the Many-Facet Rasch Measurement Partial Credit model (MFRM-PCM). Samples were high-school students playing four types of Thai instruments and the raters who were qualified and properly trained. The research instrument was rubrics used for assessing students' Thai percussion instruments skills. Each item contained five quality levels. The research methodology was divided into three phases, that is, the synthesis and verification of content validity, pre-testing of the psychometric properties and the assessment design, and the verification of the rubrics' psychometric properties. Four facets of the MFRM-PCM including students, raters, musical instruments, and items facet were employed to analyze the psychometric properties of the developed rubrics. It was found that the rubrics developed for assessing performances of Thai percussion instruments with the MFRM-PCM contained eight criteria and 12 items. The quality levels of the items after the category's effectiveness analysis were reduced ranging from two to three quality levels. [ABSTRACT FROM AUTHOR]

Abstract Background The analytical rubric serves as a permanent reference for guidelines on clinical performance for undergraduate dental students. This study aims to assess the rubric system used to evaluate clinical class II composite restorations performed by undergraduate dental students and to explore the impact of gender on overall student performance across two academic years. Additionally, we investigated the relationship between cumulative grade point averages (CGPAs) and students’ clinical performance. Methods An analytical rubric for the assessment of clinical class II composite restoration in the academic years of 2022/2023 and 2023/2024 was used by two evaluators. These two evaluators were trained to use the rubric before doing the evaluations. The scores were based on a 4-point scale for the evaluation of five major parameters for pre-operative procedures (10 points), cavity preparation (20 points), restoration procedures (20 points), and time management (4 points). At the same time, chairside oral exam parameter was 15 points based on a 5-point scale. Descriptive statistics were calculated for the different analytical rubric parameters, and the independent t-test was used to compare the scores between the student groups and the evaluators. Other tests, such as the Kappa test and Pearson’s correlation coefficient, were used to measure the association among CGPA, evaluators, and gender participants. Results The overall score out of 69 slightly increased for females/males (61.28/59.42) and (61.18/59.49) in the 2022/2023 and 2023/2024 academic years, respectively, but the differences were not statistically significant. In the 2022/2023 academic year, female students scored significantly higher than male students in pre-operative procedures, as evaluated by both evaluators (p = 0.001), and in time management, as assessed by both evaluators (p = 0.031). The Kappa test demonstrated a moderate to substantial level of agreement between the two evaluators in both academic years. Strong and significant correlations were noted between students’ CGPA and some tested parameters (p = 0.000). Conclusion The overall performance was very good and high among both genders, but it was marginally higher among females than among males. This study found some differences in performance between male and female students and variability in the evaluations by the two raters ranging from moderate to substantial agreement and similar performances for students with different CGPA.

This study focuses on the organisations in the people care sector (OPCs), encompassing a broad spectrum of activities ranging from essential healthcare services to various aspects of daily living support. Sustainability in OPCs encompasses multiple dimensions aimed at ensuring the long-term viability, efficiency, and effectiveness of services provided to vulnerable populations. Given the critical role of digital technologies in enhancing the operational efficiency within such organisations and their sustainability, it becomes imperative to gauge their digital maturity levels. To establish a robust framework for assessing the digital maturity of OPCs, we identified 29 factors grouped into five clusters that encapsulate various dimensions of digital readiness that directly influence the sustainability of OPCs. We employed the SNAP methodology to ascertain the relative significance of these factors and clusters. Furthermore, each factor was articulated through the lens of digital maturity using the rubrics approach, offering a nuanced understanding of the OPCs' digital readiness across four distinct levels. Experts from the people care sector, IT, and multi-criteria decision-making contributed invaluable input during the instrument's development phase. Theoretical validation of the instrument involved focus group discussions with domain experts, while practical validation entailed applying the instrument to real-world case studies. The instrument enables OPCs to assess their digital maturity levels, providing valuable strategic planning and decision-making insights. Furthermore, the instrument can serve as a roadmap for identifying areas ripe for digital transformation and weak points, facilitating continuous improvement and future readiness. The quantification of the digital maturity of the OPC enables the OPCs to rank at the cluster maturity level and overall maturity level. Overall, this instrument represents a significant step towards enhancing digital maturity assessment within the OPC sector, contributing to its evolution and adaptation in the digital age, and enabling the OPCs' sustainability. [ABSTRACT FROM AUTHOR]

For many first-year engineering students, their first calculus or pre-calculus courses can be a substantial barrier for initial success and persistence to subsequent engineering courses. One approach that may mitigate this challenge for some students is to support their development as stronger metacognitive learners – learning how to self-evaluate and improve based on informed feedback. A structured mathematical problem-solving rubric designed to offer feedback on how to develop and communicate mathematical solutions to engineering problems can be a helpful tool to support metacognitive development. After a semester of careful and systematic instruction, practice, and use of such a rubric in engineering calculus courses, we found significant improvement in pre-calculus students' metacognitive awareness. A median split analysis showed that for both calculus and pre-calculus courses, the lower metacognitive half of each class improved significantly in their metacognitive abilities, as was the intent for the rubric. Students reported an overwhelmingly positive perception of the value of the rubric for their own learning, and the subset of calculus I students who improved in their sophistication of rubric use had significantly higher (12.5%) final exam scores compared to those who did not improve. [ABSTRACT FROM AUTHOR]

Constructed-response questions (CRQs) require effective marking schemes to ensure that the intended learning objectives and/or professional competencies are appropriately addressed, and valid inferences regarding examinee competence are drawn from such assessments. While the educational literature on writing rubrics has proliferated in recent years, this is largely targeted at classroom use and formative purposes. There is comparatively little guidance on how to develop appropriate marking schemes for summative assessment contexts. The different purposes mean that different principles and practices apply to mark schemes for examinations. In this article, we draw on the educational literature as well as our own practical experience of working with medical and health professional educators on their questions and marking schemes to offer 12 key principles or tips for designing and implementing effective marking schemes. [ABSTRACT FROM AUTHOR]

Assessment is a central feature of teaching and learning. It is both complex and challenging in ordinary times, and these aspects are magnified in an online learning environment. Given its central role, it is crucial that its design and purpose is rigorous and robust. This paper presents justification for using interactive oral assessment as an online, innovative, authentic assessment approach that prepares students for professional life, combats plagiarism and promotes academic integrity. It shares findings through four brief case study examples of using interactive oral assessments in computing, education, French literature, and aviation. This study also demonstrates the value of a Community of Practice in developing expertise, confidence, and resources to support the effective application of interactive oral assessment. [ABSTRACT FROM AUTHOR]

"It takes more than intelligence to act intelligently". An education that enriches and kindles the thinking ability of a person and ignites not only the knowledge but also the skills and attitude to draw to an innovative conclusion with holistic development is termed Whole Person Education (WPE). A framework for achieving a 360-degree development of a student is devised and used. This framework consists of 14 indicators that are mapped with the Graduate Attributes (GA) defined by NBA. These 14 indicators include research, advanced studies, industry interactions, publications, IPR, sports, and other life skills such as communication, leadership skills, teamwork, and character building. [ABSTRACT FROM AUTHOR]

This study aims to explore the effects of pre-service teachers' use of rubric in self-assessment with instructor feedback on academic achievement and self-regulated learning. Their perceptions and experiences of the self-assessment intervention were also investigated. A total of 79 pre-service teachers participated in the study. A mixed methods approach was used as a blend of experimental and qualitative design. The quasi-experimental research model with pretest/posttest control group design was employed in the quantitative phase of the study. The pre-service teachers (N = 79) were assigned to either use of rubric in self-assessment involving tutor feedback condition or a non-self-assessment condition for their essay assignments. Besides, the pre-service teachers' perceptions and experiences of using self-assessment with instructor feedback were explored in the qualitative phase of the study. Data were collected using a rubric, an achievement test, a self-regulation in learning subscale and reflective journals. The results indicated that the rubric used in self-assessment with instructor feedback group had higher achievement and use of self-regulated learning strategies than the no-intervention group. The reflective journals also revealed that most of the pre-service teachers found the self-assessment a useful learning tool. They felt that it helped them to improve their learning by guiding them to set their own goals, monitor their progress and reflect on their learning through their own tasks. The implications for educational research and practice are discussed. [ABSTRACT FROM AUTHOR]

Rubrics are an assessment framework commonly employed in higher education settings; however, students can engage with and perceive them to be used in a variety of ways and with varying degrees of success. The aim of this research project was to explore these perceptions, to better understand how rubrics might be used to support students more effectively to successful academic outcomes. Fourteen interviews were conducted over a period of fourteen months, and four themes were identified: rubric introductions; rubric content (including language and format); student rubric use and the role of rubrics in how work is assessed. Findings were considered from thematic perspectives of the student participants. Conclusions drawn focus on the quality of classroom discussion when rubrics are introduced, the practical application of rubrics as a writing or planning tool, the need for detail and clarity in language use and explicit links between feedback and rubrics. Overall, effective engagement with rubrics appears to reduce student anxiety. [ABSTRACT FROM AUTHOR]

This meta-analysis explores the effect of using scoring rubrics on self-efficacy and self-regulation in K-16 formal learning settings and its potential moderators. From the literature, we identified 14 relevant experimental or quasi-experimental primary studies conducted with a total of 2793 students. We retrieved 17 effect sizes for self-efficacy and 18 effect sizes for self-regulation outcomes from the primary studies. Rubric use has a statistically significant moderate to large positive effect on students’ self-efficacy (Hedges’ g = 0.39) and self-regulation (Hedges’ g = 1.00). Large within- and -between study variability of effect sizes is common: self-efficacy (Hedges’ g: −.06; 2.47) and self-regulation (Hedges’ g: −1.17; 3.30). We found no significant moderation of the effect of rubric use by students’ level of education, providing feedback, or instruction using the rubric, whereas there is evidence of an effect of rubrics on self-efficacy and self-regulation, variability of theoretical approaches, measures, and implementation quality raise questions about best practices for rubric development and use. [ABSTRACT FROM AUTHOR]

When reviewing the literature relating to what instructors of qualitative research courses are teaching in their courses, we found a gap regarding qualitative faculty's motivations behind what they teach and whether they use teaching tools such as rubrics in their assessment practices. We utilized general qualitative methods to explore and describe how instructors of qualitative methodology courses conceptualize and design interview-based assessments. By conducting structured interviews with five faculty members, we embraced interpretivist descriptive traditions and sought to obtain thick, rich descriptions of each participant's perspectives and experiences. After coding interview transcripts, we created themes to represent participant beliefs that (a) interview assignments are the most appropriate and comprehensive way to assess knowledge of qualitative research, (b) the design and/or use of rubrics for these assignments is complicated within qualitative coursework, and finally, that (c) thorough feedback is the most important aspect of providing high-quality instruction in qualitative research methods. We then summarize our findings and argue that with creative application and further research, qualitative faculty can benefit from the use rubrics to assess interview assignments in qualitative methods courses. [ABSTRACT FROM AUTHOR]

Abstract Introduction Peer assessment can enhance understanding of the simulation-based learning (SBL) process and promote feedback, though research on its rubrics remains limited. This study assesses the validity and reliability of a peer assessment rubric and determines the appropriate number of items and raters needed for a reliable assessment in the advanced cardiac life support (ACLS) context. Methods Ninety-five third-year medical students participated in the ACLS course and were assessed by two teachers (190 ratings) and three peers (285 ratings). Students rotated roles and were assessed once as a team leader on a ten-item rubric in three domains: electrocardiogram and ACLS skills, management and mechanisms, and affective domains. Messick’s validity framework guided the collection of validity evidence. Results Five sources of validity evidence were collected: (1) content: expert reviews and alpha, beta, and pilot tests for iterative content validation; (2) response process: achieved acceptable peer interrater reliability (intraclass correlation = 0.78, p = 0.001) and a Cronbach’s alpha of 0.83; (3) internal structure: demonstrated reliability through generalizability theory, where one peer rater with ten items achieved sufficient reliability (Phi-coefficient = 0.76), and two raters enhanced reliability (Phi-coefficient = 0.85); construct validity was supported by confirmatory factor analysis. (4) Relations to other variables: Peer and teacher ratings were similar. However, peers rated higher in scenario management; further generalizability theory analysis indicated comparable reliability with the same number of teachers. (5) Consequences: Over 80% of students positively perceived peer assessment on a 5-point Likert scale survey. Conclusion This study confirms the validity and reliability of ACLS SBL rubrics while utilizing peers as raters. Rubrics can exhibit clear performance criteria, ensure uniform grading, provide targeted feedback, and promote peer assessment skills.

This research paper employs an exploratory framework to evaluate the potential of ChatGPT as an Automated Writing Evaluation (AWE) tool in teaching English as a Foreign Language (EFL) in Thailand. The main objective is to investigate how well ChatGPT can assess students’ writing using prompts and pre-defined rubrics compared to human raters. Moreover, the study examines its strengths and weaknesses as an assessment tool by analysing the teachers’ reflections during the assessment process. Quantitative analyses revealed significant relationships between trial accounts in comparison with the human ratings. Qualitative analysis unearths patterns in the feedback, shedding light on ChatGPT’s strengths and its limitations as an AWE tool. ChatGPT displays substantial promise as an AWE tool, offering distinct features such as human-like interface, consistency, efficiency, and scalability. Nonetheless, educators must be cognisant of its limitations. This study recognises that the strategic use of ChatGPT could enhance the evaluation process among teachers and foster the development of EFL students’ written communication skills. [ABSTRACT FROM AUTHOR]

In response to evolving engineering education, there is a growing focus on fostering students’ practical skills. This study implemented a Mini Project Based Learning (MPBL) approach within the Computer Integrated Manufacturing (CIM) course. The tasks involved SOLIDWORKS modelling, writing CNC code using CADEM seeNC Turn software, and hands-on CNC machining by students. Quantifiable outcomes demonstrated the development of students’ CNC expertise. Numerical evidence showcased a significant increase in academic performance, with the percentage of students scoring over 80 marks rising from 33.33% in the previous academic year (CAY-M1) to an impressive 45.83% in the current academic year (CAY), highlighting the positive impact of MPBL. MPBL improved comprehension and enhanced critical thinking, collaboration, creativity, and communication skills. Its integration in CIM sparked creative enthusiasm among students and educators. Effective evaluation tools played a pivotal role in elevating project results, ensuring a holistic learning experience that integrated theory and engineering design. [ABSTRACT FROM AUTHOR]

Copyright of Journal of Technology & Chinese Language Teaching is the property of Middle Tennessee State University and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

An effective evaluation of a bachelor's thesis (BT) needs the use of valid tools such as rubrics. There are few studies providing a validation of rubrics for these theses and even fewer in the academic field of food science and technology; hence the aim of this study was to validate a rubric for the assessment of relevant competencies in the BT. Ninety‐seven students presented their thesis and 56 teachers participated as members of the committees. The degree of relevance, suitability, and clarity of the rubrics were assessed as well as the relationship between student perception and academic performance and the congruence between the teacher's and students' evaluations. The content validity index and intraclass correlation coefficient (ICC) were calculated. Students had a moderate level of knowledge about rubrics, but they mostly agreed with the premise that the rubrics are an accurate tool to assess the quality of BTs. Teacher's and student's marks mostly aligned. No significant relationship was found between the positive perception of rubric's validity and the final grades. Regarding clarity, suitability, and relevance as perceived by teachers, the used rubrics were highly valued. The ICC of criteria indicated that the rubrics were valid in the studied terms. Hence, the validation of a food science and technology degree BT assessment system based on a rubric has been achieved. Supporting Information Practical Application: The conclusions drawn from this research could enable teachers at other universities to use this methodology for validating their rubrics for bachelor's theses. Furthermore, they could use this validated rubric to evaluate projects presented at their respective institutions. [ABSTRACT FROM AUTHOR]

Graduate admissions committees in Europe have a challenging task of selecting students from an increasingly large pool of candidates with diverse application files. Graduate standardized testing can ease the comparison of application files. The purpose of this study was to examine whether the Graduate Record Examinations (GRE) is predictive of several dimensions of graduate success on English-taught research masters' programs in science, technology, engineering, and mathematics at a large European university. The data from 167 masters' students were collected. Hierarchical regression analyses were conducted. All GRE scales predicted Graduate Grade Point Average. Individual GRE scales predicted internship grade and supervisors' assessments of students' research performance and the content of their research report. None of the individual GRE scales predicted supervisors' assessments of students' practical skills, but the three GRE scales taken together improved the explanatory power of the model. The structure and style of students' research reports was not predicted by the GRE. All relationships were held after accounting for socioeconomic status. Overall, the GRE appeared as a reasonable predictor of graduate study success. Both the benefits and drawbacks of the implementation of the GRE in European masters' programs are discussed, as well as the legal limitations. [ABSTRACT FROM AUTHOR]

In the methodologies for evaluation the use of rubrics as a specific tool for competences assessment (Cortoni & Lo Presti, 2018) is supported by a wide research tradition, especially in the pedagogical field, that has circumscribed their application within dynamic learning contexts (Davidson, 2005). In didactic-educational environments, the administration of self-assessment rubrics can accompany and assist the learning process of students, stimulating in them the acquisition of critical self-reflection skills and drawing attention to those fields of experience that are traditionally connected to the teacher's evaluative sphere (performance assessment, learning tasks, innovative teaching processes, etc.) (Dawson, 2015). In the research The Social Impact Assessment of DaD after COVID-19, promoted and funded by Sapienza University of Rome, combining tools for competences self-assessment (rubrics) and participatory research techniques (focus groups) has been particularly fruitful since it has helped students discuss the main changes experienced because of the pandemic regarding: i. learning styles; ii. leisure activities; iii. relationships with classmates and teachers. Combined with online participatory techniques, rubrics have maintained their nature as a non-reactive tool (Ametrano et al., 2001). In particular, the dialogic dimension generated by the focus group has made possible to neutralize the distorting effects associated with the concept of performance, preventing respondents from providing answers conditioned by social desirability. This has made possible to focus the discussion on specific aspects of the individual's experience, making the scoring process more closely aligned with the lived experience. [ABSTRACT FROM AUTHOR]

Abstract Background The development of procedural skills is essential in health sciences education. Rubrics can be useful for learning and assessing these skills. To this end, a set of rubrics were developed in case of neurophysiotherapy maneuvers for undergraduates. Although students found the rubrics to be valid and useful in previous courses, the analysis of the practical exam results showed the need to change them in order to improve their validity and reliability, especially when used for summative purposes. After reviewing the rubrics, this paper analyzes their validity and reliability for promoting the learning of neurophysiotherapy maneuvers and assessing the acquisition of the procedural skills they involve. Methods In this cross-sectional and psychometric study, six experts and 142 undergraduate students of a neurophysiotherapy subject from a Spanish university participated. The rubrics’ validity (content and structural) and reliability (inter-rater and internal consistency) were analyzed. The students’ scores in the subject practical exam derived from the application of the rubrics, as well as the rubrics’ criteria difficulty and discrimination indices were also determined. Results The rubrics´ content validity was found to be adequate (Content Validity Index > 0.90). These showed a unidimensional structure, and an acceptable internal consistency (α = 0.71) and inter-rater reliability (Fleiss’ ƙ=0.44, ICC = 0.94). The scores of the subject practical exam practically covered the entire range of possible theoretical scores, showing all the criterion medium-low to medium difficulty indices - except for the one related to the physical therapist position-. All the criterion exhibited adequate discrimination indices (rpbis > 0.39), as did the rubric as a whole (Ferguson’s δ = 0.86). Students highlighted the rubrics´ usefulness for learning the maneuvers, as well as their validity and reliability for formative and summative assessment. Conclusions The changed rubrics constitute a valid and reliable instrument for evaluating the execution quality of neurophysiotherapy maneuvers from a summative evaluation viewpoint. This study facilitates the development of rubrics aimed at promoting different practical skills in health-science education.

AbstractRubrics play a crucial role in shaping educational assessment, providing clear criteria for both teaching and learning. The advent of online rubric platforms has the potential to significantly enhance the effectiveness of rubrics in educational contexts, offering innovative features for assessment and feedback through the creation of erubrics. This study presents a comprehensive analysis of 19 online rubric platforms structured around five research questions (RQs) examining the general platform features, rubric design features, rubric implementation features, identifying the stronger online rubric platforms available, and investigating if the platforms support the creation and implementation of erubrics. Our analysis of the design features revealed varying levels of customisation and flexibility across platforms, crucial for effective assessment. Regarding implementation features, we found a mix of online and offline capabilities, with a limited number of platforms offering more advanced features (e.g. collaborative options). Through a detailed scoring system, we identify the platforms that lead innovation in design and implementation. Unfortunately, the vast majority of platforms do not support features for the creation of erubrics. We provide a detailed list of implementation recommendations for teachers, researchers, and platform designers (Appendix F). [ABSTRACT FROM AUTHOR]

This article describes the outcomes of a faculty partnership between a math professor and a composition professor to improve the final paper in a research-focused senior capstone math course. Much attention has been paid in recent years to the importance of undergraduate research experiences and how to best create and support such endeavors. However, little space has been dedicated to helping math faculty design and scaffold writing assignments to support their students' development as scholars. We describe how our partnership took place, the changes we made to existing assignments and the creation of new ones, and an assessment of our efforts completed by an interdisciplinary group of faculty and students, which showed marked improvement in the areas of information literacy, critical thinking, and quality of writing. [ABSTRACT FROM AUTHOR]

It is widely acknowledged in research that common criteria and aligned standards do not result in consistent assessment of such a complex performance as the final undergraduate thesis. Assessment is determined by examiners' understanding of rubrics and their views on thesis quality. There is still a gap in the research literature about how analytic and holistic judgments are made and how they are integrated in decisions about the final grade. This interview study aims to identify the sources of inconsistency in analytic and holistic assessment. Ten examiners assessed three final undergraduate theses from a primary school teacher education programme at a Swedish university. The analytic assessment focused on two parts: theoretical framework and academic language style, which revealed inconsistencies in assessment. The analysis of the holistic assessment showed how examiners weighted different dimensions of the thesis and how they made judgements for the final grade awarded. The findings reveal several sources of inconsistency, such as examiners' own constructs, their interpretations and expectations about students' ability to manage academic work. The study calls for further discussion about whether it is possible to make criterion-based assessment reliable. [ABSTRACT FROM AUTHOR]

This article considers starting with an existing SIMIODE modeling scenario [Winkel, B. (2015). 1-031-CoolIt-ModelingScenario. SIMIODE (Version 2.0). QUBES Educational Resources. ] that develops Newton's law of cooling by considering data on the cooling of a beaker of water in a room, and expanding upon it to create a longer project modeling the temperature of a building with an internal heat pump that is also subject to a sinusoidal varying outside temperature. The proposed project was undertaken early on in the course, since little background was required, and a longer project format was utilised so that students could return to the project and see direct applications of new concepts, such as autonomous vs. nonautonomous ordinary differential equations, slope fields, and Euler's method as they were introduced. The project prompt is provided as well as a detailed discussion of the motivation behind the questions. Finally, the pros and cons of requiring the students to submit a written lab report for the project are reflected upon and a sample rubric is provided. [ABSTRACT FROM AUTHOR]

A qualitative study was conducted in a secondary school to evaluate student learning processes and outcomes by examining their inquiry questions, journals, and maker artifacts in a curriculum-based maker learning environment supported by the Guided Inquiry Design (GID). Thirteen 8th-grade students in a suburban middle school in the southwest of the United States participated in the study. Inquiry questions, maker artifacts, and inquiry journals were collected and analyzed with rubrics that were developed based on a critical review of literature drawn from different bodies of literature. The objectives of this study were three-fold: (1) evaluate the quality of students' inquiry questions and maker artifacts, (2) assess students' internal knowledge representation (IKR) and external knowledge representation (EKR), and (3) develop a robust and valid assessment framework for maker learning considering students' expertise development over time. The findings revealed that the students progressed at different developmental levels; therefore, expertise development should be incorporated into the assessment framework for maker learning. This study also implied that scaffolding should be tailored to meet special needs of each student in a maker learning environment. The originality of this research is that the assessment framework takes into account individuals' development and progress towards expertise over time, instead of focusing on their learning outcomes at a specific time point. An additional value of this study is that the tools and supporting materials that serve as instructional scaffolds also serve as tools to collect evidence about student learning performance, processes, and outcomes. [ABSTRACT FROM AUTHOR]

In the Foreign Language (FL) classroom, video description and dubbing have recently been introduced for the development of communicative skills in various types of didactic methods (Vermeulen and Ibáñez 2014, 2017; Talaván 2020; Ávila-Cabrera and Rodríguez-Arancón 2021). This paper offers an innovative didactic proposal of Audio Description (AD) in the English for Tourism (ET) classroom. It supports the hypothesis that authentic tasks enhance communicative skills in LSP (Language for Specific Purposes) education (Melnichuk et al. 2017). It presents a quasi-experimental study of student performance in two different productive tasks (writing and speaking). The study follows a Task-Based Learning (TBL) approach and addresses a group of 119 students within an undergraduate program of ET (B2 level) at a Spanish distance-education university (UNED). As a post-task, a twofold rubric, designed in a previous teaching project, scored and analyzed student writing and speaking responses to an AD script of a mute video about a touristic place of their choice. Results show that implementing an AD task in the LSP classroom had a positive effect on students’ marks in their final test. In addition, the number of students who completed the writing task was around 50% greater than those who completed the speaking task. Introducing ICT tools in the LSP classroom seems to be positive, and it will be argued that developing digital technologies, such as mobile apps, may be a necessary step to foster future professionals’ language performance and competences.

ABSTRACTThe historical roots of what is now a modern Swedish school-age educare (SAEC) were formed from a social pedagogical starting point in which children’s social development, freedom and well-being were prioritized. SAEC has now become more focused on an educational pedagogical assignment and has been incorporated into the Swedish curriculum. SAECs could therefore be seen as institutions under reconstruction, in that their current work is formed in what can be regarded as a transition period. This transition could imply new points of departure concerning work practices and forms of documentation, both of that could challenge older traditions. Using policy enactment theory as a methodology, this case study discusses the work practices and forms of documentation that are in use now, with a specific focus on the latter. The main purpose of the article is to explore and develop SAEC staff’s points of departure for developing their documentation and assessments and how the new curriculum assignment is enacted in the context of SAEC’s pedagogical practices. The study’s findings show that the enactment process could be seen as an initiative based on local needs for clarity. The developed documentation and assessment practices are described as a cultural shift away from former practices.

This article investigates the knowledge of secondary school students about immunity and vaccines, using an open-ended questionnaire along with its evaluation rubric. Thus, the rubric includes four response categories for each question, whose meanings reveal the kinds of ideas held by the students. The qualitative results obtained show ideas that are not very consistent with the referent learning model for immunity; however, an analysis of Rasch shows articulated knowledge, which is evidence through the unidimensionality of the measurements obtained. This suggests the possibility of using them as a guide to a possible progression itinerary that facilitates student learning over the course of their education. These results not only have implications at a theoretical and classroom practice levels, but also entail the validation of the rubric constructed for use with this student population. [ABSTRACT FROM AUTHOR]

Despite being widely applied, the implementation of problem-based/project-based learning (PBL) activities still poses several challenges. Activity design and evaluation and monitoring processes stand out as the most complex aspects of the methodology. This study provides support for teachers to improve PBL assessment and monitoring systems in the scientific and technical field. To do this, the evaluation and monitoring tools used in the most representative PBL activities at different levels of higher education were collected. These were then integrated to generate new, more complete tools (three rubrics and two evaluation scales). These tools were then appli0ed to PBL activities, and the teachers involved (n=11) assessed their view of their functioning. The results indicate that the participating teachers perceived that the tools generated in this way functioned better than the ones used originally, highlighting their completeness, adaptability and ease of use. The study suggests that support in the design of tools could lead to improvements in the process of monitoring and evaluating PBL activities by making them more agile, objective, systematic and efficient. [ABSTRACT FROM AUTHOR]

Value for money poses the question, "What is good resource use?" It is often answered with a narrow economic analysis that does not adequately address what diverse people value. We suggest new principles and methods that may help evaluators answer the question better. First, we define value for money, which sits at the intersection of evaluation and economics. Next, we make the case for a holistic assessment of value for money that evaluators can conduct with tools they already have, like rubrics. We introduce three principles that further align value for money with evaluation: value depends on the credibility of estimates; things do not have value, people place value on things; and people value the same things differently. Together, they suggest evaluators should arrive at multiple, possibly conflicting conclusions that represent diverse value perspectives. We demonstrate how this may be done using a value-for-money rubric to improve resource allocation for impact. [ABSTRACT FROM AUTHOR]

A challenge instructors face is developing and accurately assessing technical communication skills to ensure students can apply and transfer the skills from the academic context into the context of engineering practice. By intentionally balancing teaching transferrable communication skills relevant to engineering practice and evaluating student understanding, engineering educators can foster competence and prepare students for the expectations of their professional careers. This study addresses two questions: (1) how can chemical engineering instructors reliably and consistently assess student communication skills. and (2) are instructor expectations aligned with those of practicing engineers? The use of welldesigned rubrics is important for setting clear expectations for students. providing constructive feedback, and in team taught courses, grading consistently. This study discusses how a rubric for assessing technical communication skills in senior-level chemical engineering laboratory reports was validated and demonstrated reliability across five chemical engineering instructors. Additionally, five industry partners evaluated student reports for comparison to instructor rubric scores. Expectations and perceptions of the quality of student work align between instructors and practicing engineers, but practicing engineers prioritized safety and abstract clarity, while instructors prioritized the students' abilities to interpret results and draw conclusions. [ABSTRACT FROM AUTHOR]

Copyright of Miscelánea: A Journal of English & American Studies is the property of Miscelanea: A Journal of English & American Studies and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)