175,955 results on '"measurement"'
Search Results
2. Professional Collaboration among Elementary School Teachers in Lesson Study
- Author
-
Adriana Richit, João Pedro da Ponte, and Mauri Luís Tomkelski
- Abstract
Professional teacher collaboration, a fundamental characteristic of lesson study, has been pointed out as a principle of teacher personal and professional growth. This article aims to describe and analyze the development of professional collaboration in a lesson study, highlighting the main stages of this process. The investigation involved six elementary school teachers of Brazilian public schools, in planning, observing, and reflecting on a lesson on the curriculum topic of length measure at grade 4. The participants worked collaboratively planning a lesson about this topic. The methodology is qualitative, with data collected by records and field notes of sessions, conversations, and interviews. The analyses pointed out three remarkable stages of the development of professional collaboration, which constituted the categories of analysis: recognition of collaboration, development of collaboration, and valuing collaboration. The results show that the professional collaboration that developed during the lesson study was facilitated by the dynamics of the different steps of this process and, especially, by the relationship between participants and teacher educators. Collaboration emerged from the activities of planning, teaching, observing, and reflecting on the lesson, and was valued given the encouragement and strengthening of the group insofar as teachers felt confident, encouraged, and welcomed in the group.
- Published
- 2024
3. Universal Design and K-12 Academic Assessments: A Scoping Review of the Literature. NCEO Report 442
- Author
-
National Center on Educational Outcomes (NCEO), Council of Chief State School Officers (CCSSO), Applied Engineering Management Corporation (AEM), Center for Parent Information & Resources (CPIR), National Association of State Directors of Special Education (NASDSE), WestEd, Kristin K. Liu, Martha L. Thurlow, Mari Quanbeck, Jessica A. Bowman, and Amy Riegelman
- Abstract
This report summarizes an investigation of literature published in 1985-2023 on universal design (UD) of large-scale assessments. State education agencies, K-12 assessment vendors, teacher trainers, and classroom teachers are increasingly applying the principles of UD to the instruction and assessment of students from special populations. In theory, UD ensures that instruction and assessment are created from the beginning to be accessible to the widest population of students possible. Yet, it is unclear how these UD frameworks and their associated principles and elements are being applied, or even which UD framework is used. This obscurity and lack of defined UD principles in the research literature creates obstacles in research replication and in identification of evidence-based practices. This scoping review identifies how the concept of UD has been applied to the broad range of U.S. district and state large-scale academic assessments. We included literature on the application of UD to the broad range of K-12 district and state large-scale academic assessments in the U.S.
- Published
- 2024
4. Impact Story: Implementing Statewide Systems -- Formative Assessment in Missouri
- Author
-
Region 12 Comprehensive Center (R12CC)
- Abstract
Research suggests that students who participate in formative assessment perform better on measures of academic achievement than students who do not. To raise school and systematic performance, teachers need access to high-quality, rigorous tools designed to provide timely and individualized feedback for student learning. According to a report published in 2023 by the Missouri Department of Elementary and Secondary Education (DESE), 58% of third grade students are reading at only a basic or below basic level, based on 2022-2023 state assessment results. The Region 12 Comprehensive Center (R12CC), in collaboration with DESE, is working to implement a statewide common formative assessment (CFA) system, referred to as the Formative Assessment Builder. The CFA system will provide Missouri educators with equitable access to common formative assessments for student learning in the area of Grade 2 literacy as they prepare for the transition to 3rd grade instruction and high stakes assessments. The CFA system is an online portal hosted by DESE that provides access to professional learning modules and supporting materials. The portal will store assessment items created, vetted, and uploaded by DESE. All Missouri teachers and administrators will have free, unlimited, and direct access to the system. This report examines how the CFA system is an integral tool that will benefit both teachers in their instruction and students in their learning.
- Published
- 2024
5. Finite Complement Clauses in Disciplinary Research Articles Authored by Filipino Academic Writers
- Author
-
Hjalmar Punla Hernandez
- Abstract
Finite complement clauses (FCCs) are an understudied syntactic structure of L2 advanced academic writing. The present study cross-investigated FCCs in qualitative (QUALI) and quantitative (QUANTI) research articles written by Filipino academic writers (FAWs) in Applied Linguistics (APPLING), Communication (COMM), and Measurement and Evaluation (MEEV). Specifically, it determined the FCCs with the most occurrences across five disciplinary research article sub-registers and identified whether these FCCs differ significantly in terms of frequencies of use. With Hernandez's (2021) framework adapted from Biber and Gray's (2016) study, this research analyzed five FCCs in 42 disciplinary research articles. Major results revealed that verb-controlled that-clauses (with 33.69 as normalized frequency count) outnumbered other FCCs in research article sub-registers across disciplines. They were more recurrent in QUALI and QUANTI APPLING research articles (7.91 and 7.54, respectively) and QUANTI and QUALI COMM research articles (7.34 and 6.96, respectively) than in QUANTI MEEV research articles (3.94). In addition, a significant difference exists between them and other FCCs at the p<0.05 level in terms of frequencies of use. In view of these findings, it can be concluded that verb-controlled that-clauses are the most useful FCCs in APPLING, COMM, and MEEV research articles. Likewise, FAWs across the three disciplines write more informally as signposted by their repeated use of that complementizer with these FCCs controlled by verbs. The study draws its implications for academic writing instruction.
- Published
- 2024
6. Unravelling the Nexus between Human Values and Competencies to Religion among Educational Stakeholders in Mauritius Using Structural Equation Modelling
- Author
-
Shakeel M. C. Atchia
- Abstract
Religion has been associated with human values and competencies needed to shape young people into responsible citizens able to make a positive difference in the lives of others. However, this correlation remains dependent on the context. As the correlation has not yet been investigated in Mauritius, which is a multicultural and multi-ethnic country, this study aims to bridge this knowledge gap using a purely positivist epistemological approach. It will analyze the Mauritius-specific data derived from a public data set which was part of the "Mapping the Terrain" project to examine the correlation between religion and a broad set of human values and competencies, namely forgiveness, individualistic orientation, collectivistic orientation, self-efficacy, problem-solving, meaning-making, sense of belongingness, religiosity/spirituality, hope, life satisfaction, gratitude, emotion, regulation, empathy, and self-regulation. The descriptive analysis and the Structural Equation Model (SEM), developed using the SPSS and AMOS software, revealed that (i) independent of ethnic group, educational stakeholders in Mauritius have a high affinity to most of the human values and competences, and (ii) as compared with others, the Muslim community has a slightly lower affinity to forgiveness, life satisfaction, individualistic orientation, self-efficacy, and problem solving. These data, which represent important baseline information needed to inform policymakers and other educational stakeholders, were used to derive a set of recommendations that will further the development of the key human values and competencies needed to promote harmony in a multicultural and multi-ethnic country.
- Published
- 2024
7. A Systematic Literature Review on it Governance Mechanisms and Frameworks
- Author
-
Merve Hatice Karatas and Hüseyin Çakir
- Abstract
Nowadays, it is not common to come across sectors that can work and succeed without using information technology (IT). IT has now become a part of organizations' management and strategic decision-making mechanisms. Therefore, organizations make serious investments to develop software and system infrastructures and transfer business processes to digital environments such as cloud technologies. So, they get business resilient while they gain opportunities of spreading their business activities to wide stakeholders and customers. Here it is essential to provide assurance that an organization evaluates, develops, implements, maintains, disposes of its IT systems and manages life cycle of all information and information technology systems properly on all physical and logical environments. However, the most important matter is that an organization's objectives are met by the management practices of its information systems. While organizations carry out their digital transformation at a dizzying speed, organizations should be protected from material and moral damages such as loss of money, loss of commercial confidential information, loss of reputation by protecting the confidentiality, integrity and accessibility of the information assets they own and also comply with legal legislations such as the protection of personal data and intellectual property rights. In order to achieve this, organizations benefit from one or more frameworks, standards or directives that are suitable for their own structures and needs, separately or by integrating them. However, the most important point in this transformation process is the transition of organizations from IT management understanding to IT governance. In other words, IT has now become a part of the strategic decision-making mechanism by rising from the level of support tool to carry out business processes in organizations. When we search the academic literature, frameworks and standards, it is seen that the key elements of IT governance are structures, processes and relational mechanisms. If these three components are set up correctly and fit the organization, it can be assured that IT aligns with and supports the objectives of the organizations and that effective IT governance is achieved in every kind of organizations. In this research, databases such as Web of Science, IEEE, and SCOPUS are scanned and found articles are reviewed in order to make a literature review on IT Governance Mechanisms and Frameworks. Results are evaluated and discussed. By the way, suggestions for further studies were made and advanced researches were shed light on.
- Published
- 2024
8. A Comprehensive Study on Evaluating and Mitigating Algorithmic Unfairness with the MADD Metric
- Author
-
Melina Verger, Chunyang Fan, Sébastien Lallé, François Bouchet, and Vanda Luengo
- Abstract
Predictive student models are increasingly used in learning environments due to their ability to enhance educational outcomes and support stakeholders in making informed decisions. However, predictive models can be biased and produce unfair outcomes, leading to potential discrimination against certain individuals and harmful long-term implications. This has prompted research on fairness metrics meant to capture and quantify such biases. Nonetheless, current metrics primarily focus on predictive performance comparisons between groups, without considering the behavior of the models or the severity of the biases in the outcomes. To address this gap, we proposed a novel metric in a previous work (Verger et al., 2023) named "Model Absolute Density Distance" (MADD), measuring algorithmic unfairness as the difference of the probability distributions of the model's outcomes. In this paper, we extended our previous work with two major additions. Firstly, we provided theoretical and practical considerations on a hyperparameter of MADD, named "bandwidth," useful for optimal measurement of fairness with this metric. Secondly, we demonstrated how MADD can be used not only to measure unfairness but also to mitigate it through postprocessing of the model's outcomes while preserving its accuracy. We experimented with our approach on the same task of predicting student success in online courses as our previous work, and obtained successful results. To facilitate replication and future usages of MADD in different contexts, we developed an open-source Python package called maddlib (https://pypi.org/project/maddlib/). Altogether, our work contributes to advancing the research on fair student models in education.
- Published
- 2024
9. Development and Validation of a Reliable and Valid Assessment Tool for Measuring Innovative Thinking in Vocational Students
- Author
-
Peeraya Sukkeewan, Noawanit Songkram, and Jaitip Nasongkhla
- Abstract
The objective of this study was to develop a measure that possesses both reliability and validity in order to evaluate innovative thinking within the realm of education. To achieve this, the instrument's validity and reliability were evaluated through quantitative methods in two distinct phases. A team of educational experts conducted the process of establishing content validity and ensuring that the items on the instrument accurately reflected the intended constructs of creative thinking. Following that, the assessment of concept validity was conducted using confirmatory factor analyses. The aforementioned investigations resulted in the discovery of a five-factor solution consisting of 25 elements, all of which demonstrated scores beyond the crucial threshold. This successful outcome confirmed the presence of distinct factors representing different dimensions of innovative thinking. The study enrolled 1250 students from vocational education institutions as participants. The data obtained from the participants was subjected to principal component analysis and confirmatory factor analysis, leading to the development of a model that exhibited a good match with the empirical data. This indicated the effectiveness of the developed instrument in measuring innovative thinking capacity. In conclusion, the research effectively developed an accurate and dependable tool for evaluating innovative thinking in the realm of education. The gathering of positive data from the participants and meticulous quantitative analyses were responsible for this.
- Published
- 2024
10. Examining 5th Grade Students' Learning on Surface Area Calculations with Realistic Mathematics Education Approach
- Author
-
Elif Ertem Akbas and Lütfiye Yildirm
- Abstract
The fact that the mathematics course is abstract, that it is not possible to associate it with daily life, and that it is impossible to concretize abstract expressions causes a prejudice against the this course and leads to a decrease in the academic achievements of students. It is seen that throughout history, various studies have been carried out taking this situation into consideration. A group of these studies is on realistic mathematics education. Realistic mathematics education is an approach that aims to concretize the abstract concepts of mathematics by relating them to real-life situations. The purpose is to make mathematics more understandable by concretizing it. In the study, the subject of calculating the surface area of prisms with the use of realistic mathematics education was taught, and the purpose of the study was to examine the effects of this application. The study group consisted of 20 5th grade students. While determining this group, maximum variety sampling strategy was preferred. In the study, action research, one of the qualitative research methods, was used, and the data were interpreted with the help of descriptive analysis and content analysis. The data collection tools in the study included semi-structured interview forms, video recordings, photos and activity sheets prepared by the students under the guidance of the researcher in accordance with the realistic mathematics education approach. When the findings were examined, it was seen that the students showed a positive development in the meaning and visualization processes; that they could reach mathematical inferences on their own; that they enjoyed the mathematics lesson; and that the realistic mathematics education approach gave positive results on learning. Based on these results, it was suggested that not only the application of the realistic mathematics education approach for different acquisitions but also the inclusion of these activities in the textbooks in accordance with the curriculum will result in improvements in favor of learning.
- Published
- 2024
11. Looking Back to Move Forward
- Author
-
Digital Promise, Empirical Education Inc., Jeremy Roschelle, and Adam Schellinger
- Abstract
SEERNet digital learning platforms (DLPs) are developing new infrastructure to support research in authentic contexts where student learning is happening. In order to contextualize this work within the larger field, we trace historical precedents along four main categories: data repositories, data collection services, research design interfaces, and research communities. By situating this innovative movement alongside its predecessors, we can identify the opportunities for SEERNet and others to progress and sustain the mission of making research more scalable, equitable, and rigorous.
- Published
- 2024
12. Investigation of Preschoolers' Mathematical Skills: A Systematic Literature Review
- Author
-
Antonia Petropoulou, Konstantinos Lavidas, and Stamatis Papadakis
- Abstract
Background/purpose: Awareness of the mathematical skills and knowledge children possess in their early years is widely accepted. This includes various common positive aspects, not only for educators but also for researchers and policymakers. This study presents a systematic review conducted to meticulously identify empirical studies published in the Scopus-Index Journal database about the mathematical skills children aged 3 to 8 years old have mastered. Materials/methods: This review followed the PRISMA guidelines and the research database comprised of Scopus-indexed journals. The technique followed used "keywords" and Boolean operators. The screening processes included reviewing abstracts, scanning complete texts of published articles, and rejecting those not meeting preset inclusion criteria. Moreover, systematic reviews, meta-analyses, and papers not written in English were also excluded. Of the 801 studies initially identified, a total of 15 empirical studies were included in the systematic review. Results: Children master various math skills from a very young age, mainly in "numbers and operations", but face difficulties in skills related to "algebra" as well as "geometry and measurement". Additionally, several preschoolers' characteristics help to explain the acquisition of these skills, with "age" being the primary factor. Researchers use various research instruments and mainly conduct individual semi-structured interviews. Children's geometry skills and knowledge appear to have been studied to a small extent. The areas of "measurement" and "data analysis and probability" were found to be under active investigation. Conclusion: It is worth noting that not only does a noticeable research gap exist for the math domains of "measurement," "geometry," and "data analysis and probability". Factors that seem to affect young children's math skills, such as "gender", "parents' educational level", and "attendance to a preparatory preschool" need further investigation. The implications of the current study's results extend beyond academia, providing valuable insights that educators and policymakers can leverage to enhance the quality of mathematics education during the early years period.
- Published
- 2024
13. Quantifying Quality: The Impact of Measures of School Quality on Children's Academic Achievement across Diverse Societies
- Author
-
Bruce S. Rawlings, Helen Elizabeth Davis, Adote Anum, Oskar Burger, Lydia Chen, Juliet Carolina Castro Morales, Natalia Dutra, Ardain Dzabatou, Vivian Dzokoto, Alejandro Erut, Frankie T. K. Fong, Sabrina Ghelardi, Micah Goldwater, Gordon Ingram, Emily Messer, Jessica Kingsford, Sheina Lew-Levy, Kimberley Mendez, Morgan Newhouse, Mark Nielsen, Gairan Pamei, Sarah Pope-Caldwell, Karlos Ramos, Luis Emilio Echeverria Rojas, Renan A. C. dos Santos, Lara G. S. Silveira, Julia Watzek, Ciara Wirth, and Cristine H. Legare
- Abstract
Recent decades have seen a rapid acceleration in global participation in formal education, due to worldwide initiatives aimed to provide school access to all children. Research in high income countries has shown that school quality indicators have a significant, positive impact on numeracy and literacy--skills required to participate in the increasingly globalized economy. Schools vary enormously in kind, resources, and teacher training around the world, however, and the validity of using diverse school quality measures in populations with diverse educational profiles remains unclear. First, we assessed whether children's numeracy and literacy performance across populations improves with age, as evidence of general school-related learning effects. Next, we examined whether several school quality measures related to classroom experience and composition, and to educational resources, were correlated with one another. Finally, we examined whether they were associated with children's (4-12-year-olds, N = 889) numeracy and literacy performance in 10 culturally and geographically diverse populations which vary in historical engagement with formal schooling. Across populations, age was a strong positive predictor of academic achievement. Measures related to classroom experience and composition were correlated with one another, as were measures of access to educational resources and classroom experience and composition. The number of teachers per class and access to writing materials were key predictors of numeracy and literacy, while the number of students per classroom, often linked to academic achievement, was not. We discuss these results in the context of maximising children's learning environments and highlight study limitations to motivate future research.
- Published
- 2024
- Full Text
- View/download PDF
14. Control-Value Theory: From Achievement Emotion to a General Theory of Human Emotions
- Author
-
Reinhard Pekrun
- Abstract
In its original version, control-value theory describes and explains achievement emotions. More recently, the theory has been expanded to also explain epistemic, social, and existential emotions. In this article, I outline the development of the theory, from preliminary work in the 1980s to early versions of the theory and the recent generalized control-value theory. I provide summaries of the theory's evidence-based propositions on antecedents, outcomes, and regulation of emotions, including the fundamentally important role of control and value appraisals across different types of human emotions that are relevant to education (and beyond). The theory includes descriptive taxonomies of emotions as well as propositions explaining (a) the influence of individual factors, social environments, and socio-cultural contexts on emotions; (b) the effects of emotions on learning, performance, and health; (c) reciprocal causation linking emotions, outcomes, and antecedents; (d) ways to regulate emotions; and (e) strategies for intervention. Subsequently, I outline the relevance of the theory for educational practice, including individual and large-scale assessments of emotions; students', teachers', and parents' understanding of emotions; and change of educational practices. In conclusion, I discuss strengths of the theory, open questions, and future directions.
- Published
- 2024
- Full Text
- View/download PDF
15. Measuring Autism-Associated Traits in the General Population: Factor Structure and Measurement Invariance across Sex and Diagnosis Status of the Social Communication Questionnaire
- Author
-
Laura Hegemann, Ragna Bugge Askeland, Stian Barbo Valand, Anne-Siri Øyen, Synnve Schjølberg, Vanessa H. Bal, Somer L. Bishop, Camilla Stoltenberg, Tilmann von Soest, Laurie J. Hannigan, and Alexandra Havdahl
- Abstract
Autism screening questionnaires are sometimes used as a measure of "autism-associated traits" in samples drawn from the general population, even though such tools are primarily developed and designed for use in samples of children diagnosed with or being assessed for autism. Here, we explore the psychometric properties of the Social Communication Questionnaire (SCQ) current version reported at age 8 in a large population-based sample. Using data from the Norwegian Mother, Father and Child Cohort study (MoBa), we perform exploratory (N = 21,775) and confirmatory (N = 21,674) factor analyses on items and compare our results with previously suggested factor structure models of the SCQ. Furthermore, we test for measurement invariance across sex and registry-ascertained autism diagnostic status (N[subscript diagnosed] = 636). A 5-factor model provided best fit to the data in both children with and without autism diagnoses, though with some qualitative differences in what the factors represent across these groups. This model performed largely consistently across boys and girls in the general population. Taken together, the SCQ's measurement properties must be carefully considered when it is used in population-based samples and measurement invariance testing of other autism screening tools used in similar contexts is warranted.
- Published
- 2024
- Full Text
- View/download PDF
16. Effects of Stair-Climbing Exercise on Health-Related Physical Fitness Measures in Children with Developmental Disabilities
- Author
-
Lin Wen-Li, Chien-Lin Lin, and Chin-Kai Lin
- Abstract
Children with developmental disabilities lack sufficient physical activity in their daily lives. The purpose of this study was to see if children with developmental disabilities who participated in stair-climbing exercises had better physical performance and health status than children with developmental disabilities who did not. This study adopted a pre-and-post-test experimental design, enrolling 30 subjects (experimental group, 15; control group, 15) with developmental disabilities aged 5-7 years from pediatric rehabilitation treatment departments of two regional teaching hospitals in Taiwan. The experimental group received stair-climbing exercises and physical therapy twice a week for eight consecutive weeks. The primary outcomes were health-related physical fitness assessment items, including body composition (body mass index: BMI), cardiorespiratory fitness (stair-climbing test), muscular fitness (knee-bend sit-ups), and flexibility (Chair Sit and Reach Test). The post-test measurements of BMI, cardiorespiratory fitness, sit-ups, and muscular flexibility of children in the experimental group were significantly better than the pre-test measurements. The stair-climbing exercise training results for cardiorespiratory fitness, muscular fitness, and muscular flexibility in the experimental group were significantly better than those in the control group. Stair-climbing exercise improves the physical fitness of children with developmental disabilities. The results of this study suggest that children with developmental disabilities should be encouraged to engage in this convenient and easy stair-climbing exercise to improve physical performance and health status.
- Published
- 2024
- Full Text
- View/download PDF
17. Comparing RMSEA-Based Indices for Assessing Measurement Invariance in Confirmatory Factor Models
- Author
-
Nataly Beribisky and Gregory R. Hancock
- Abstract
Fit indices are descriptive measures that can help evaluate how well a confirmatory factor analysis (CFA) model fits a researcher's data. In multigroup models, before between-group comparisons are made, fit indices may be used to evaluate measurement invariance by assessing the degree to which multiple groups' data are consistent with increasingly constrained nested models. One such fit index is an adaptation of the root mean square error of approximation (RMSEA) called RMSEA[subscript D]. This index embeds the chi-square and degree-of-freedom differences into a modified RMSEA formula. The present study comprehensively compared RMSEA[subscript D] to [delta]RMSEA, the difference between two RMSEA values associated with a comparison of nested models. The comparison consisted of both derivations as well as a population analysis using one-factor CFA models with features common to those found in practical research. The findings demonstrated that for the same model, RMSEA[subscript D] will always have increased sensitivity relative to [delta]RMSEA with an increasing number of indicator variables. The study also indicated that RMSEA[subscript D] had increased ability to detect noninvariance relative to [delta]RMSEA in one-factor models. For these reasons, when evaluating measurement invariance, RMSEA[subscript D] is recommended instead of [delta]RMSEA.
- Published
- 2024
- Full Text
- View/download PDF
18. Advancing Research on Career Sustainability
- Author
-
Jeffrey H. Greenhaus, Gerard A. Callanan, and Gary N. Powell
- Abstract
Interest in sustainable careers has grown substantially in recent decades as a host of external and personal forces has increasingly disrupted individuals' continued employment or diminished the quality of their experiences at work. However, there is a lack of consensus regarding the definition and measurement of career sustainability that limits our understanding of the career sustainability process. In this article, we propose a definition that we believe represents the essence of career sustainability and make recommendations regarding the assessment of the construct. We then present a research agenda that includes a framework to guide research on the career sustainability process and identifies areas where future research attention is warranted. We conclude with a discussion of the implications of the framework for counseling practice.
- Published
- 2024
- Full Text
- View/download PDF
19. Current Trends in Math Anxiety Research: A Bibliometric Approach
- Author
-
Luna Radevic and Ilija Milovanovic
- Abstract
The aim of this study was to investigate current trends in research of math anxiety (MA) through bibliometric perspective. Three main clusters were formed based on author keywords: cognitive correlates (working memory, attention, numerical cognition, mental arithmetic), psychological factors and effects (self-concept and self-efficacy, motivation, confidence, attitudes), and educational context (PISA, measurement, gender differences, math achievement, math education, assessment). Analysis of the index keywords revealed somewhat different organization with two dominant clusters: the experimental cluster in which the most frequent are psychophysiological measures and terms and the correlational cluster in which the topics of MA psychosocial factors are most represented. The map of bibliographic coupling showed several relatively separated groups of authors with different focus in cited references. However, a map of co-citation of authors revealed closeness of these separated groups, with Beilock, S. L. and Ashcraft, M. H. by far the most-cited authors in this field.
- Published
- 2024
- Full Text
- View/download PDF
20. Transcription Decisions of Conjoined Independent Clauses Are Equitable across Dialects but Impact Measurement Outcomes
- Author
-
Janna B. Oetting and Tahmineh Maleki
- Abstract
Purpose: Transcription of conjoined independent clauses within language samples varies across professionals. Some transcribe these clauses as two separate utterances, whereas others conjoin them within a single utterance. As an inquiry into equitable practice, we examined rates of conjoined independent clauses produced by children and the impact of separating these clauses within utterances on measures of mean length of utterance (MLU) by a child's English dialect, clinical status, and age. Method: The data were archival and included 246 language samples from children classified by their dialect (African American English or Southern White English) and clinical status (developmental language disorder [DLD] or typically developing [TD]), with those in the TD group further classified by their age (4 years [TD4] or 6 years [TD6]). Results: Rates of conjoined independent clauses and the impact of these clauses on MLU varied by clinical status (DLD < TD) and age (TD4 < TD6), but not by dialect. Correlations between the rate of conjoined clauses, MLU, and language test scores were also similar across the two dialects. Conclusions: Transcription decisions regarding conjoined independent clauses within language samples lead to equitable measurement outcomes across dialects of English. Nevertheless, transcribing conjoined independent clauses as two separate utterances reduces one's ability to detect syntactic differences between children with and without DLD and document syntactic growth as children age.
- Published
- 2024
- Full Text
- View/download PDF
21. Efficiency of Higher Education Financial Resource Allocation from the Perspective of 'Double First-Class' Construction: A Three-Stage Global Super Slacks-Based Measure Analysis
- Author
-
Jin Wang, Wei Zhang, Min Zhao, XiuFeng Lai, Lang Chang, and Zhanjun Wang
- Abstract
The allocation of financial resources in higher education has always been a hot topic of concern in academia and society. The measurement and evaluation of the allocation efficiency of higher education financial resources from the perspective of 'Double first-class' construction is the most important initiative to improve the quality of higher education development and promote the construction of a community with a shared future for mankind. The author constructs a resource allocation efficiency evaluation index system, including two input factors: basic expenditure and project expenditure, and four primary indicators: personnel cultivation, scientific research, international repercussions and social contribution, in addition, ten secondary culture results, results Awarded, education of students abroad, achievement transformation, etc., are considered as output factors. The three-stage Global Super Slacks-Based Measure (SBM) model is applied to accurately measure and scientifically evaluate the allocation efficiency of financial resources in China's higher education. Results show that: first, the true efficiency level can be revealed by eliminating the influence of external environmental factors and random noise. Only 2.82% of universities are located on the effective frontier, indicating that there is significant room for improvement in universities' financial resource allocation capacity and fund utilization efficiency. Second, influenced by factors such as external dependence, R&D intensity, industrial structure and fiscal decentralization, the financial resources allocation efficiency is significantly overestimated, many universities rely heavily on external policy environments for financial resource allocation, and the support from the external environment for efficiency improvement in a few universities still needs to be strengthened. The third, promoting the classification evaluation of universities can meet the needs of 'Double first-class' construction and guarantee the development of university characteristics and diversification. The research shows that first-class universities, comprehensive universities, eastern universities have relatively mature management capabilities, and first-class universities, comprehensive universities and central universities are the most suitable for operation scale; while first-class disciplines, liberal arts universities and western universities have the most significant improvement in the efficiency. Additionally, in view of the research questions and empirical analysis results, this paper also discusses the construction of evaluation index system, the impact of environmental factors and efficiency measurement, classification evaluation, and the effectiveness and promotion of the three-stage Global Super-SBM model, presenting the supporting literature, the uniqueness of this study and the areas for further research. Finally, conclusions are summarized, and suggestions are proposed to provide theoretical guidance and methodological references for dynamic adjustments in the allocation of resources in the new round of 'Double first-class' construction and the strategic planning of higher education resource allocation.
- Published
- 2024
- Full Text
- View/download PDF
22. Differential Effects of a Behavioral Treatment Probe on Social Gaze Behavior in Fragile X Syndrome and Non-Syndromic Autism Spectrum Disorder
- Author
-
Scott S. Hall and Tobias C. Britton
- Abstract
The purpose of this study was to examine potential differences in social learning between individuals with fragile X syndrome (FXS), the leading known inherited cause of intellectual disability, and individuals with non-syndromic autism spectrum disorder (ASD). Thirty school-aged males with FXS and 26 age and symptom-matched males with non-syndromic ASD, were administered a behavioral treatment probe designed to improve levels of social gaze during interactions with others. The treatment probe was administered by a trained behavior therapist over two days in our laboratory and included reinforcement of social gaze in two alternating training conditions -- looking while listening and looking while speaking. Prior to each session, children in each group were taught progressive muscle relaxation and breathing techniques to counteract potential increased hyperarousal. Measures included the rate of learning in each group during treatment, in addition to levels of social gaze and heart rate obtained during administration of a standardized social conversation task administered prior to and following the treatment probe. Results showed that learning rates obtained during administration of the treatment probe were significantly less steep and less variable for males with FXS compared to males with non-syndromic ASD. Significant improvements in social gaze were also observed for males with FXS during the social conversation task. There was no effect of the treatment probe on heart rate in either group. These data reveal important differences in social learning between the two groups and have implications for early interventions in the two conditions.
- Published
- 2024
- Full Text
- View/download PDF
23. Large-Scale Data Decipher Children's Scale Errors: A Meta-Analytic Approach Using the Zero-Inflated Poisson Models
- Author
-
Hiromichi Hagihara, Mikako Ishibashi, Yusuke Moriguchi, and Yuta Shinya
- Abstract
Scale errors are intriguing phenomena in which a child tries to perform an object-specific action on a tiny object. Several viewpoints explaining the developmental mechanisms underlying scale errors exist; however, there is no unified account of how different factors interact and affect scale errors, and the statistical approaches used in the previous research do not adequately capture the structure of the data. By conducting a secondary analysis of aggregated datasets across nine different studies (n = 528) and using more appropriate statistical methods, this study provides a more accurate description of the development of scale errors. We implemented the zero-inflated Poisson (ZIP) regression that could directly handle the count data with a stack of zero observations and regarded developmental indices as continuous variables. The results suggested that the developmental trend of scale errors was well documented by an inverted U-shaped curve rather than a simple linear function, although nonlinearity captured different aspects of the scale errors between the laboratory and classroom data. We also found that repeated experiences with scale error tasks reduced the number of scale errors, whereas girls made more scale errors than boys. Furthermore, a model comparison approach revealed that predicate vocabulary size (e.g., adjectives or verbs), predicted developmental changes in scale errors better than noun vocabulary size, particularly in terms of the presence or absence of scale errors. The application of the ZIP model enables researchers to discern how different factors affect scale error production, thereby providing new insights into demystifying the mechanisms underlying these phenomena.
- Published
- 2024
- Full Text
- View/download PDF
24. Using Conversation Analysis to Explore Assessments of Decision-Making Capacity in a Hospital Setting
- Author
-
Jessica Foulkes, Anna Volkmer, and Suzanne Beeke
- Abstract
Background: Healthcare professionals (HCPs) have a responsibility to conduct assessments of decision-making capacity that comply with the Mental Capacity Act 2005 (MCA). Current best-practice guidance, such as the Mental Capacity Code of Practice and National Institute for Health and Care Excellence decision-making and mental capacity guidance, does not stipulate how to accomplish this in practice, for example, what questions should be asked, how options and information should be provided. In addition, HCPs struggle to assess the capacity of individuals with communication difficulties. Aims: This study was a service evaluation that aimed to objectively analyse, using Conversation Analysis (CA), how real-life capacity assessments were conducted in a hospital setting with patients with acquired brain injury (ABI)-related communication difficulties. A second aim was to establish the feasibility of using CA to advance knowledge of the conduct of capacity assessment. Methods & Procedures: Four naturally occurring capacity assessments were video-recorded. Recordings involved speech and language therapists, occupational therapists, neuropsychologists and patients with communication difficulties as a result of ABI. The methods and findings of CA were used to investigate the interactional behaviours of HCPs and patients during assessments of decision-making capacity. The analysis was informed by our knowledge of the MCA best practice guidance. Outcomes & Results: An overall structure of capacity assessment that enacted some of the best-practice MCA guidance was identified in one recording, consisting of six phases: (i) opening, (ii) preparation, (iii) option-listing, (iv) test, (v) decision, and (vi) close. The preparation phase consisted of two sub-components: information gathering and information giving. Variation from this structure was observed across the dataset, notably in the way in which options were (or were not) presented. Conclusions & Implications: CA is a feasible empirical method for exploring the structure and conduct of capacity assessments. CA identifies and provides ways of describing interactional behaviours that align with and diverge from best-practice MCA guidance. Future CA studies including a wider range of health and social care professionals and patients have the potential to inform evidence based training for HCPs who conduct assessments of decision-making capacity.
- Published
- 2024
- Full Text
- View/download PDF
25. The Relation between Reading and Externalizing Behavior: A Correlational Meta-Analysis
- Author
-
Sage E. Pickren, Jessica N. Torelli, Anna H. Miller, and Jason C. Chow
- Abstract
Reading proficiency is important because it has life-long consequences and influences success in other academic areas. Many students with behavior problems are poor readers and many students with learning disabilities have more behavior problems than their typical peers. We conducted a correlational meta-analysis to examine the association between reading and externalizing behavior in students ages 5-12. We identified 33 studies that reported 88 effect sizes. Using a random-effects linear regression model with robust variance estimation, we found a significant, negative correlation (r= -0.1698, SE = 0.01, p < 0.0001) between reading and externalizing behavior. We tested several moderators related to measurement and sample characteristics. We found that rater type, behavior dimension (e.g., aggression), time between longitudinal measurement points, age of the sample, and percentage male of the sample moderated the relation between reading and behavior. Whether the reading assessment measured comprehension or word reading and socioeconomic status of the sample did not moderate the relation. Understanding the association between reading and externalizing behavior has implications for disability identification and intervention practices for children in elementary school. Future research should examine shared cognitive factors and environmental influences that explain the relation between the constructs.
- Published
- 2024
- Full Text
- View/download PDF
26. Culturally Responsive Assessment: Provisional Principles. ETS RR--23-11
- Author
-
Michael E. Walker, Margarita Olivera-Aguilar, Blair Lehman, Cara Laitusis, Danielle Guzman-Orth, and Melissa Gholson
- Abstract
Recent criticisms of large-scale summative assessments have claimed that the assessments are biased against historically excluded groups because of the assessments' lack of cultural representation. Accompanying these criticisms is a call for more culturally responsive assessments--assessments that take into account the background characteristics of the students; their beliefs, values, and ethics; their lived experiences; and everything that affects how they learn and behave and communicate. In this paper, we present provisional principles, based on a review of research, that we deem necessary for fostering cultural responsiveness in assessment. We believe the application of these principles can address the criticisms of current assessments.
- Published
- 2023
27. Online Instructional Materials in Mathematics VI for Selected Public Elementary Schools in District 4 Division of City Schools Manila: In Response to Department of Education's (DepEd's) Learning Continuity Plan
- Author
-
Julie Gravoso Maranan
- Abstract
This study is an attempt to design and develop as well as validate sets of Online Instructional Materials in Mathematics VI at selected elementary schools in DCS, Manila, specifically, focused on the study of Geometry and Measurement. Using both documentary analysis and descriptive method of study, two (2) major groups of respondents were chosen to participate in the study. They were the 6 school administrators who were the School Principals, Supervisor, Head Teacher, Master Teacher and the 35 Mathematics teachers who represented the seven (7) selected elementary schools in the District 4 of the DCS, Manila. Aside from these experts, she also made use of two (2) sections of Grade VI pupils of a public elementary school in the District, who are the subjects of the study. The following are the salient findings of the investigations on: 1. Topics to be included in the Online Instructional Materials in Mathematics VI. Using documentary and historical data, the following indicators were bases in how the researcher decided in how she chose Geometry and Measurement as the core subject areas specifically covered in the modules: (1.1) Content-based for Grade VI Mathematics--Five (5) units were covered, of these areas of concern Geometry was the least covered with only 2 or 9.09 topics and Measurement and Whole Numbers equally had more with 5 or 22.73 percent topics. Rational Numbers have the most substantial topics covered in the MLC. (1.2) DepEd's Prescribed Textbooks and Subject Contents--When the three (3) DepEd's prescribed textbooks were analyzed in terms of the topics and pages covered as prescribed in the prescribed content-based curriculum, again, Geometry and Measurement, which are considered difficult areas in Mathematics VI were those that were least covered. They obtained an overall (Measurement with 47:86 topic and page covered ratio) and Geometry with 15:25 topic and page covered ratio and were ranked 3 and 4, respectively among the 5 major units of the subject under study. (1.3) Budget of Work for Mathematics VI--Not much emphasis was also given to both Geometry and Measurement as proofs of the first registering only 11 suggested lessons and 17 sessions; and the second, with 11 suggested lessons with 23 sessions; very limited topics and pages were not only covered, but also not evenly and appropriately distributed considering the significance of the topics in preparing the pupils for higher mathematical procedures and processes. (1.4) Results of the Inventory and Achievement Tests in Mathematics VI in the District 4 of DCS, Manila--The Grade VI pupils totaling 1474 for the schoolyear 2022-2023 enrolled in Mathematics VI were able to perform which resulted to get only 29.27 mean raw or 72.21 transmitted scores in the inventory test; and their performance in the achievement test revealed 44.07 or 86.95 mean raw and transmitted scores which generated a gain of 14.8 mean scores/14.74 transmitted scores. (1.5) Table of Specification Covered in the Achievement Test for the Academic Year 2022-2023--In terms of item placement of the topics testing the mathematical skills of the pupils in knowledge, comprehension, application, and analysis on the distribution of test questions, only one (1) item was noted in Geometry and nil in Measurement under application skills. In knowledge and comprehension only one (1) each was recorded, but none in analysis. (1.6) Report on the DepEd's District 4 Organizational Structure on the Status of Basic Education Resource Textbooks, District of DCS, Manila, 2022-2023--The Annual Report of the Division significantly revealed the dearth of textbooks and other supplementary materials for the need of the pupils. In schools population, the pupil-textbooks ratio only of 3:7 for Grade VI pupils which revealed the inadequacy of basic textbooks requirement for the grade level. These data are revealing of the need to come out with supplementary instructional materials to augment the inadequacy and limited textbooks to replace the traditional and obsolete materials to revolutionize the teaching of mathematics, using alternative approach in no in-class interactive classroom activities. In response to these needs, the researcher, a Math teacher who is concern more to improve instruction to effect quality education, endeavors to design and develop sets of content-based modules for the use of Grade VI pupils in Mathematics in the School District of Manila. The Online Instructional Materials in Mathematics VI concentrated only on the topics of great concern -- Geometry and Measurement. Each major area is covered in 7 lessons or a total of 14. Her objective is to provide and equip the learners with needed numerical skills and competencies in the study of the areas focusing in attaining knowledge, developing the skills in comprehension, and applying concepts and analysis. She also saw to it that the content-based modules were designed and developed with a systems approach in mind, like following and observing each step of the modular process, such as: 1. Entry (starting) behavior of the learner was analyzed; 2. Specific objectives stated; 3. Content selected and sequenced; 4. Learning activities well-planned, designed and developed; 5. Continuous assessments in the form of pre and post and built-in tests; and 6. Effectiveness of the module evaluated. The content of the online tools is so prepared to allow the pupils to work independently by themselves, and if there is a need for teacher assistance, such help will be at the minimum, and on online instruction. Another key components of the online tools are that they are highly supportive of each other. Parts like the specific objectives, learner's activities, and evaluation are interrelated and suggested practice exercises or activities are the means used to achieve the predetermined objectives. Likewise, the evaluation serves as the feedback to find out the extent of how much the objectives are realized. 2. Validity of the Contents of the Online Instructional Tools in Mathematics VI. Based on the survey conducted on the assessment of the school administrators and experts, they were of the professional views that these sets of tools were not only valid as they were very acceptable, as proofs of obtained composite means of X = 4.67 for relevance of objectives; X = 4.78 for relevance of content; X = 4.76 for clarity; X = 4.72 for adequacy; X = 4.82 for suitability; and X = 4.67 for usefulness or resulted to an overall composite mean of X = 4.74. 3. Performance of the Pupils in the Pre and Posttests Using the Sets of Online Instructional Tools in Mathematics VI; and Significant Difference, if any, in the Results of the Pre and Posttests. The results of the pre- and posttest in Mathematics VI was satisfactory as evidenced by mean gain of 11.15 and further affirmed by the overall result of t = 20.871 which is much > than its tubular t = 2.576 that at 0.01 alpha level and 85 dfs, that the null Ho posited at the onset of the study is rejected. These findings suggest that pupils were able to enhance their knowledge and skills in the use of the online instructional tools in Mathematics, as an alternative tools in the teaching of Mathematics. Conclusions: In view of the cited findings, the following conclusions were drawn: 1. Geometry and Measurement subject areas were least covered areas in the DepEd's prescribed textbooks, budget of work, in the inventory ad achievement test and table of specification, results of the yearly test, and annual district report that the researcher focused on the content of her proposal on these two (2) not well-tread and tried topics in Mathematics VI in Geometry and Measurement. 2. In terms of judgmental evaluation, the proposed sets of online instructional materials in Mathematics VI were valid as they were very acceptable to the school administrators / experts (X = 4.71); and Mathematics teacher (X = 4.75); or an overall composite mean of X = 4.73. 3. In terms of concurrent validity, the results of the achievement test and the average grade of the pupils in Mathematics VI were highly and positively significant. 4. Significant difference is found to exist between the assessments of the school administrators and Mathematics teachers as to the acceptability of the proposed online instructional materials in Mathematics VI. Recommendations: Based from the conclusions drawn in the study, the researcher offers the following: 1. The Proposed Online Instructional Materials in Mathematics VI should be endorsed and adopted for the use of the Grade VI pupils not only in the District 4, but also on the whole Division of City Schools (DCS) of Manila, to serve as online supplementary materials in the teaching of Mathematics. 2. These sets of online instructional tools in Mathematics VI should further undergo testing and re-testing to improve the design and enrich the topics as well as the classroom activities that suit particular setting. These can also serve as alternative source in the absence in the inadequacy of teachers and basic textbooks and other reference materials, as well as serve as online instructional tool for pupils as no in-class interactive class is still partially suspended because of the pandemic situations. 3. More online instructional tools in Mathematics should be developed in other areas of the subject to ease the problem of big classes, inadequate classrooms and facilities, as well as and ease the burden of the teachers as pupils start to assume responsibility for learning, especially, now that partial no in-class is ordered by the DepEd because of the fear of safety and health satisfaction. 4. Because of the limitation of the study, the researcher further recommends a follow-up research to firmly establish the logical and statistical validity of other sets of online instructional materials in other areas of Mathematics subject.
- Published
- 2023
28. Different Methods for Assessing Pre-Service Teachers' Instruction: Why Measures Matter. EdWorkingPaper No. 23-862
- Author
-
Annenberg Institute for School Reform at Brown University, Arielle Boguslav, and Julie Cohen
- Abstract
Teacher preparation programs are increasingly expected to use data on pre-service teacher (PST) skills to drive program improvement and provide targeted supports. Observational ratings are especially vital, but also prone to measurement issues. Scores may be influenced by factors unrelated to PSTs' instructional skills, including rater standards and mentor teachers' skills. Yet we know little about how these measurement challenges play out in the PST context. Here we investigate the reliability and sensitivity of two observational measures. We find measures collected during student teaching are especially prone to measurement issues; only 3-4% of variation in scores reflects consistent differences between PSTs, while 9-17% of variation can be attributed to the mentors with whom they work. When high scores stem not from strong instructional skills, but instead from external circumstances, we cannot use them to make consequential decisions about PSTs' individual needs or readiness for independent teaching.
- Published
- 2023
29. 7 Recommendations for Using Education Data to Support Equitable Learning Outcomes
- Author
-
WestEd, Jessica Arnold, and Julie Webb
- Abstract
While there are many different types of education data, policymakers and education leaders often place heavy emphasis on data from large-scale quantitative measures, such as annual state assessments. But data from these sources alone do not provide a complete picture of learning and are often not well suited to informing improvements at the local level. This brief provides seven recommendations to help educators, administrators, policymakers, and others use a wider range of data to more effectively support equitable learning outcomes.
- Published
- 2024
30. Accountability for Postsecondary Readiness. A 50-State Analysis
- Author
-
Region 15 Comprehensive Center, WestEd, Herz, Mitchell P., Johnson, Lamar L., and Crane, Eric W.
- Abstract
Postsecondary readiness enables students to pursue their dreams, contribute to society, and thrive in the global economy. Since many accountability systems include a postsecondary readiness indicator in formal evaluations of schools and districts, it benefits educators, families, researchers, policymakers, and other education partners to understand how postsecondary readiness is defined, measured, and used. This brief, produced by the Region 15 Comprehensive Center, explains how states define and measure postsecondary readiness, an important step toward improving how such measures function within state accountability systems. Region 15 Comprehensive Center staff identified four main findings about the use of postsecondary readiness indicators, the types of measures included in the indicators, and how much weight indicators are given in accountability systems: (1) More than three of four ESSA plans contained a postsecondary readiness indicator; (2) States included three main types of measures in postsecondary readiness indicators: academic, career, and military; (3) Postsecondary readiness indicators focused most heavily on academic and career measures and less on military measures; and (4) Weighting of the postsecondary readiness indicator varies widely from state to state.
- Published
- 2023
31. Addressing Uncodable Behaviors: A Bayesian Ordinal Mixture Model Applied to a Mathematics Learning Trajectory Teaching Experiment
- Author
-
Pavel Chernyavskiy, Traci S. Kutaka, Carson Keeter, Julie Sarama, and Douglas Clements
- Abstract
When researchers code behavior that is undetectable or falls outside of the validated ordinal scale, the resultant outcomes often suffer from informative missingness. Incorrect analysis of such data can lead to biased arguments around efficacy and effectiveness in the context of experimental and intervention research. Here, we detail a new Bayesian mixture approach that analyzes ordinal responses with undetectable/uncodable behaviors in two stages: (1) estimate a likelihood of response detection and (2) estimate an Explanatory Item Response Model for the ordinal variable conditional on detection. We present an independent random effects and correlated random effects variant of the new model and demonstrate evidence of model functionality using two simulation studies. To illustrate the utility of our proposed approach, we describe an extended application to data collected during a length measurement teaching experiment (N = 186, 56% girls, 5-6 years at preassessment). Results indicate that students assigned to a learning trajectories instructional condition were more likely to use detectable, mathematically relevant problem-solving strategies than their peers in two comparison conditions and that their problem-solving strategies were also more sophisticated. [This is the online first version of an article published in "Journal of Research on Educational Effectiveness."]
- Published
- 2024
- Full Text
- View/download PDF
32. Optimal Calibration of Items for Multidimensional Achievement Tests
- Author
-
Mahmood Ul Hassan and Frank Miller
- Abstract
Multidimensional achievement tests are recently gaining more importance in educational and psychological measurements. For example, multidimensional diagnostic tests can help students to determine which particular domain of knowledge they need to improve for better performance. To estimate the characteristics of candidate items (calibration) for future multidimensional achievement tests, we use optimal design theory. We generalize a previously developed exchange algorithm for optimal design computation to the multidimensional setting. We also develop an asymptotic theorem saying which item should be calibrated by examinees with extreme abilities. For several examples, we compute the optimal design numerically with the exchange algorithm. We see clear structures in these results and explain them using the asymptotic theorem. Moreover, we investigate the performance of the optimal design in a simulation study.
- Published
- 2024
- Full Text
- View/download PDF
33. Revisiting the Usage of Alpha in Scale Evaluation: Effects of Scale Length and Sample Size
- Author
-
Leifeng Xiao, Kit-Tai Hau, and Melissa Dan Wang
- Abstract
Short scales are time-efficient for participants and cost-effective in research. However, researchers often mistakenly expect short scales to have the same reliability as long ones without considering the effect of scale length. We argue that applying a universal benchmark for alpha is problematic as the impact of low-quality items is greater on shorter scales. In this study, we proposed simple guidelines for item reduction using the "alpha-if-item-deleted" procedure in scale construction. An item can be removed if alpha increases or decreases by less than 0.02, especially for short scales. Conversely, an item should be retained if alpha decreases by more than 0.04 upon its removal. For reliability benchmarks, 0.80 is relatively safe in most conditions, but higher benchmarks are recommended for longer scales and smaller sample sizes. Supplementary analyses, including item content, face validity, and content coverage, are critical to ensure scale quality.
- Published
- 2024
- Full Text
- View/download PDF
34. Measuring What Matters: Considerations for the Measurement of Services for Individuals with Autism
- Author
-
Meghan M. Burke, W. Catherine Cheung, Megan Best, Leann S. DaWalt, and Julie Lounds Taylor
- Abstract
Services are important for many individuals with autism to achieve meaningful post-school outcomes. To understand how to improve service access, it is important to measure services in ways that capture whether an individual's needs are truly being met. Yet, most measures of service access are simplistic, without fully taking into account the vast heterogeneity among those on the autism spectrum. In this manuscript, we highlight the key issues, challenges, and considerations in measuring service access. We provide ways a service access measure can address some of these issues while also suggesting further ways to improve the measurement of services. We conclude with implications for research, policy, and practice.
- Published
- 2024
- Full Text
- View/download PDF
35. Measurement Invariance in Intellectual and Developmental Disability Research
- Author
-
Cristan Farmer, Aaron J. Kaat, Michael C. Edwards, and Luc Lecavalier
- Abstract
Measurement invariance (MI) is a psychometric property of an instrument indicating the degree to which scores from an instrument are comparable across groups. In recent years, there has been a marked uptick in publications using MI in intellectual and developmental disability (IDD) samples. Our goal here is to provide an overview of why MI is important to IDD researchers and to describe some challenges to evaluating it, with an eye towards nudging our subfield into a more thoughtful and measured interpretation of studies using MI.
- Published
- 2024
- Full Text
- View/download PDF
36. Confirmation of a Reconceptualized Definition and Measure of Adolescent Risk Behavior: Adolescent Viewpoints
- Author
-
Nicole R. Skaar
- Abstract
The goal of this project was to substantiate a more positive conceptualization of adolescent risk behavior and to compare adolescent viewpoints of risk behavior to the items on the Prosocial and Health Adolescent Risk Behavior Scale (PHARBS). A total of 57 high school students participated in the research. Researchers recruited students from an Advanced Placement (AP) Psychology course at a large Midwestern high school. The high school serves approximately 1,750 students in grades 9 through 12. The university Institutional Review Board approved the study procedures. Families provided informed consent, and students assented to participating in one of eight focus group discussions. The focus groups were audio taped, transcribed, and coded. Researchers analyzed the coded data using word count analysis. Students discussed prosocial risk behaviors in addition to health risk behaviors, providing support for the PHARBS and suggesting that adolescents view taking some risks as positive. A more positive conceptualization of risk behavior may better align with how adolescents view risk behavior. Researchers and clinicians might approach adolescent risk behavior measurement and research on the importance of understanding risk behaviors as a normal and potentially positive aspect of adolescent development.
- Published
- 2024
- Full Text
- View/download PDF
37. Associations between Education, Information-Processing Skills, and Job Automation Risk in the United States
- Author
-
Donnette Narine, Takashi Yamashita, Runcie C. W. Chidebe, Phyllis A. Cummins, Jenna W. Kramer, and Rita Karam
- Abstract
Job automation is a topical issue in a technology-driven labor market. However, greater amounts of human capital (e.g., often measured by education, and information-processing skills, including adult literacy) are linked with job security. A knowledgeable and skilled labor force better resists unemployment and/or rebounds from job disruption brought on by job automation. Therefore, the purpose of this study was to advance understanding of the association between educational attainment and literacy, and job automation risk. Using the 2012/2014/2017 Program for the International Assessment of Adult Competencies (PIAAC) data, survey-weighted linear regression was used to model the risk of job automation as a function of education, and literacy proficiency. Higher educational attainment (college or higher vs. less than high school: b = -18.23, p < 0.05) and greater literacy proficiency (score 0-500 points: b = -0.038, p < 0.05) were associated with a decrease in job automation risk among the U.S. workforce.
- Published
- 2024
- Full Text
- View/download PDF
38. Has Peak PISA Passed? An Investigation of Interest in International Large-Scale Assessments across Countries and over Time
- Author
-
John Jerrim
- Abstract
International Large-Scale Assessments (ILSAs) have had significant impact on education policy across the globe. But has interest in ILSAs now started to wane? This paper presents new evidence on this issue, exploring how the amount of attention three major ILSAs receive compares across countries, between studies and over time. Using information on Google searches made for ILSAs over time, we illustrate how results from TIMSS and PIRLS results receive significantly less attention than those from PISA. Globally, interest in ILSAs seems to have peaked in 2012 and has been on the decline since. There is however substantial cross-country variation, with increasing interest in some countries over the last decade (e.g. Sweden, Turkey) offsetting some of the fall in others (e.g. Japan, German). Moreover, while changes in scores seem to be related to the attention that ILSAs receive, other factors -- including their current position in political and policy narratives -- are also likely at play.
- Published
- 2024
- Full Text
- View/download PDF
39. RAN and Two Languages: A Meta-Analysis of the RAN-Reading Relationship in Bilingual Children
- Author
-
Victoria Kishchak, Anna Ewert, Paulina Halczak, Pawel Kleka, and Marcin Szczerbinski
- Abstract
RAN (Rapid Automatized Naming) is known to be a robust predictor of reading development in different languages. Much less is known about RAN predictive power in bilingual contexts. This is the first meta-analysis of research with bilingual children, assessing the strength of the RAN-reading relationship both within and across languages. It also explored the moderators that may affect this relationship. The search identified 38 published studies of bilingual children with 47 samples, 313 effect sizes and 5312 participants. Analyses of random-effects models with robust variance estimation revealed weak-to-moderate overall effect sizes of RAN and reading concurrently (r = -0.39) and longitudinally (r = -0.38). Moderator analyses of concurrent correlations revealed that RAN correlated more strongly with reading fluency (r = -0.56) than accuracy (r = -0.38). Alphanumeric RAN tasks (digits r = -0.39, letters r = -0.42) showed stronger associations with reading than non-alphanumeric RAN tasks (objects r = -0.38, colors r = -0.25). RAN-reading correlation was statistically significant both within and across languages. It was somewhat weaker when the two skills were measured in different languages (rL1RAN-L2 reading = -0.34, rL2RAN-L1 reading = -0.36) compared to when they were measured in the same language (rL1 = -0.40, rL2 = -0.44), though those differences failed to reach statistical significance. In addition, the type of bilingualism was found to be a potential moderator of the RAN-reading relationship longitudinally, with its magnitude being the strongest in simultaneous bilinguals. Our results suggest that, as a predictor, RAN taps into general, language-independent processes underlying reading.
- Published
- 2024
- Full Text
- View/download PDF
40. The Effectiveness of Note Taking through Exposure to L2 Input: A Meta-Analysis
- Author
-
Zhouhan Jin and Stuart Webb
- Abstract
There has been increasing interest in the effects of note taking in second language (L2) research. However, no meta-analysis has been conducted to examine the relationship between note taking and learning through exposure to L2 input. We retrieved 28 effect sizes from 21 studies (N = 1992) to explore the overall effects of note taking as well as to examine the extent to which the effectiveness of note taking is likely to vary as a function of a set of potential moderators (i.e., learner variables, treatment variables, note-taking features, learning target, and measurement type). Results revealed that note taking had a small to medium positive overall effect on learning through exposure to L2 input (g = 0.56, 95% CI: 0.24-0.88). Subsequent moderator analyses revealed that variability in the size of note-taking effects across studies was explained by learner variables (context, region, orthographic scripts, institutional level), treatment variables (mode of input, material type), note-taking features (note-taking behavior, number of note-taking sessions, provision and type of note-taking strategy instruction, total length of instruction, opportunity to review notes), learning target, and measurement type. Based on the obtained findings, teachers are recommended to incorporate note taking in L2 classrooms. Pedagogical suggestions and directions for future research are also provided.
- Published
- 2024
- Full Text
- View/download PDF
41. Leading Indicators of Academic Achievement: Investigating the Predictive Validity of an Observation Instrument in a Large District
- Author
-
Lindsey Devers Basileo, Merewyn Elizabeth Lyons, and Michael David Toth
- Abstract
Instructional leaders require timely and predictive data to guide post-pandemic systemic changes. We investigated the predictability of an observational instrument, the Rigor Appraisal, and its association with achievement and other school effectiveness measures in a sample of 53 schools in Illinois. We found that increases in the Rigor Appraisal had a small to moderate and statistically significant association with achievement, a positive and moderate statistically significant association with attendance, a negative relationship between referrals and suspensions, and a positive and moderate statistically significant association with the 5Essentials. Additionally, the implementation of academic teaming was associated with greater achievement in schools with more low-income students. We also found that leaders who conducted non-evaluative instructional walks experienced a positive and statistically significant impact on achievement. As such, the Rigor Appraisal merits further study in different contexts, as it shows promise as a leading indicator that can be used for the continuous improvement of instructional systems.
- Published
- 2024
- Full Text
- View/download PDF
42. Opening the 'Gait' to Unit Rate
- Author
-
A. Susan Gay, Jeanine Haistings, Jason L. Rucker, Lindsay Garcia, and Megan Koenigsman
- Abstract
The lesson described in this article was developed and taught by a team of mathematics educators and physical therapists, with the shared goal of broadening students' perception of how mathematics concepts are applied in the real world. This lesson gives students authentic experience with the Gait Speed Test as a physical therapist would administer it. In the lesson, sixth- graders generate walking speed data using a fixed distance and measuring time in seconds, convert that to an appropriate unit rate, and interpret that unit rate in the context of health and physical function.
- Published
- 2024
- Full Text
- View/download PDF
43. The Validity of Heart Rate Variability (HRV) in Educational Research and a Synthesis of Recommendations
- Author
-
Hyun Jin Kim, Yuyi Park, and Jihyun Lee
- Abstract
This study provides a comprehensive overview of methodological aspects when using heart rate variability (HRV) measures in educational research. Following PRISMA 2020 guidelines, we searched four databases for relevant studies published until March 5, 2024. From the 48 studies reviewed, we extracted data across three analytical categories: (1) area of study interest and participant populations, (2) data collection and analysis methodologies, and (3) the concurrent and predictive validity of HRV measurement for educational research. Study quality was evaluated using QualSyst assessment criteria. Most studies measured stress and enlisted undergraduate students as participants. Data were predominately collected using wearable devices, measuring HRV for durations of less than 30 min, and in varied contexts, including during exams, while learning, and in experiments. The parameters analyzed varied within both time and frequency domains. HRV data had a moderate level of concurrent validity as a measure of stress in an educational context. The concurrent validity of HRV data for measuring attention remains uncertain with insufficient evidence. Limited correlations appeared between stress and performance. The findings, potentials, and limitations of HRV measures are discussed, and synthesized recommendations for educational research using HRV data are provided.
- Published
- 2024
- Full Text
- View/download PDF
44. University of Florida Accountability Plan, 2023
- Author
-
State University System of Florida, Board of Governors
- Abstract
The Accountability Plan is an annual report that is closely aligned with the Board of Governors' 2025 System Strategic Plan. This report enhances the System's commitment to accountability and strategic planning by fostering greater coordination between institutional administrators, University Boards of Trustees and the Board of Governors regarding each institution's direction and priorities as well as performance expectations and outcomes on institutional and System-wide goals. Contents include: (1) Introduction; (2) Strategy; (3) Performance-Based Funding Metrics; (4) Preeminent Research University Funding Metrics; (5) Key Performance Indicators; (6) Enrollment Planning; (7) Academic Program Coordination; and (8) Definitions. [For "University of Florida Accountability Plan, 2022," see ED622123.]
- Published
- 2023
45. Ethnic/Racial Differences in Mathematics Performance of Texas Grade 3 Students: A Statewide, Multiyear Study
- Author
-
Davenport, Gaylon and Slate, John R.
- Abstract
In this investigation, the extent to which differences were present in the mathematics achievement by the ethnicity/race of Grade 3 students in Texas were analyzed. Data obtained from the Texas Education Agency Public Education Information Management System for all Texas Grade 3 students who took the State of Texas Assessment of Academic Readiness Mathematics exam were examined for the 2016-2017, 2017-2018, and 2018-2019 school years. In all three years analyzed, statistically significant differences were revealed in overall mathematics achievement and in all four Mathematics Reporting categories. Inferential statistical analyses revealed a clear stair-step effect. Asian students were the highest performing ethnic/racial group in all four Mathematics Reporting categories and all three performance level standards, followed by White, Hispanic, and Black students. Suggestions for future research and implications for policy and practice were provided.
- Published
- 2023
46. Teacher Use of Score Reports for Instructional Decision-Making in the Subsequent Academic Year
- Author
-
Clark, Amy, Kobrin, Jennifer L., Karvonen, Meagan, and Hirt, Ashley
- Abstract
Large-scale summative assessment results are typically used for program-evaluation and resource-allocation purposes; however, stakeholders increasingly desire results from large-scale K-12 assessments that inform instruction. Because large-scale summative results are usually delivered after the end of the school year, teacher use of results is reserved for the subsequent academic year. To evaluate use of summative score reports to inform instruction, we conducted a series of teacher interviews and focus groups with 17 teachers in three states. Teachers were asked to describe how they used summative results from the previous administration of a large-scale alternate assessment system in the subsequent academic year. Interview and focus-group transcripts were coded and identified themes related to when and how score reports are delivered; how teachers use results to plan instruction, formulate goals for individualized education programs (IEPs), and create instructional groupings; how teachers talk to parents about results; and what resources best support their use of score reports. Findings demonstrate preliminary support for diagnostic score report use.
- Published
- 2023
47. The Effect of Ex-Add Learning Techniques on Critical Thinking Skills and Pedagogic Competence of Islamic Education Students
- Author
-
Mahfudz, Mahfudz and Sukarno, Sukarno
- Abstract
This study aimed to determine the effect of explain-analysis-doing discussion or known as ex-add learning techniques on critical thinking skills and pedagogic competence of Islamic religious education students at State Islamic University (UIN) Sulthan Thaha Saifuddin Jambi and at UIN Raden Fatah Palembang, Indonesia. The approach used quantitative with quasiexperimental techniques. The number seen in this study was 31 students from UIN Sulthan Thaha Saifuddin Jambi. The data were obtained using tests, namely pretest, and posttest. The test instrument was in the form of multiple-choice questions, each consisting of 40 questions. Data analysis was carried out using percentage techniques, N-gain analysis, and a T-test. Based on the data and discussion that has been done, it can be concluded that the ex-add technique in 'learning methods and strategies' can increase critical thinking skill (CTS) and pedagogic competence (PC) respectively by 78 0.23% in the 'high' category and 59.81% in the 'medium' category. This is reinforced by the results of the T-test that both variables obtain a value (2- tailed) of 0.000<0.05. This means that there is an average difference between the pretest and posttest scores for each variable. In other words, it can be said that the increase in student CTS and PC after participating in learning with the ex-add technique is significant.
- Published
- 2023
48. Defining, Measuring, and Supporting Family Economic Well-Being in Early Childhood Home Visiting: A Review of Research and Practices. OPRE Report 2023-117
- Author
-
Administration for Children and Families (DHHS), Office of Planning, Research and Evaluation (OPRE), Mathematica, James Bell Associates (JBA), Eddins, Katie, Sama-Miller, Emily, Forrester, Emily, Gemignani, Josefina, Manzer, Jamie, Avellar, Sarah, and Childress, Leah
- Abstract
Early childhood home visiting (ECHV) has the potential to support families' economic well-being. In ECHV, trained home visitors work in the home with expectant parents or families with young children. Generally, their services focus on supporting and improving maternal, child, and family health and development outcomes. Some ECHV models also address economic aspects of families' lives and have demonstrated positive effects on outcomes such as parents' income. Given the connections between economic stability, parenting, and caregivers' well-being, a stronger focus on family economic well-being in ECHV could benefit families in many ways. The Office of Planning, Research, and Evaluation in the Administration for Children and Families in collaboration with the Health Resources and Services Administration initiated the Supporting Family Economic Well-Being through Home Visiting (HomeEc) project to better understand how to define and measure family economic well-being and to learn how ECHV agencies have supported or could support it. This report summarizes the findings from targeted reviews of literature and practice documents from ECHV and related fields, such as social work, child welfare, and employment- and income-focused supports. It includes (1) a definition of family economic well-being; (2) a summary of the factors that contribute to or are influenced by it; (3) a summary of how it is measured in research and practice; (4) a set of practices that can support it; and (5) implications for later work on this project and future research.
- Published
- 2023
49. Using a Measurement System to Strengthen Student Success Reforms: Guidebook and Tools for Data Management and the Postsecondary Data Partnership
- Author
-
Complete College America (CCA)
- Abstract
Measurement systems give colleges a structure for collecting, sharing, and acting on data. The guidebook and tools presented here help faculty, staff, college leadership, and policymakers understand and use measurement systems--and specifically use data to improve completion rates, close institutional performance gaps, and facilitate economic mobility for historically excluded students. This report lists four cornerstones to strong measurement systems: (1) measure what matters; (2) source the data your college needs; (3) use the national student clearing house PDP; and (4) have regular conversations about data.
- Published
- 2023
50. Future of Assessments: Centering Equity and the Lived Experiences of Students, Families, and Educators
- Author
-
Education Trust, Munyan-Penney, Nicholas, and Mehrotra, Sarah
- Abstract
Addressing inequities in the educational outcomes--particularly for students of color and students from low-income backgrounds--cannot happen without comparable data from statewide summative assessments. Statewide assessment results help schools and district leaders target state and local resources to the students and schools with the greatest need and track whether these resources are impacting student achievement. Despite this, many educators, students, and families say that federal assessment and accountability policies take away from instructional time without providing actionable data. Meanwhile, pandemic pauses in administering statewide assessments and changes in political dynamics at the state and federal levels have opened a window of opportunity to develop new statewide summative assessments that gauge how students are doing, highlight disparities, and show where interventions aren't measuring up to their promise and might be improved. This paper centers the lived experiences and perspectives of students, families, educators, and district and state leaders, so that they can be used to design assessments that provide data that will enable the Ed Trust to promote equitable learning opportunities and improve outcomes for all students. To better understand how directly impacted communities are experiencing statewide assessments, Ed Trust held focus groups with diverse stakeholders who are on the ground, focusing on students of color, students from low-income backgrounds, English learners, and those who work in a school or district in which the majority of students are members of these student groups. The focus group findings informed the creation of "equity pillars," which highlight key values and identify criteria for improving federal assessment policy, and federal policy recommendations for how this vision could be achieved.
- Published
- 2023
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.