Search

There exist passionate debates about the best way to teach children to read. Since the Bush administration, school districts receiving federal funds have been required to have research evidence justifying their methods of teaching reading, and in recent years the need for evidence-based practices have intensified with the "Science of Reading" movement. Last year the country's largest school system changed from balanced reading to three other programs for teaching children to read. In this study we examined the empirical evidence regarding the effectiveness of the three newly adopted reading programs for the country's largest school system. Our study consisted of website review of the research evidence provided by the three publishing companies regarding the effectiveness of their reading programs. Borrowing from studies of program effectiveness, we applied three criteria for analyzing the quality of research used by the publishers to document their program effectiveness. These criteria were the following: (1) Comparative clinical trials; (2) replication of results and (3) publication of evidence in professional journals. The results of our analyses indicated that only one of the selected reading programs was supported with empirical evidence meeting our criteria regarding program effectiveness. We argue that teachers, not programs, are what best affects children's learning to read. Overly simplified and politicized methods of teaching reading lacking empirical evidence of effectiveness are unlikely to accomplish this important goal.

High quality student outcome measures provide the foundation for effective learning assessment. These outcomes can be organized into different categories, such as skills or habits of mind, and evidence types, such as direct or indirect. Prevailing models of assessment, however, focus only on the distinction between direct and indirect evidence without incorporating the outcome categories. Such a binary model of evidence can be limiting, privileges measures of skills and knowledge over habits of mind and values, and risks excluding validated psychometric tools as a source of measurement. An argument is made for a new 2x2 outcome matrix which incorporates outcome category and evidence type as a possible alternative to the dominant direct vs. indirect dichotomy.

Scientific argumentation skills are a key component of science learning practices needed by students in the 21st century. Where the essence of scientific argumentation is to support the argument with evidence and reasoning and then refute the claims and evidence of the opponent's argument. Supporting arguments with evidence and reasoning can be facilitated through inquiry activities. Meanwhile, refuting claims and evidence from opposing arguments can be facilitated through debate activities. Inquiry and debate can be a solution to improving students' scientific argumentation skills. This study aims to prove the truth of this statement through a systematic literature review by applying the PRISMA 2020 criteria which are expanded by bibliometric analysis with the help of the VOSviewer software. The results of the study show that research related to inquiry, debate, and their influence on students' scientific argumentation skills has a pretty good trend. In Indonesia the research climate is still quite good, research topics are still in great demand, and it is very possible to carry out research innovations on related topics. Another finding is that the integration of inquiry and debate in science learning can be a potential strategy to improve students' scientific argumentation skills.

Systematic reviews and meta-analyses aggregate research findings across studies and populations, making them a valuable form of research evidence. Over the past decade, studies in medical education using these methods have increased by 630%. However, many manuscripts are not publication-ready due to inadequate planning and insufficient analyses. These guidelines aim to improve the clarity and comprehensiveness of reporting methodologies and outcomes, ensuring high quality and comparability. They align with existing standards like PRISMA, providing examples and best practices. Adhering to these guidelines is crucial for publication consideration in "Anatomical Sciences Education."

Developing students' source-based argument writing skills is a vital educational goal for the 21st-century information society. Consequently, researchers and educators continually seek ways to understand and improve students' capacities for advancing arguments and synthesizing multiple documents, texts, or sources in a range of subject areas in secondary schools. This study examined differences between middle and high school students' argument essays (N = 207) in multiple dimensions of source-based argument writing in history, the dimensions writing in history, and the relations of identified dimensions to overall writing quality. Using multivariate analysis of covariance, middle and high school students' writing significantly varied in areas of writing related to language use, the presentation of ideas, and evidence use. Their writing varied less so for skills related to historical thinking, indicating a lack of development in these skills across secondary school. Findings from confirmatory factor analysis and structural equation modeling showed a bifactor model with a general factor and 4 specific factors--Presentation of Ideas, Evidence Use, Language Use, and Historical Thinking--best represented writing in this genre, with the general factor strongly predicting holistic writing scores. Implications for both research and educational practice are discussed, including the importance of attending to developmental variation in discrete writing skills.

The present study contributes to the development of effective measures to evaluate classroom climate, especially in elementary education where these remain limited. In addition, it addresses a typical "flaw" of several studies by approaching classroom climate as a group-level construct rather than an individual characteristic. Following a multilevel approach, we attempted to establish validity evidence for an adapted version of the Classroom Behavioral Climate (CBC) questionnaire and examine its equivalence across two contexts. The participants included 2963 students from 176 fourth and fifth grade classes. Multilevel Confirmatory Factor Analyses resulted in a shorter version of the CBC with three correlated factors in both countries. Two-level models performed better than the single-level models. Configural, metric, and partial scalar invariance was also achieved. The study highlights the need for researchers and practitioners to use appropriate methods and instruments to evaluate the classroom environment based on their research aims and intended use.

Some patients benefit from a treatment while others may do so less or do not benefit at all. We have previously developed a two-stage network meta-regression prediction model that synthesized randomized trials and evaluates how treatment effects vary across patient characteristics. In this article, we extended this model to combine different sources of types in different formats: aggregate data (AD) and individual participant data (IPD) from randomized and non-randomized evidence. In the first stage, a prognostic model is developed to predict the baseline risk of the outcome using a large cohort study. In the second stage, we recalibrated this prognostic model to improve our predictions for patients enrolled in randomized trials. In the third stage, we used the baseline risk as effect modifier in a network meta-regression model combining AD, IPD randomized clinical trial to estimate heterogeneous treatment effects. We illustrated the approach in the re-analysis of a network of studies comparing three drugs for relapsing--remitting multiple sclerosis. Several patient characteristics influence the baseline risk of relapse, which in turn modifies the effect of the drugs. The proposed model makes personalized predictions for health outcomes under several treatment options and encompasses all relevant randomized and non-randomized evidence.

Data extraction is a crucial, yet labor-intensive and error-prone part of evidence synthesis. To date, efforts to harness machine learning for enhancing efficiency of the data extraction process have fallen short of achieving sufficient accuracy and usability. With the release of large language models (LLMs), new possibilities have emerged to increase efficiency and accuracy of data extraction for evidence synthesis. The objective of this proof-of-concept study was to assess the performance of an LLM (Claude 2) in extracting data elements from published studies, compared with human data extraction as employed in systematic reviews. Our analysis utilized a convenience sample of 10 English-language, open-access publications of randomized controlled trials included in a single systematic review. We selected 16 distinct types of data, posing varying degrees of difficulty (160 data elements across 10 studies). We used the browser version of Claude 2 to upload the portable document format of each publication and then prompted the model for each data element. Across 160 data elements, Claude 2 demonstrated an overall accuracy of 96.3% with a high test-retest reliability (replication 1: 96.9%; replication 2: 95.0% accuracy). Overall, Claude 2 made 6 errors on 160 data items. The most common errors (n = 4) were missed data items. Importantly, Claude 2's ease of use was high; it required no technical expertise or labeled training data for effective operation (i.e., zero-shot learning). Based on findings of our proof-of-concept study, leveraging LLMs has the potential to substantially enhance the efficiency and accuracy of data extraction for evidence syntheses.

Quinacridone red and violet are visually different colors, an observation confirmed by their visible reflectance spectra and CIE L*a*b* coordinates. However, their IR spectra are extremely similar. Though chemically identical, the two quinacridones are polymorphs. In this experiment, designed for and tested by nonscience majors, the pigments are extracted from oil paints with hexane in a short procedure involving sonification and centrifugation. ATR-FTIR spectra of the recovered brilliantly colored powders reveal the presence of a calcium carbonate filler in one of the two paints. Factoring out the carbonate bands, the spectra are nearly identical. Students must reconcile the evidence of color and the evidence of the spectra.

This paper explored the link between information literacy (IL) and other factors that enable or inhibit the utilisation of research evidence in policymaking in Zimbabwe. The study assumes that if policymakers possess appropriate IL skills to access, assess, synthesise, and apply research evidence, they will naturally use the evidence to inform their policy decisions. Face-to-face interviews with 26 policymakers -- technocrats selected from the Parliament of Zimbabwe and two ministries, Industry and Commerce, and Youth, Sport, and Recreation -- produced evidence to inform the findings and conclusions. Data synthesis using thematic content analysis confirmed the findings. The results show that while IL skills are critical in enabling policymakers' use of research evidence, multiple other factors also influence the use of research evidence in policymaking due to the complexity of the process. The political and socioeconomic context plays a profound role because of the intricate and nonlinear nature of the policymaking process. Therefore, enhancing evidence use in policymaking revolves around strengthening IL skills at the individual level, including institutional and the broader policy ecosystem, by acknowledging and leveraging personal and institutional relationships. This insight illuminates the need to reorient IL programmes to link them to these other factors.

Qualitative comparative analysis (QCA) is a hybrid method designed to bridge the gap between qualitative and quantitative research in a case-sensitive approach that considers each case holistically as a complex configuration of conditions and outcomes. QCA allows for multiple conjunctural causation, implying that it is often a combination of conditions that produces an outcome, that multiple pathways may lead to the same outcome, and that in different contexts, the same condition may have a different impact on the outcome. This approach to complexity allows QCA to provide a practical understanding for complex, real-world situations, and the context of implementing interventions. There are guides for conducting QCA in primary research and quantitative systematic reviews yet, to our knowledge, no guidance for conducting QCA in systematic mixed studies reviews (SMSRs). Thus, the specific objectives of this paper are to (1) describe a step-by-step approach for novice researchers for using QCA to integrate qualitative and quantitative evidence, including guidance on how to use software; (2) highlight specific challenges; (3) propose potential solutions from a worked example; and (4) provide recommendations for reporting.

This scoping review aims to identify and systematically review published mapping reviews to assess their commonality and heterogeneity and determine whether additional efforts should be made to standardise methodology and reporting. The following databases were searched; Ovid MEDLINE, Embase, CINAHL, PsycINFO, Campbell collaboration database, Social Science Abstracts, Library and Information Science Abstracts (LISA). Following a pilot-test on a random sample of 20 citations included within title and abstracts, two team members independently completed all screening. Ten articles were piloted at full-text screening, and then each citation was reviewed independently by two team members. Discrepancies at both stages were resolved through discussion. Following a pilot-test on a random sample of five relevant full-text articles, one team member abstracted all the relevant data. Uncertainties in the data abstraction were resolved by another team member. A total of 335 articles were eligible for this scoping review and subsequently included. There was an increasing growth in the number of published mapping reviews over the years from 5 in 2010 to 73 in 2021. Moreover, there was a significant variability in reporting the included mapping reviews including their research question, priori protocol, methodology, data synthesis and reporting. This work has further highlighted the gaps in evidence synthesis methodologies. Further guidance developed by evidence synthesis organisations, such as JBI and Campbell, has the potential to clarify challenges experienced by researchers, given the magnitude of mapping reviews published every year.

Prediction-based accounts of language acquisition have the potential to explain several different effects in child language acquisition and adult language processing. However, evidence regarding the developmental predictions of such accounts is mixed. Here, we consider several predictions of these accounts in two large-scale developmental studies of syntactic priming of the English dative alternation. Study 1 was a cross-sectional study (N = 140) of children aged 3-9 years, in which we found strong evidence of abstract priming and the lexical boost, but little evidence that either effect was moderated by age. We found weak evidence for a prime surprisal effect; however, exploratory analyses revealed a protracted developmental trajectory for verb-structure biases, providing an explanation as for why prime surprisal effects are more elusive in developmental populations. In a longitudinal study (N = 102) of children in tightly controlled age bands at 42, 48, and 54 months, we found priming effects emerged on trials with verb overlap early but did not observe clear evidence of priming on trials without verb overlap until 54 months. There was no evidence of a prime surprisal effect at any time point and none of the effects were moderated by age. The results relating to the emergence of the abstract priming and lexical boost effects are consistent with prediction-based models, while the absence of age-related effects appears to reflect the structure-specific challenges the dative presents to English-acquiring children. Overall, our complex pattern of findings demonstrates the value of developmental data sets in testing psycholinguistic theory.

This study provides a comprehensive overview of methodological aspects when using heart rate variability (HRV) measures in educational research. Following PRISMA 2020 guidelines, we searched four databases for relevant studies published until March 5, 2024. From the 48 studies reviewed, we extracted data across three analytical categories: (1) area of study interest and participant populations, (2) data collection and analysis methodologies, and (3) the concurrent and predictive validity of HRV measurement for educational research. Study quality was evaluated using QualSyst assessment criteria. Most studies measured stress and enlisted undergraduate students as participants. Data were predominately collected using wearable devices, measuring HRV for durations of less than 30 min, and in varied contexts, including during exams, while learning, and in experiments. The parameters analyzed varied within both time and frequency domains. HRV data had a moderate level of concurrent validity as a measure of stress in an educational context. The concurrent validity of HRV data for measuring attention remains uncertain with insufficient evidence. Limited correlations appeared between stress and performance. The findings, potentials, and limitations of HRV measures are discussed, and synthesized recommendations for educational research using HRV data are provided.

McKinney (2018) has argued that for the scholarship of teaching and learning (SoTL) to advance within a discipline, the integration of SoTL must be closely examined and opportunities for growth in SoTL must be recognized and discussed. To that end, this paper reflects on the degree to which SoTL is integrated into communication sciences and disorders (CSD) by examining a variety of topics: perspectives and theories historically valued by our discipline, existing supports for SoTL at various levels (i.e., individual teacher-scholars, departments, institutions, and the CSD discipline as a whole), the application of SoTL findings in teaching and learning. Four specific recommendations are made because of this examination and reflection.

Research has previously examined the role of the epistemological background of students in accepting or rejecting the theory of evolution. In this study, the participants were 11 undergraduate biology major students in a private university in Beirut, Lebanon. We collected data through semi-structured interviews, and we extracted the patterns regarding how they perceived tentativeness, what constituted acceptable evidence for them to accept the theory of evolution and the role of religion in their lives. Our findings indicated that, unlike their professor, students uncertain about the theory or rejecting it did so due to the tentative nature of science. They also rejected historical evidence as valid evidence in science, struggled to form a cooperative relationship between evolution and religion and refused common descent because they considered humans as superior organisms. We discuss the implications of those results for curriculum and instruction.

In current educational research communications, especially in English and increasingly also in German publications, the term "evidence" refers to international homogenizing gold standards and is often linked to European evidence policies, large scale assessments and justified and proven knowledge. Against the background of international communication and the related circulation of terms and concepts, this paper analyses German and English OECD publications that recommend the development of educational research in 1970s and 90s. In England, the OECD and thus the external perception of their own education system hardly played a significant role due to years of awareness of the need for reform. Rather, Hargreaves's lecture (1996) about the disappointing effects of educational research when compared with the achievements of evidence-based medicine was decisive for the evidence movement. In addition, non-university institutions have gained legitimacy through acting as "evidence" providers for the school system. Based on analyses of German educational research literature, we show that "evidence" appeared in neurological, medical, technological, and economic texts in the 90s and early 2000s. Usage of "evidence" increased after the PISA shock in 2000 and is now linked to the expression of disciplinary development into empirical educational research. However, based on relatively stable patterns of communication and interpretation in two academic cultures, it is shown that the connectivity of an epistemological term like "evidence" does not necessarily reduce misunderstanding.

This article provides a conceptual framework for considering both the theoretical and methodological factors that underpin the successful validation of a competency framework. Drawing on educational assessment literature, this article argues that a valid competency framework relates to an interpretive judgement of the credibility of the claims made. To establish a credible approach to competency framework validation, there is a requirement to align the purposes of the competency framework, the claims developers make concerning the uses of the framework, and evidence collection methods to substantiate or challenge these claims. This article concludes with a template of questions for competency framework developers to consider in determining the range of potential claims to be made concerning their framework, and in understanding competency framework users and contexts.

Background: Local governments increasingly rely on sales taxes to raise revenue, often justifying the need for a local sales tax increase with a specific programmatic goal, such as better education or transportation. In Washington State, the legislature explained that a local sales tax increase was necessary to support criminal justice because criminal justice requires more police, courts, and jails. Objective: Informed by decades of literature questioning the efficacy of fighting crime through police, courts, and jails, the objective of this study seeks to use empirical evidence to explain whether the social fabric offers indicators that can better define criminal justice and thus inform local tax policy so that local sales tax revenue may be used to prevent crime rather than fight it. Method: The study compiled a 29-year history of 36 social variables across all 39 Washington counties to determine whether crime is predictable and what is most predictive of crime. Pearson coefficients of determination were calculated to identify cross-sectional associations between social variables and crime variables. An ARIMAX predictive model was then constructed to test the predictive power of the multivariate time series. Results: The study finds that crime is predictable and social observations specific to how a child grows up are consistently predictive explanatory variables of crime. There is reason to believe that the most effective action state and local governments can take to promote criminal justice and prevent crime is to leverage their taxing power to ensure that every child (a) has access to food and basic necessities, (b) is raised in a safe and stable home, and (c) graduates from college.

This paper describes a student-centered approach to teaching and learning physics in a high school classroom. The teacher designs and uses a 5E learning cycle to teach series and parallel electric circuits. This article provides an example of the implementation of 5E model for a physics lesson to address three-dimensional learning-science and engineering practices, disciplinary core ideas, and crosscutting concepts. In this lesson, students could make predictions, exchange ideas, and collect and analyze data to construct evidence-based explanations about electric circuits, Ohm's law. This type of lesson design is effective to enhance students' engagement in scientific practices and develop conceptual understanding.

This study reviewed thirty-seven articles on intercultural learning supported by technology. The results are reported in terms of strength of evidence and relationship among research variables. The results indicated the following strength of evidence: (1) moderate evidence showed higher frequency of the technology usage in higher education or above; strong evidence revealed that technology was applied more frequently in studies with large sample than in those with small sample; (2) moderate evidence demonstrated most of the main findings were obtained from studies related to higher education or above; (3) moderate evidence illustrated that the main finding was intercultural learning outcome and it was frequently obtained using various measuring instruments; (4) there was moderate evidence that mixed research was prevalent in the reviewed studies, and most of the main findings were obtained through mixed research; (5) strong evidence showed that computer vision technologies had the most significant impacts on participants' intercultural learning. In addition, the following five relationships were identified: participants and technology, participants and main findings, instruments and main findings, types and main findings, and impacts of technology on intercultural learning. Taken together, the implication of this research provides reliable evidence for driving innovation in technology-assisted cross-cultural learning studies.

Stereotypes can exert a powerful influence on our interactions with others, potentially leading to prejudice when factual evidence is ignored. Here, we identify neuroanatomical and developmental factors that influence the real-time integration of stereotypes and factual evidence during live social interactions. The study uses precisely quantified communicative exchanges in a longitudinal cohort of seventeen-year-olds followed since infancy, testing their ability to moderate stereotype tendencies toward children as contrary evidence accumulates. Our results indicate that the impact of stereotypes on communicative behavior is linked to individual variations in gray matter density and cortical thickness in the right anterior cingulate gyrus. In contrast, the ability to moderate stereotype tendencies is influenced by developmental exposure to social interactions during the initial years of life, beyond the effects of familial environment and later experiences. These findings pinpoint a key brain structure underlying stereotype tendencies and suggest that early-life social experiences have lasting consequences on how individuals integrate factual evidence in interpersonal communication.

The growing use of artificial intelligence in education extends and intensifies technologies of governing, including datafication, performativity and accountability. In this article, we outline how the use of AI and data science has the disruptive potential to create new norms in education policy and governance. We report on an ethnographic investigation into an education department initiative that involved data scientists using machine learning to identify causal links between different school-based and non-school based factors, and educational outcomes. The article proposes that machine learning is being introduced into this education department as a set of minor experiments in education governance. We focus on issues of changing expertise and evidence and differences in method between new data science approaches and established statistical expertise in this education department, in order to highlight minor but important new governance practices. We conclude that the increasing use of AI in education, as part of new cognitive infrastructures, is quietly shifting the ways in which education systems operate.

We explore ways in which statistics can be used to understand disease spread and support decision-making by governments. "Past performance does not guarantee future results"--we hope. We discuss and show examples from the National Science Foundation (NSF)-funded COVID-Inspired Data Science Education through Epidemiology (CIDSEE) project. Throughout, the emphasis is on the relationships between evidence, modeling and theorizing, and appropriate action. Statistics should be an essential element in all these aspects. We point to some "big statistical ideas" that underpin the whole process of modeling, which can be illustrated vividly in the context of pandemics. We argue that statistics education should emphasize the application of statistics in practical situations, and that many curricula do not equip students to use their understandings of statistics outside the classroom. We offer a framework for curriculum analysis and point to some rich teaching resources.

Previous research has shown that linguistic cues such as mental and modal verbs can influence young children's judgments about the reliability of informants. Further, certain languages include grammatical morphemes (i.e. evidential markers), which clarify the source of information coming from testimony (e.g., Bulgarian, Japanese, Turkish). Accordingly, the first aim of the current study is to examine whether Turkish-speaking children's reliability judgments change based on evidential markers (i.e. the past-tense "direct" evidential marker, -"DI", and the past-tense "indirect" evidential marker, -"mIs"). The literature has also investigated whether selective trust abilities are related to understanding the epistemic states of others (i.e., Theory of Mind). Therefore, the second aim is to examine the relation between selective trust based on evidential markers and ToM abilities by including a comprehensive ToM battery. Eighty-six Turkish-speaking preschool and elementary school children between the ages of 4 and 7, residing in a metropolitan city in Turkey, participated in a selective trust task based on evidential markers, a general language task, and a ToM battery. The results of the current study showed that after the age of 6, Turkish-speaking children start to selectively trust the informant using the past-tense direct evidential marker, -"DI", over the past-tense indirect evidential marker, -"mIs". Selective trust performance was related to receptive vocabulary but not to ToM abilities after controlling for participant gender and age. Overall, the results contribute to current discussions about children's selective trust ability based on linguistic cues and its relation with ToM.

The spread of misinformation has underscored the importance of cultivating citizens' competency to critically evaluate popular accounts of scientific evidence. Extending the prevailing emphasis on evidence in the natural sciences, we argue for fostering students' understanding of psychological evidence and its communication in the media. In this study, we illustrate how this goal can be advanced in undergraduate psychology instruction by actively engaging students in evidence evaluation and design. We employed the Grasp of Evidence framework to document students' evidence evaluation ideals and processes and how these changed over a course in which students engaged in a series of collaborative evidence evaluation and design tasks. Prior to instruction, students exhibited a mechanistic understanding of scientific methods, coupled with substantial reliance on personal experience. Following instruction, students demonstrated three key shifts in grasp of evidence: a shift in perception of the sources of psychological knowledge, a shift in views of scientific objectivity, and a shift in definitions of psychological phenomena. Analysis of students' collaborative discourse highlighted three design principles that supported increasingly complex understandings of psychological evidence: collaborative critique and redesign of flawed studies, engagement with diverse sources of popular evidence, and confronting elusive conceptual constructs.

The Interpersonal Behaviors Questionnaire (IBQ) in Sport assesses athlete perceptions of coach interpersonal behaviors that support or thwart athletes' basic psychological needs. While different sources of validity evidence for responses to the IBQ have been provided for adults, only validity evidence for relations to other variables has been provided with youth. Moreover, potential problems with internal structure for youths' responses to the IBQ have recently been noted and motivated the current study. Specifically, a three-phase mixed-methods design was employed to provide validity evidence for modification of the IBQ for youth. Phase I empirically examined the internal structure for youth athletes' responses to the IBQ. Phase II used cognitive think-aloud interviews to identify and then modify problematic IBQ items to create the Youth Interpersonal Behaviors Questionnaire in Sport (Y-IBQ). Phase III examined the psychometric properties of the Y-IBQ to provide initial validity evidence for this instrument in a youth athlete sample.

The purpose of this study was to explore the validity of evidence for self-efficacy to regulate physical activity scale (SERPA) measurement using an exploratory latent variable approach. The objectives were to explore the dimensionality, temporal invariance, and external validity of scores produced by the SERPA, a modified version of the barriers self-efficacy scale. Data (N[subscript baseline]= 461 and N[subscript 30 days post-baseline] = 427) from the Well-Being and Physical Activity Study (ClinicalTrials.gov, identifier: NCT03194854), which deployed the Fun For Wellness intervention, were analyzed. A two-dimensional factor structure explained responses to the SERPA at baseline. There was evidence for at least partial strict temporal measurement invariance for this two-dimensional structure. There was evidence for external validity of the SERPA measurement as evidenced by group assignment (i.e. the intervention) exerting a direct effect on the proposed two-dimensional structure of latent self-efficacy to regulate physical activity in adults with obesity at 30 days post-baseline.