Search

The COVID-19 pandemic caused tremendous upheaval in schooling. In addition to devasting effects on students, these disruptions had consequences for researchers conducting studies on education programs and policies. Given the likelihood of future large-scale disruptions, it is important for researchers to plan resilient studies and think critically about adaptations when such turbulence arises. In this article, we utilize qualitative analysis of interviews with research study leaders to illuminate practical and methodological challenges, as well as promising practices that arose during the pandemic period. We find that researchers made pivots to address practical challenges and protect the feasibility of their studies. We also find that researchers took precautions, where possible, to understand and bolster internal validity. However, these pivots frequently surfaced additional threats to construct and external validity. We conclude with recommendations for future studies conducted in times of prolonged unplanned school closures or other large-scale disruptions.

Identifying gifted students in today's complex context requires precision in both the definition of the concept and its constituent characteristics. However, there are discrepancies worldwide in the instruments established to diagnose gifted students. This study undertook a systematic literature review (SLR) to identify the most representative characteristics of this profile. A database of 676 articles from Scopus and WoS was analyzed, of which 37 were screened for further study using a content analysis approach. The study aimed to answer two research questions: (1) What are the prevailing characteristics of research on giftedness? (2) What are the challenges and barriers to current research and practice in gifted research? These inquiries were addressed through a series of disaggregated questions divided into four categories: publication metrics, study methodology, identification and support of giftedeness, and technology used. The main findings were a) the lack of standardized measures for identifying gifted individuals; b) the important role of teacher training in identifying and supporting gifted profiles; and c) the inherent limitations of research on giftedness, which constrain the generalizability of its findings. It was concluded that emotional intelligence plays a critical role in giftedness. Key challenges identified include discrepancies in giftedness identification instruments and the impact of cultural and socio-economic factors on gifted education.

Indigenous people are often hesitant to participate in research projects because they lack trust in researcher intentions. In this article, we explore the critical role that Indigenous boundary spanners play in research conducted with Indigenous communities through our research on oceans and human health. Our analysis centers around five principles where Indigenous boundary spanners significantly influence the research process. Centering work around 'ohana (family), being intentional around where to collect data, approaching the work with humility knowing that the community are the experts, cultivating team members' knowledge of community through conversations, and challenging assumptions within the institution are all aspects of research that must be considered when working with Indigenous communities. Including Indigenous community members and Indigenous scholars as part of teams can improve these aspects of research and begin the process of (re)building trust with Indigenous communities.

Astronomy education is essential for STEM education in primary schools, and integrating engineering design-based science education enhances student engagement and achievement in the field of space science. Integrating engineering design into science education is essential for students to excel in astronomy and to meet the requirements of contemporary society. This study investigated the effect of engineering design-based instruction (EDBI) on the understanding of astronomy concepts among sixth-grade students. The study included a cohort of 37 sixth-grade students from a public school. It was carried out using a one-group pre-test, post-test experimental design. All participants received EDBI that was based on the objectives of the 6th grade "Solar System and Eclipses" unit. Statistical analyses were employed to ascertain the effect of astronomy instruction based on engineering design on students' comprehension of astronomy concepts. The results indicated a significant difference in the average scores of students' understanding of astronomical concepts before and after being taught using EDBI.

Scientific literacy is decreasing in the Czech Republic and inquiry-based science education (IBSE), believed to enhance it, is used rarely. Meanwhile, outdoor teaching is on the rise, but it is unclear if it could help promote inquiry. This study examines the frequencies of outdoor teaching and IBSE and their relationship in self-reported practice among motivated educators. Two questionnaires were f illed out by educators who downloaded teaching resources in 2019 (N = 796) and those who enrolled in an online course in 2020 (N = 745). A high proportion of educators used some form of IBSE. Many of them unexpectedly often involved students in research design as part of IBSE. The frequency of student-designed investigation was correlated with the frequency of outdoor teaching in both samples. Both frequencies increased after the online course. This indicates that involving students in research design can be supported indirectly and that new professional development courses could use the attractiveness of outdoor education. Two groups of active teachers were identified, one focused on inquiry in their own class and the other motivating colleagues to teach outdoors. As they were represented more among primary school teachers, establishing learning communities consisting of both primary and lower-secondary science teachers could bring change to science education.

This study aims to obtain data and information about the effectiveness and practicality of YouTube in learning German speaking for second-semester students of the German language education study program in terms of learning outcomes and student responses. This study was experimental research, and the experimental model used was a pre-experimental design. The design form used is a one-group pre-test posttest group. The sample selection was done using the purposive sampling technique. Data collection was done through a German-speaking skill test. The data were analyzed using t-test analysis. The findings of the research revealed that there was a significant difference before and after using YouTube media in learning German speaking, and student responses showed very positive results of 87.28%, so it was declared successful, effective, and practical to use in learning German speaking.

Identifying and fostering gifted students is crucial in educational science and psychology. Giftedness diagnostics must be based on profound domain-specific concepts and acknowledge the variety of talents to enable a successful individual education. Growing challenges like digitalization, decarbonization, demographic changes, and pandemics increase the need for creative and productive professionals in STEM fields. Educational practitioners are expected to identify and foster these talents, confronted with the discourse between academic science and psychology about giftedness. Due to the lack of domain-specific diagnostic instruments, the individual expression of giftedness is often neglected during diagnostic procedures in educational practice and general intelligence tests are used instead. To address this problem, this paper presents the development process of a domain-specific diagnostic instrument for scientific giftedness. To bridge the gap between theory and practice and incorporate knowledge from various fields, the development process is integrated into Design-Based Research (DBR). Therefore, we theoretically examine how the principles of DBR and test development can be connected. We present our research approach and check how the planned development process can lead to a test instrument suitable for practice and further knowledge about giftedness diagnostics. The project demonstrates that DBR is suitable for developing didactic interventions but can also lead to innovations in psychometrics and improve giftedness diagnostics in practice through additional quality criteria.

This paper offers insights into how mathematics education researchers can learn from preservice teachers (PSTs) by building upon parallels between adapting curriculum-making and designing research. The pandemic created learning opportunities for PSTs to anticipate mathematics curriculum anew and obstacles for researchers to study their pedagogical processes. A multiple case study reveals how PSTs in Year 1 and Year 2 of a Bachelor of Education program reimagined their intended mathematics curriculum to meet the demands of the evolving pandemic context. Viewed through the lens of complexity thinking and conceptions of "currere" and curriculum-making, PSTs' lesson redesigns include new contexts for teaching and learning (e.g., home environment, parental/guardian involvement, materials) that illuminate how curriculum researchers might become more tentative, responsive, and adaptable to unforeseen circumstances.

Emerging technologies are transforming educational practices, but successful integration requires improving the quality and efficiency of learning. New technology emerges in hype cycles but adoption and performance lag over time. A strategy development framework is needed for decision-makers to understand the complex interaction of all the factors to consider when making new technology investments. The research explores how strategy development occurs through the dynamic interaction of strategy with learning, and technology integration. It analyses the key elements of a strategy map for learning with technology and how they influence each other within the overall strategy map. The research design integrated the different cycles of Design Science Research (DSR) with a modified Delphi Technique in two phases of research. During the first research phase, Delphi panel members were interviewed to understand current challenges and practices in learning with technology. The results of the literature review and thematic data analysis from the interviews were used to create a hypothetical strategy map and a strategy development framework, as an artefact, as part of the DSR process. This framework was shared with Delphi members in the second phase of research, and they were requested to evaluate the framework for its fit and utility in similar contexts of learning with technology. The feedback contributed to the refinement of the artefact and highlighted the key operational focus areas for learning with technology. The key operational focus areas identified were the need to increase the basic technology literacy of students and educators, continuous professional development in terms of online pedagogy, and the need for principles in terms of multimedia design. Other focus areas were an online design blueprint and an improvement in learning and teaching experiences through efficiencies and productivity of ed-tech technologies. This study contributes a strategy development framework for educational technology which enhances theories around the analytical and conceptual processes when planning and implementing new emerging technologies in learning. Analytical processes include external and internal analysis and a SWOT analysis of aspects related to learning with technology. Other key outcomes of the study include a hypothetical strategy map for learning with technology which aligns business objectives to a financial, customer, internal business process and learning and growth perspective.

Practitioner-focused educational doctoral programs have grown substantially in recent years. Dissertations in Practice (DiPs), which are the culminating research report and evaluation method in these programs, differ from traditional PhD dissertations in their focus on addressing a problem of practice and on connecting theories with practice. As part of our ongoing program evaluation, we reviewed DiPs from doctoral students who graduated from an online asynchronous Educational Doctoral program in Learning Design and Technologies at the University of South Carolina. Findings revealed that most students chose a pragmatic philosophical paradigm, adopted a mixed methods research design, reported an action research intervention implemented with populations in K-12 schools, used surveys and interviews as data sources, and analyzed data with descriptive/inferential statistics and thematic analysis. Implications for the program curriculum are discussed.

Hispanic-Serving Institutions (HSIs) are often characterized as Hispanic enrolling (rather than serving) that practice deficit-based systems that continue to marginalize Latinx and other underrepresented students, especially in STEM fields. Extant research on HSIs stresses the importance of investigating the value of grassroots advocacy groups as external influencers of institutional servingness through deeper engagement with the Latinx community. Using a novel family-centered theory of change that addresses diversity, equity, and inclusion, we integrated intersectionality and servingness into a family-integrated education serving and transforming academic framework. We investigated the potential transformational impact of this framework on students, families, faculty, and administrators at The University of Texas Rio Grande Valley, an institution with over 90% Latinx population, the majority of which are Mexican American. Preliminary findings shed light on how the framework can help reshape an HSI's identity from "Hispanic enrolling" to a true Hispanic-Serving Institution through Family-Centered Pedagogy. The Family-Centered Pedagogy enriches the learning experience in which students complement their instruction by drawing from their families' experience and ancestral knowledge, supported by the Family-Centered Theory of Change developed by AVE Frontera, our community partner.

The enormous developments in technology and hence the widespread use of hand-held devices in the last few decades have led to great interest in mobile-assisted language learning (MALL) as a new way of language education. MALL is considered an effective method particularly for young language learners due to their higher level of familiarity with the technology compared to their predecessors. Thus, an increasing number of mobile apps focusing on language education of children has been developed recently. It has also attracted researchers who carry out studies on MALL in terms of various perspectives such as learners' learning processes and perspectives. However, an important aspect of MALL which is the use of portable devices and apps individually out of school settings poses possible problems in terms of carrying out quasi-experimental studies. To this end, this paper combines three major areas in Applied Linguistics, namely, MALL, quasi-experimental research design, and young language learners and focuses on salient issues which are identified as lack of control, training, convenience of MALL activities for children, and ethical issues. Based on the TPACK framework, a new framework is proposed to incorporate young learners' characteristics in MALL studies. It is believed that the consideration of these points will be beneficial to future studies utilising quasi-experimental design in MALL with children.

There is an increasing interest in the integration of computational thinking (CT) in the K-12 curriculum. By integrating CT into other disciplines, the aim is to equip students with essential skills to navigate domain-specific challenges. This study conducts a systematic review of 108 peer-reviewed scientific papers to analyze in which K-12 subjects CT is being integrated, learning objectives, CT integration levels, instructional strategies, technologies and tools employed, assessment strategies, research designs and educational stages of participants. The findings reveal that: (a) over two-thirds of the CT integration studies predominantly focus on science and mathematics; (b) the majority of the studies implement CT at the substitution level rather than achieving a transformation impact; (c) active learning is a commonly mentioned instructional strategy, with block-based languages and physical devices being frequently utilized tools; (d) in terms of assessment, the emphasis primarily lies in evaluating attitudes towards technology or the learning context, rather than developing valid and reliable assessment instruments. These findings shed light on the current state of CT integration in K-12 education. The identified trends provide valuable insights for educators, curriculum designers, and policymakers seeking to effectively incorporate CT across various disciplines in a manner that fosters meaningful skill development with an interdisciplinary approach. By leveraging these insights, we can strive to enhance CT integration efforts, ensuring the holistic development of students' computational thinking abilities and promoting their preparedness for the increasingly interdisciplinary domains of digital world.

COVID-19 led to an increase in online higher education courses. With this increase in demand, there needs to be online support to foster students' academic success. Online academic student support is often provided to students to assist them in developing the skills and knowledge to successfully complete their courses. However, it remains unclear whether online academic student support in higher education is successful, and if so, what makes it successful. This systematic literature review seeks to provide an overview of research on online academic student support in higher education. Out of 5385 initially identified publications from 2013 to 2022, 12 papers were included for review; seven studies were quantitative and five were mixed-methods studies. The synthesis of the findings reported outcomes on students' improved engagement, access to support and usage patterns, satisfaction, academic performance, motivation, creativity, self-efficacy, retention or course completion, and social benefits. This range creates a challenge for higher education providers who consider implementing best practice in the provision of online academic student support due to the diversity of approaches. Future research that is methodologically strong is needed to demonstrate the impact of online academic student support detailing how higher education providers can improve the quality, learning outcomes, and retention of students.

Various areas of educational research are interested in the transitions between different states--or events--in sequential data, with the goal of understanding the significance of these transitions; one notable example is affect dynamics, which aims to identify important transitions between affective states. Unfortunately, several works have uncovered issues with the metrics and procedures commonly used to analyze these transitions. As such, our goal in this work is to address these issues by outlining an alternative procedure that is based on the use of marginal models. We begin by looking at the specific mechanisms responsible for a recently discovered statistical bias with several metrics used in sequential data analysis. After giving a theoretical explanation for the issue, we show that the marginal model procedure appears to adjust for this bias. Next, a related problem is that the common practice of removing transitions to repeated states has been shown to have unintended side-effects--to account for this issue, we develop a method for extending the marginal model procedure to this specific type of analysis. Finally, in a recent study evaluating the problem of multiple comparisons and sequential data analysis, the Benjamini-Hochberg (BH) procedure, a commonly used approach to control for false discoveries, did not perform as expected. By applying a technique from the biostatistics and epidemiology literature, we show that the performance of the BH procedure, when used with the marginal model method, can be brought back to its expected level. In all of our analyses, we evaluate the proposed method by both running simulations and using actual student data. The results indicate that the marginal model procedure seemingly compensates for the problems observed with other transition metrics, thus resulting in more accurate estimates of the importance of transitions between states.

Background/purpose: Awareness of the mathematical skills and knowledge children possess in their early years is widely accepted. This includes various common positive aspects, not only for educators but also for researchers and policymakers. This study presents a systematic review conducted to meticulously identify empirical studies published in the Scopus-Index Journal database about the mathematical skills children aged 3 to 8 years old have mastered. Materials/methods: This review followed the PRISMA guidelines and the research database comprised of Scopus-indexed journals. The technique followed used "keywords" and Boolean operators. The screening processes included reviewing abstracts, scanning complete texts of published articles, and rejecting those not meeting preset inclusion criteria. Moreover, systematic reviews, meta-analyses, and papers not written in English were also excluded. Of the 801 studies initially identified, a total of 15 empirical studies were included in the systematic review. Results: Children master various math skills from a very young age, mainly in "numbers and operations", but face difficulties in skills related to "algebra" as well as "geometry and measurement". Additionally, several preschoolers' characteristics help to explain the acquisition of these skills, with "age" being the primary factor. Researchers use various research instruments and mainly conduct individual semi-structured interviews. Children's geometry skills and knowledge appear to have been studied to a small extent. The areas of "measurement" and "data analysis and probability" were found to be under active investigation. Conclusion: It is worth noting that not only does a noticeable research gap exist for the math domains of "measurement," "geometry," and "data analysis and probability". Factors that seem to affect young children's math skills, such as "gender", "parents' educational level", and "attendance to a preparatory preschool" need further investigation. The implications of the current study's results extend beyond academia, providing valuable insights that educators and policymakers can leverage to enhance the quality of mathematics education during the early years period.

During the COVID-19 pandemic, the race to find an effective vaccine or treatment saw an 'extraordinary number' of clinical trials being conducted. While there were some key success stories, not all trials produced results that informed patient care. There was a significant amount of waste in clinical research during the pandemic which is said to have hampered an evidence-based response. Conducting trials which could have been predicted to fail to answer the research question (e.g. because they are not large enough to provide a definitive result) is not only a waste of resources but also a breach of research participants' trust and a violation of research ethics. The issues seen in COVID-19 clinical trials are symptomatic of a wider trial design crisis where many trials do not provide informative results. This paper examines the roles of key stakeholders in delivering ethical and informative trials and whether guidance published by 'The Good Clinical Trials Collaborative' could be used to align key stakeholder groups and enable a joined-up approach to improve clinical trial design.

Biology education research provides important guidance for educators aiming to ensure access for disabled students. However, there is still work to be done in developing similar guidelines for research settings. By using critical frameworks that amplify the voices of people facing multiple forms of marginalization, there is potential to transform current biology education research practices. Many biology education researchers are still in the early stages of understanding critical disability frameworks, such as Disability Critical Race Studies (DisCrit), which consists of seven tenets designed to explore the intersecting experiences of ableism and racism. Our Research Methods Essay uses DisCrit as a model framework and pulls from other related critical disability frameworks to empower disabled voices in biology education research. Drawing from existing scholarship, we discuss how biology education researchers can design, conduct, and share research findings. Additionally, we highlight strategies that biology education scholars can use in their research to support access for participants. We propose the creation and sharing of Access and Equity Maps to help plan--and make public--the steps researchers take to foster access in their research. We close by discussing frequently asked questions researchers may encounter in taking on critical frameworks, such as DisCrit.

In 1974, the United States Congress asked a question prompting a national conversation about ethics: which ethical principles should govern research involving human participants? To embark on an answer, Congress passed the National Research Act, and charged this task to the newly established National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. The Commission's mandate was modest however, the results were anything but. The outcome was "The Belmont Report:" a trio of principles -- respect for persons, beneficence, and justice -- serving as an ethical compass for scientists, researchers, and institutional review boards (IRBs). Almost 50 years later, the utility, legacy, and ingenuity of "The Belmont Report" continues to be both admired and challenged. Critics argue that Belmont is not fit for the 21st century, while supporters praise "Belmont" for its enduring wisdom. The goal of this paper is to equip IRB practitioners with the tools necessary to maximally interpret "The Belmont Report" and meaningfully engage in ethical analysis that reconsiders outmoded legacy thinking and fixed decision-making. Through historical and contextual reflection, this paper describes how IRB practitioners can contemporize review of ethical human research using their moral imagination - a skill found at the intersection of creativity, deliberation, and empathy.

Since its onset, scholars have characterized social media as a valuable source for data collection since it presents several benefits (e.g. exploring research questions with hard-to-reach populations). Nonetheless, methods of online data collection are riddled with ethical and methodological challenges that researchers must consider if they want to adopt good practices when collecting and analyzing online data. Drawing from our primary research project, where we collected passive online data on Reddit, we explore and detail the steps that researchers must consider before collecting online data: (1) planning online data collection; (2) ethical considerations; and (3) data collection. We also discuss two atypical questions that researchers should also consider: (1) how to handle deleted user-generated content; and (2) how to quote user-generated content. Moving on from the dichotomous discussion between what is public and private data, we present recommendations for good practices when collecting and analyzing qualitative online data.

Although well established in developed countries, Ethics review boards in the academia, and specifically for social and behavioral sciences (SBS) research, is a relatively new, and still a controversy inducing endeavor. This study explores the establishment and functioning of ERBs in Israeli academia, serving as a case study for the challenges and progress made in ensuring ethical research practices in non-medical related spheres. A purposeful sample of 46 participants was selected, comprising ERB current or past members and SBS researchers, who each interacted extensively with ERB's evaluation processes. The participants came from all eight research universities of Israel, as well as seven large public and private academic colleges. Open, semi structured In-depth interviews were conducted in order to facilitate a critical reflective stance among the various participants, exploring their experiences, behaviors and the meanings they assign to ERB processes. Our research revealed two major themes. The first is the developmental trajectories in the construction processes of ERBs in Israel, comprised of the following stages: Initiation, expansion, opposition, and acceptance and assimilation. The second was a typology of participation throughout the ERBs' construction process. Inspired by Merton's strain theory, this typology includes conformists, ritualists, ideologists, control-freaks, and insurgents. The findings expose a unique perspective into the initiation, establishment, and development of ERBs, which can shed light on the role of ERBs in general, as well as point out how resistance to ERBs, as well as the different reasons for championing them, affected not only ERBs form and their legitimacy, but also their interaction with researchers.

This paper describes a content analysis used to examine educational doctoral degrees (EdD) dissertations in a U.S. university. The purpose of the study was to get a better understanding of the validation techniques utilized in dissertations published by EdD students. Forty-nine dissertations were selected and examined for research methodologies, research design, and elements of vigorous validation techniques. The most frequently found methodology was quantitative (n = 30; 61.22%) followed by qualitative (n = 13; 26.53%). Among the quantitative studies, the most frequently used design was survey (n = 18; 60%). The most frequently used design in qualitative studies was case study (n = 6; 12.14%). Validation techniques for quantitative designs were mostly content validity (n = 18; 50.00%). Trustworthiness techniques for qualitative designs were mostly member checking (n = 8; 19.51%). There were no legitimation techniques identified for mixed methods designs. Implications for this study in higher education include EdD doctoral students and committees use at least three techniques for validation purposes.

The implementation of context-based chemistry programs has been started before 40 years ago since 1980s in an attempt to make the learning of chemistry more meaningful for students. Consequent to its lengthy, there has been a steady increase in the number of interventional context-based (ICB) approach chemistry studies investigating the effect of various instructional strategies on students' learning outcomes from primary to post-secondary levels. However, there is a limitation of the literature review conducted on interventional context-based chemistry studies. Hence, the present review was carried out to evaluate interventional context-based chemistry studies using six research questions based on the following categories (main headings): (1) countries or continents in which ICB chemistry studies were conducted in; (2) research methodologies implemented in ICB studies; (3) topics in which ICB chemistry studies used; (4) learning variables measured by ICB studies; (5) teaching methods and instructional strategies adopted by ICB studies; and (6) the effectiveness of context-based instructions on students' learning outcomes. Moreover, some sub-headings also followed the main headings. To achieve this objective, a rigorous systematic literature review has been executed using 25 selected ICB chemistry studies published between the years 2009 and 2022 based on the specific inclusion and exclusion criteria. These studies were accessed in internationally well-known databases (Google Scholar, ERIC, Semantic Scholar, and Mendeley); and the studies were organized and reviewed thematically. To summarize and present the findings of the studies, matrices, constructed by the researcher, were used. The review analysis results revealed and shed light on the critical appraisal of interventional context-based chemistry studies, missing parts of the context-based approach, and implications and suggestions for future studies.

This qualitative case study contributed to the existing body of knowledge by examining the empowering effect of faculty mentorship on the research skill development of MAEd students. The professor-mentorship provided to MAEd students played a vital role in developing their research skills. Throughout the research process, professor-mentors guided and supported students, enhancing their abilities in selecting research topics, conducting literature reviews, designing methodologies, and analyzing data. The mentorship improved methodological rigor and fostered critical thinking, analytical skills, and a deeper comprehension of the research process. Feedback and support from mentors were instrumental in refining students' research proposals, writing, and presentations. Professor-mentors encouraged students to share their research findings through conferences and publications, providing valuable growth opportunities. This exposure boosted students' research skills and bolstered their confidence as researchers. Overall, professor mentors' mentorship significantly shaped the research skills and career paths of MAEd students, instilling a passion for evidence-based practices in education and preparing them for future research endeavors.

Outside of education, many academic disciplines developed and promulgated checklists to evaluate the quality of qualitative studies. This article used an embedded mixed methods approach in three stages: development of a conceptual framework reviewing 62 guidelines; a content analysis of key areas of the guidelines; and review of dissertations to see how practices compare to model guidelines. Using 15 educational administration dissertations in the United States, a thematic analysis examined components of the three frameworks: planning the study, in the field, and reporting results. Many researchers failed to adequately describe methods in all phases, with lack of intensity in fieldwork being a ubiquitous problem. Developing validity and reliability should move from a post hoc procedure to a central component in all stages of design. The implications of the frameworks move beyond a rigid checklist and provide direction to develop strategic mapping for designing research in an iterative fashion to optimize representativeness of findings.

This systematic review examined research on moderators in asynchronous online discussions (AODs) through a review of 52 sources published over the past four decades. Areas of interest included conceptual frameworks cited in research, publication trends, instructional contexts, research methods and characteristics, and descriptions of the role of the moderator with implications for practice. Results indicate: (1) nearly half of the publications did not cite a conceptual framework focused on moderation; (2) the field is diverse with a wide variety of themes for research designs, outcomes, foci, and questions; (3) half of reviewed publications involved case studies or similarly limited study designs; (4) the majority of publications collected data on students in higher education, but there was a lack of consistency in the reporting of demographic information; (5) research foci tended toward investigating peer moderators or the role of the instructor; (6) research questions tended to focus on strategies of moderators or student performance and discussion quality; (7) most definitions or expectations of a moderator included discussion and social management duties. We conclude by discussing the implications of some of the findings and future research options.

This research systematically examines the experimental articles on STEM education (science, technology, engineering, and mathematics education). In this direction, experimental articles with the Social Sciences Citation Index on the Web of Science were analyzed within the scope of research questions, taking into account the guidelines of PRISMA. The research was carried out using the systematic review method. In the first search made in this line, the results listed 17,482 studies. Then, this number was reduced to 34 by applying the inclusion and exclusion criteria. Finally, the studies were examined in detail, and 12 articles that were not suitable were excluded from the scope. Thus, this research was carried out on 22 articles. In line with research problems, articles were categorized by publication year, country, method, study group and number, data collection tools, data analysis methods, topics covered, and experimental methods. The research results infer that the number of articles increases every year, and Turkey and China are the pioneering countries in this sense. It is noteworthy that mixed methods and quasi-experimental methods are generally preferred in the literature. Contrary to the literature, another result obtained from the research is that teachers are preferred in variable numbers as the study group. Scales, tests, and interviews are the most frequently used measurement tools by researchers. Besides, t-tests and content analysis are used in data analysis. Additionally, various topics are covered in the articles. One of the results obtained from the research is that the effect of STEM education on various skills and achievements is examined more. In line with these results, some suggestions were made by discussing the studies in the literature.

Introduction: Clinician-client relationships impact treatment outcomes in speech-language pathology. Training clinicians to improve these relationships might therefore improve treatment outcomes but has not been examined in the field. This study is a preliminary investigation of whether training student clinicians can enhance clinician-client relationships in children's speech-language treatment. Methods: The study followed a single-subject multiple baseline design. Five graduate student clinicians completed a web-based training on clinician-client relationships, which was implemented as a series of three modules discussing goals, tasks, and bond. The training's impact on the student's relationships with their child clients was examined through weekly ratings completed by the students, their supervisor, and some parents and children. Intervention effects were measured by visual analysis of baseline versus intervention phases and by Tau-U effect sizes. Results: Visual analyses supported change in just under half the possible opportunities, but improvements in the relationship were also present in many of the baseline phases. Tau-U effects that corrected for baseline trend reached significance in 18 of 29 instances, providing support for the effects of the intervention. Conclusions: This study provides initial evidence that clinician-client relationship training can be effective for speech-language pathology graduate students. Clinician-client relationship training is a promising area for future investigation.

The multi-decade debates within the field of behavior analysis as to the possible value and threat of group design methodology and statistical analyses on the purity of the field have weakened the discipline's maximal impact on the world. This paper rebukes the concerns and suggests that through such adoption behavior analysis may likely better achieve its world-changing ideals, and pragmatic initiatives. We begin with a historical trace of the current debate and describe the pros and cons to design/analysis inclusion, frame such matters within the context of contemporary issues which applied behavior analysts find themselves concerned, and ultimately put forward means by which broader, and perhaps more impactful, research questions can be asked and interpreted.

The quality of mixing methods has been widely debated in the field of applied linguistics (AL) and the integration of data from both quantitative and qualitative research paradigms has always been open to controversy. The present study was aimed at recognizing the status quo of MMR in AL, investigating the nature of various sections of MMR studies, and specifying the way the pattern of employing MMR has changed over the past few years. From a total of 1,314 articles in seven peer-reviewed accredited AL journals, 220 articles were finally identified to be mixed in method which were subsequently scrutinized based on already established frameworks regarding their research questions, research designs, sampling designs, and inference quality to explore the status quo of mixed methods research (MMR) in AL. We went through two phases of screening to identify the articles which met the principles of MMR and analyzed the selected articles qualitatively based on a coding scheme. The findings revealed (a) only a few research questions were hybrid, (b) both concurrent research designs and concurrent sampling designs were employed more frequently than their sequential counterparts, and (c) only a few articles made their inferences mixed in a principled manner. The findings of several extracts and an open-ended questionnaire showed a growing interest in MMR and the challenges and problems of conducting MMR, respectively. The results might imply that the new paradigms of research favor mixing methods and that the researchers employ it more due to its strengths.

To advance and encourage partnerships between institutions and their greater communities, academic reward structures must be designed in ways that support those who choose to leverage their expertise, resources, and time to engage with community in meaningful and mutually beneficial ways. This study investigates how school- and department-level promotion and tenure committees define, understand, and "evaluate" faculty's engaged research. Specifically, this study explored what goes into making evaluative decisions and how evaluative decisions are made (e.g., how review committees define and categorize faculty's engaged research, what metrics are used to assess it). In this single case multi-site qualitative study 12 participants across five R1 institutions classified as "engaged" by the Carnegie Foundation participated in semi-structured interviews. All participants were tenured, engaged scholars with experience serving on a school- and/or department-level promotion and tenure review committee. Findings demonstrate that review committees struggle to define, categorize, and evaluate community engaged research in promotion and tenure, as they are forced to exclusively rely on a traditional set of metrics to evaluate the engaged work of their peers. Though universities are making strides to institutionalize engagement, appropriate recognition of engaged research within promotion and tenure is not yet a reality.

Panahi and Mohebbi review James Dean Brown's 50-years of research in language testing, curriculum development and research statistics with reference to an impressionistic framework for analysis containing two components with their subcomponents: Annotations (i.e., briefing and implications) and main concepts and themes (i.e., testing and teaching terminology, research design, research instruments, data analysis, and domains). The review was carried out in two phases: In Phase I, we (Ali Panahi and Hassan Mohebbi) reviewed Brown's all works and extracted approximately 1100 main concepts and themes leading to 28 main entries for testing and teaching terminology. The issues he has examined are much more extensive; the first 10 topics and themes most widely investigated, in the order of frequency, are language testing and assessment, research and statistics, curriculum development and language programs, cloze tests, CRTs and NRTs, TESOL, ESL, applied linguistics and language testing, placement, standardized and proficiency tests, connected speech and reduced forms, pragmatics tests and issues, and reliability and validity. In Phase II, JD Brown provides a discussion and his personal reflections on the systematic review.

This study aims to descriptively analyze the studies on multiple disabilities in Türkiye between 2008 and 2022. The data of the research were searched in Anadolu University Library, Google Scholar, and Higher Education Institution Thesis databases with the keywords multiple disability, multiple disabilities, and additional disability. In this context, 15 postgraduate thesis studies and 17 articles were included in the research. The studies included in the study were analyzed under themes such as the year they were published, the university where the study took place, the keywords of the study, the method of the study, the design, the data collection technique/tool, and data analysis method, the journal in which the study was published and its index. As a result of the descriptive analysis, more adjustments were made to the qualitative research method, design, data collection technique, and paper clips. The studies used several studies in which individuals with multiple disabilities were participants in addition to those with visual impairments. The studies were carried out within the body of Gazi University. The studies have been published in journals that are extensively scanned in the ESCI index. At the end of the research, forward-looking suggestions are presented.

This article ponders the question: "How might EdD research methods courses be reimagined to position Black Feminist Theory as a comparable theoretical framework to guide epistemological stance development and scholar-practitioner inquiry?" By introducing Black Feminist Theory as a viable theoretical framework, this article posits its potential incorporation into reimagined EdD research methods courses. After providing a more detailed description of Black Feminist Theory and its associated constructs, the ways that Black Feminist Theory can shape scholar-practitioners' inquiry is explored, including: 1) framing a problem of practice, 2) building conceptual and/or theoretical frameworks, and 3) connecting to research design and approaches. Implications for Black Feminist Theory's alignment to the CPED framework are discussed.

Although experimental evaluations have been labeled the "gold standard" of evidence for policy (U.S. Department of Education, 2003), evaluations without an analysis of costs are not sufficient for policymaking (Monk, 1995; Ross et al., 2007). Funding organizations now require cost-effectiveness data in most evaluations of effects. Yet, there is little guidance on how to integrate research on costs into efficacy or effectiveness evaluations. As a result, research proposals and papers are disjointed in the treatment of costs, implementation, and effects, and studies often miss opportunities to integrate what is learned from the cost component into what is learned about effectiveness. To address this issue, this paper uses common evaluation frameworks to provide guidance for integrating research on costs into the design of field experiments building on the ingredients method (Levin et al., 2018). The goal is to improve study design, resulting in more cohesive, efficient, and higher-quality evaluations.

The increasing volume of large-scale assessment data poses a challenge for testing organizations to manage data and conduct psychometric analysis efficiently. Traditional psychometric software presents barriers, such as a lack of functionality for managing data and conducting various standard psychometric analyses efficiently. These challenges have resulted in high costs to achieve the desired research and analysis outcomes. To address these challenges, we have designed and implemented a modernized data pipeline that allows psychometricians and statisticians to efficiently manage the data, conduct psychometric analysis, generate technical reports, and perform quality assurance to validate the required outputs. This modernized pipeline has proven to scale with large databases, decrease human error by reducing manual processes, efficiently make complex workloads repeatable, ensure high quality of the outputs, and reduce overall costs of psychometric analysis of large-scale assessment data. This paper aims to provide information to support the modernization of the current psychometric analysis practices. We shared details on the workflow design and functionalities of our modernized data pipeline, which provide a universal interface to large-scale assessments. The methods for developing non-technical and user-friendly interfaces will also be discussed.