Search

The COVID-19 pandemic caused tremendous upheaval in schooling. In addition to devasting effects on students, these disruptions had consequences for researchers conducting studies on education programs and policies. Given the likelihood of future large-scale disruptions, it is important for researchers to plan resilient studies and think critically about adaptations when such turbulence arises. In this article, we utilize qualitative analysis of interviews with research study leaders to illuminate practical and methodological challenges, as well as promising practices that arose during the pandemic period. We find that researchers made pivots to address practical challenges and protect the feasibility of their studies. We also find that researchers took precautions, where possible, to understand and bolster internal validity. However, these pivots frequently surfaced additional threats to construct and external validity. We conclude with recommendations for future studies conducted in times of prolonged unplanned school closures or other large-scale disruptions.

Identifying gifted students in today's complex context requires precision in both the definition of the concept and its constituent characteristics. However, there are discrepancies worldwide in the instruments established to diagnose gifted students. This study undertook a systematic literature review (SLR) to identify the most representative characteristics of this profile. A database of 676 articles from Scopus and WoS was analyzed, of which 37 were screened for further study using a content analysis approach. The study aimed to answer two research questions: (1) What are the prevailing characteristics of research on giftedness? (2) What are the challenges and barriers to current research and practice in gifted research? These inquiries were addressed through a series of disaggregated questions divided into four categories: publication metrics, study methodology, identification and support of giftedeness, and technology used. The main findings were a) the lack of standardized measures for identifying gifted individuals; b) the important role of teacher training in identifying and supporting gifted profiles; and c) the inherent limitations of research on giftedness, which constrain the generalizability of its findings. It was concluded that emotional intelligence plays a critical role in giftedness. Key challenges identified include discrepancies in giftedness identification instruments and the impact of cultural and socio-economic factors on gifted education.

Indigenous people are often hesitant to participate in research projects because they lack trust in researcher intentions. In this article, we explore the critical role that Indigenous boundary spanners play in research conducted with Indigenous communities through our research on oceans and human health. Our analysis centers around five principles where Indigenous boundary spanners significantly influence the research process. Centering work around 'ohana (family), being intentional around where to collect data, approaching the work with humility knowing that the community are the experts, cultivating team members' knowledge of community through conversations, and challenging assumptions within the institution are all aspects of research that must be considered when working with Indigenous communities. Including Indigenous community members and Indigenous scholars as part of teams can improve these aspects of research and begin the process of (re)building trust with Indigenous communities.

Astronomy education is essential for STEM education in primary schools, and integrating engineering design-based science education enhances student engagement and achievement in the field of space science. Integrating engineering design into science education is essential for students to excel in astronomy and to meet the requirements of contemporary society. This study investigated the effect of engineering design-based instruction (EDBI) on the understanding of astronomy concepts among sixth-grade students. The study included a cohort of 37 sixth-grade students from a public school. It was carried out using a one-group pre-test, post-test experimental design. All participants received EDBI that was based on the objectives of the 6th grade "Solar System and Eclipses" unit. Statistical analyses were employed to ascertain the effect of astronomy instruction based on engineering design on students' comprehension of astronomy concepts. The results indicated a significant difference in the average scores of students' understanding of astronomical concepts before and after being taught using EDBI.

Scientific literacy is decreasing in the Czech Republic and inquiry-based science education (IBSE), believed to enhance it, is used rarely. Meanwhile, outdoor teaching is on the rise, but it is unclear if it could help promote inquiry. This study examines the frequencies of outdoor teaching and IBSE and their relationship in self-reported practice among motivated educators. Two questionnaires were f illed out by educators who downloaded teaching resources in 2019 (N = 796) and those who enrolled in an online course in 2020 (N = 745). A high proportion of educators used some form of IBSE. Many of them unexpectedly often involved students in research design as part of IBSE. The frequency of student-designed investigation was correlated with the frequency of outdoor teaching in both samples. Both frequencies increased after the online course. This indicates that involving students in research design can be supported indirectly and that new professional development courses could use the attractiveness of outdoor education. Two groups of active teachers were identified, one focused on inquiry in their own class and the other motivating colleagues to teach outdoors. As they were represented more among primary school teachers, establishing learning communities consisting of both primary and lower-secondary science teachers could bring change to science education.

This study aims to obtain data and information about the effectiveness and practicality of YouTube in learning German speaking for second-semester students of the German language education study program in terms of learning outcomes and student responses. This study was experimental research, and the experimental model used was a pre-experimental design. The design form used is a one-group pre-test posttest group. The sample selection was done using the purposive sampling technique. Data collection was done through a German-speaking skill test. The data were analyzed using t-test analysis. The findings of the research revealed that there was a significant difference before and after using YouTube media in learning German speaking, and student responses showed very positive results of 87.28%, so it was declared successful, effective, and practical to use in learning German speaking.

Identifying and fostering gifted students is crucial in educational science and psychology. Giftedness diagnostics must be based on profound domain-specific concepts and acknowledge the variety of talents to enable a successful individual education. Growing challenges like digitalization, decarbonization, demographic changes, and pandemics increase the need for creative and productive professionals in STEM fields. Educational practitioners are expected to identify and foster these talents, confronted with the discourse between academic science and psychology about giftedness. Due to the lack of domain-specific diagnostic instruments, the individual expression of giftedness is often neglected during diagnostic procedures in educational practice and general intelligence tests are used instead. To address this problem, this paper presents the development process of a domain-specific diagnostic instrument for scientific giftedness. To bridge the gap between theory and practice and incorporate knowledge from various fields, the development process is integrated into Design-Based Research (DBR). Therefore, we theoretically examine how the principles of DBR and test development can be connected. We present our research approach and check how the planned development process can lead to a test instrument suitable for practice and further knowledge about giftedness diagnostics. The project demonstrates that DBR is suitable for developing didactic interventions but can also lead to innovations in psychometrics and improve giftedness diagnostics in practice through additional quality criteria.

This paper offers insights into how mathematics education researchers can learn from preservice teachers (PSTs) by building upon parallels between adapting curriculum-making and designing research. The pandemic created learning opportunities for PSTs to anticipate mathematics curriculum anew and obstacles for researchers to study their pedagogical processes. A multiple case study reveals how PSTs in Year 1 and Year 2 of a Bachelor of Education program reimagined their intended mathematics curriculum to meet the demands of the evolving pandemic context. Viewed through the lens of complexity thinking and conceptions of "currere" and curriculum-making, PSTs' lesson redesigns include new contexts for teaching and learning (e.g., home environment, parental/guardian involvement, materials) that illuminate how curriculum researchers might become more tentative, responsive, and adaptable to unforeseen circumstances.

Emerging technologies are transforming educational practices, but successful integration requires improving the quality and efficiency of learning. New technology emerges in hype cycles but adoption and performance lag over time. A strategy development framework is needed for decision-makers to understand the complex interaction of all the factors to consider when making new technology investments. The research explores how strategy development occurs through the dynamic interaction of strategy with learning, and technology integration. It analyses the key elements of a strategy map for learning with technology and how they influence each other within the overall strategy map. The research design integrated the different cycles of Design Science Research (DSR) with a modified Delphi Technique in two phases of research. During the first research phase, Delphi panel members were interviewed to understand current challenges and practices in learning with technology. The results of the literature review and thematic data analysis from the interviews were used to create a hypothetical strategy map and a strategy development framework, as an artefact, as part of the DSR process. This framework was shared with Delphi members in the second phase of research, and they were requested to evaluate the framework for its fit and utility in similar contexts of learning with technology. The feedback contributed to the refinement of the artefact and highlighted the key operational focus areas for learning with technology. The key operational focus areas identified were the need to increase the basic technology literacy of students and educators, continuous professional development in terms of online pedagogy, and the need for principles in terms of multimedia design. Other focus areas were an online design blueprint and an improvement in learning and teaching experiences through efficiencies and productivity of ed-tech technologies. This study contributes a strategy development framework for educational technology which enhances theories around the analytical and conceptual processes when planning and implementing new emerging technologies in learning. Analytical processes include external and internal analysis and a SWOT analysis of aspects related to learning with technology. Other key outcomes of the study include a hypothetical strategy map for learning with technology which aligns business objectives to a financial, customer, internal business process and learning and growth perspective.

Practitioner-focused educational doctoral programs have grown substantially in recent years. Dissertations in Practice (DiPs), which are the culminating research report and evaluation method in these programs, differ from traditional PhD dissertations in their focus on addressing a problem of practice and on connecting theories with practice. As part of our ongoing program evaluation, we reviewed DiPs from doctoral students who graduated from an online asynchronous Educational Doctoral program in Learning Design and Technologies at the University of South Carolina. Findings revealed that most students chose a pragmatic philosophical paradigm, adopted a mixed methods research design, reported an action research intervention implemented with populations in K-12 schools, used surveys and interviews as data sources, and analyzed data with descriptive/inferential statistics and thematic analysis. Implications for the program curriculum are discussed.

Hispanic-Serving Institutions (HSIs) are often characterized as Hispanic enrolling (rather than serving) that practice deficit-based systems that continue to marginalize Latinx and other underrepresented students, especially in STEM fields. Extant research on HSIs stresses the importance of investigating the value of grassroots advocacy groups as external influencers of institutional servingness through deeper engagement with the Latinx community. Using a novel family-centered theory of change that addresses diversity, equity, and inclusion, we integrated intersectionality and servingness into a family-integrated education serving and transforming academic framework. We investigated the potential transformational impact of this framework on students, families, faculty, and administrators at The University of Texas Rio Grande Valley, an institution with over 90% Latinx population, the majority of which are Mexican American. Preliminary findings shed light on how the framework can help reshape an HSI's identity from "Hispanic enrolling" to a true Hispanic-Serving Institution through Family-Centered Pedagogy. The Family-Centered Pedagogy enriches the learning experience in which students complement their instruction by drawing from their families' experience and ancestral knowledge, supported by the Family-Centered Theory of Change developed by AVE Frontera, our community partner.

The enormous developments in technology and hence the widespread use of hand-held devices in the last few decades have led to great interest in mobile-assisted language learning (MALL) as a new way of language education. MALL is considered an effective method particularly for young language learners due to their higher level of familiarity with the technology compared to their predecessors. Thus, an increasing number of mobile apps focusing on language education of children has been developed recently. It has also attracted researchers who carry out studies on MALL in terms of various perspectives such as learners' learning processes and perspectives. However, an important aspect of MALL which is the use of portable devices and apps individually out of school settings poses possible problems in terms of carrying out quasi-experimental studies. To this end, this paper combines three major areas in Applied Linguistics, namely, MALL, quasi-experimental research design, and young language learners and focuses on salient issues which are identified as lack of control, training, convenience of MALL activities for children, and ethical issues. Based on the TPACK framework, a new framework is proposed to incorporate young learners' characteristics in MALL studies. It is believed that the consideration of these points will be beneficial to future studies utilising quasi-experimental design in MALL with children.

There is an increasing interest in the integration of computational thinking (CT) in the K-12 curriculum. By integrating CT into other disciplines, the aim is to equip students with essential skills to navigate domain-specific challenges. This study conducts a systematic review of 108 peer-reviewed scientific papers to analyze in which K-12 subjects CT is being integrated, learning objectives, CT integration levels, instructional strategies, technologies and tools employed, assessment strategies, research designs and educational stages of participants. The findings reveal that: (a) over two-thirds of the CT integration studies predominantly focus on science and mathematics; (b) the majority of the studies implement CT at the substitution level rather than achieving a transformation impact; (c) active learning is a commonly mentioned instructional strategy, with block-based languages and physical devices being frequently utilized tools; (d) in terms of assessment, the emphasis primarily lies in evaluating attitudes towards technology or the learning context, rather than developing valid and reliable assessment instruments. These findings shed light on the current state of CT integration in K-12 education. The identified trends provide valuable insights for educators, curriculum designers, and policymakers seeking to effectively incorporate CT across various disciplines in a manner that fosters meaningful skill development with an interdisciplinary approach. By leveraging these insights, we can strive to enhance CT integration efforts, ensuring the holistic development of students' computational thinking abilities and promoting their preparedness for the increasingly interdisciplinary domains of digital world.

COVID-19 led to an increase in online higher education courses. With this increase in demand, there needs to be online support to foster students' academic success. Online academic student support is often provided to students to assist them in developing the skills and knowledge to successfully complete their courses. However, it remains unclear whether online academic student support in higher education is successful, and if so, what makes it successful. This systematic literature review seeks to provide an overview of research on online academic student support in higher education. Out of 5385 initially identified publications from 2013 to 2022, 12 papers were included for review; seven studies were quantitative and five were mixed-methods studies. The synthesis of the findings reported outcomes on students' improved engagement, access to support and usage patterns, satisfaction, academic performance, motivation, creativity, self-efficacy, retention or course completion, and social benefits. This range creates a challenge for higher education providers who consider implementing best practice in the provision of online academic student support due to the diversity of approaches. Future research that is methodologically strong is needed to demonstrate the impact of online academic student support detailing how higher education providers can improve the quality, learning outcomes, and retention of students.

Various areas of educational research are interested in the transitions between different states--or events--in sequential data, with the goal of understanding the significance of these transitions; one notable example is affect dynamics, which aims to identify important transitions between affective states. Unfortunately, several works have uncovered issues with the metrics and procedures commonly used to analyze these transitions. As such, our goal in this work is to address these issues by outlining an alternative procedure that is based on the use of marginal models. We begin by looking at the specific mechanisms responsible for a recently discovered statistical bias with several metrics used in sequential data analysis. After giving a theoretical explanation for the issue, we show that the marginal model procedure appears to adjust for this bias. Next, a related problem is that the common practice of removing transitions to repeated states has been shown to have unintended side-effects--to account for this issue, we develop a method for extending the marginal model procedure to this specific type of analysis. Finally, in a recent study evaluating the problem of multiple comparisons and sequential data analysis, the Benjamini-Hochberg (BH) procedure, a commonly used approach to control for false discoveries, did not perform as expected. By applying a technique from the biostatistics and epidemiology literature, we show that the performance of the BH procedure, when used with the marginal model method, can be brought back to its expected level. In all of our analyses, we evaluate the proposed method by both running simulations and using actual student data. The results indicate that the marginal model procedure seemingly compensates for the problems observed with other transition metrics, thus resulting in more accurate estimates of the importance of transitions between states.

Background/purpose: Awareness of the mathematical skills and knowledge children possess in their early years is widely accepted. This includes various common positive aspects, not only for educators but also for researchers and policymakers. This study presents a systematic review conducted to meticulously identify empirical studies published in the Scopus-Index Journal database about the mathematical skills children aged 3 to 8 years old have mastered. Materials/methods: This review followed the PRISMA guidelines and the research database comprised of Scopus-indexed journals. The technique followed used "keywords" and Boolean operators. The screening processes included reviewing abstracts, scanning complete texts of published articles, and rejecting those not meeting preset inclusion criteria. Moreover, systematic reviews, meta-analyses, and papers not written in English were also excluded. Of the 801 studies initially identified, a total of 15 empirical studies were included in the systematic review. Results: Children master various math skills from a very young age, mainly in "numbers and operations", but face difficulties in skills related to "algebra" as well as "geometry and measurement". Additionally, several preschoolers' characteristics help to explain the acquisition of these skills, with "age" being the primary factor. Researchers use various research instruments and mainly conduct individual semi-structured interviews. Children's geometry skills and knowledge appear to have been studied to a small extent. The areas of "measurement" and "data analysis and probability" were found to be under active investigation. Conclusion: It is worth noting that not only does a noticeable research gap exist for the math domains of "measurement," "geometry," and "data analysis and probability". Factors that seem to affect young children's math skills, such as "gender", "parents' educational level", and "attendance to a preparatory preschool" need further investigation. The implications of the current study's results extend beyond academia, providing valuable insights that educators and policymakers can leverage to enhance the quality of mathematics education during the early years period.

Single-case experimental designs (SCEDs) may offer a reliable and internally valid way to evaluate technology-enhanced learning (TEL). A systematic review was conducted to provide an overview of what, why and how SCEDs are used to evaluate TEL. Accordingly, 136 studies from nine databases fulfilling the inclusion criteria were included. The results showed that most of the studies were conducted in the field of special education focusing on evaluating the effectiveness of computer-assisted instructions, video prompts and mobile devices to improve language and communication, socio-emotional, skills and mental health. The research objective of most studies was to evaluate the effects of the intervention; often no specific justification for using SCED was provided. Additionally, multiple baseline and phase designs were the most common SCED types, with most measurements in the intervention phase. Frequent data collection methods were observation, tests, questionnaires and task analysis, whereas, visual and descriptive analysis were common methods for data analysis. Nearly half of the studies did not acknowledge any limitations, while a few mentioned generalization and small sample size as limitations. The review provides valuable insights into utilizing SCEDs to advance TEL evaluation methodology and concludes with a reflection on further opportunities that SCEDs can offer for evaluating TEL.

Photovoice involves respondents taking photographs of their environment to promote critical discussions and reflect on their experiences. Photovoice empowers marginalized communities and serves to reach policymakers. The Arizona Youth Identity Project (AZYIP) used photovoice with an innovative approach in a multisite research design with a large sample size and completely online research implementation using video conferencing, mobile phones, and video messages. We outline our process for other researchers interested in utilizing this dynamic method. We also reflect on the challenges and opportunities of engaging in this research design for future projects.

Research is about an individual's intellectual acumen and rationality, and inter-researcher collaboration capability magnifies the outcomes. Despite common belief, there exist fundamental asymmetries in the goals, orientations and expectations among the research collaborators. Seldom studied in-depth and empirically validated, the challenges and barriers faced by early-career researchers (ECRs) in social sciences are crucial to understand. In this study, we aim to identify, categorize and rank the order of priority of the research collaboration barriers and their sub-barriers. This analysis highlights which barrier is likely to impact the research collaboration outcome more as compared to other barriers, as seen through the pairwise comparison. We contribute to the literature on research collaborations by providing a much-needed assessment of the barriers faced by ECRs in social sciences to develop a nuanced understanding of the dynamics within collaboration research. Key barriers identified and explored in this research relate to research design, interpersonal and interprofessional relationships, team-level dynamics, spatial and temporal factors, cultural differences and institutional variables. The fuzzy AHP tool was used to prioritize and rank the barriers, check the consistency ratio and then perform the sensitivity analysis. Research design barriers emerged as the most challenging barrier to research collaborations, implying researchers place huge emphasis on the compatibility of research goals, objectives, paradigms and perspectives. The study provides insights for individuals/institutions leading and managing research collaborations into improving the collaborative dynamics in social sciences.

Open science practices are designed to enhance the utility, integrity, and credibility of scientific research. This article highlights how preregistration in open science practice can be leveraged to enhance the rigor and transparency of single-case experimental designs within an applied behavior analysis framework. We provide an overview of the benefits of preregistration including increased transparency, reduced risk of researcher bias, and improved replicability, and we review the specific contexts under which these practices most benefit the proposed framework. We discuss potential concerns with and unique considerations for preregistering experiments that use single-case designs, with practical guidance for researchers who are seeking to preregister their studies. We present a checklist as a tool for researchers in applied behavior analysis to use for preregistration and provide recommendations for our field to strengthen the contingencies for open science practices that include preregistration.

During the COVID-19 pandemic, the race to find an effective vaccine or treatment saw an 'extraordinary number' of clinical trials being conducted. While there were some key success stories, not all trials produced results that informed patient care. There was a significant amount of waste in clinical research during the pandemic which is said to have hampered an evidence-based response. Conducting trials which could have been predicted to fail to answer the research question (e.g. because they are not large enough to provide a definitive result) is not only a waste of resources but also a breach of research participants' trust and a violation of research ethics. The issues seen in COVID-19 clinical trials are symptomatic of a wider trial design crisis where many trials do not provide informative results. This paper examines the roles of key stakeholders in delivering ethical and informative trials and whether guidance published by 'The Good Clinical Trials Collaborative' could be used to align key stakeholder groups and enable a joined-up approach to improve clinical trial design.

Educators and researchers strive to build policies and practices on data and evidence, especially on academic achievement scores. When assessment scores are inaccurate for specific student populations or when scores are inappropriately used, even data-driven decisions will be misinformed. To maximize the impact of the research-practice-policy collaborative, every stage of the assessment and research process needs to be critically interrogated. In this paper, we highlight the need to reframe assessment and research for multilingual learners, students with disabilities, and multilingual students with disabilities. We outline a framework that integrates three critical perspectives (QuantCrit, DisCrit, and critical multiculturalism) and discuss how this framework can be applied to assessment creation and research.

Designing rigorous studies to identify technology-based interventions to improve K-12 student reading skills require intervention researchers to take a "road less traveled." This chapter presents that road using the Knowledge Acquisition and Transformation Expansions (KATE) intervention as a case study. An early version of KATE has shown positive, meaningful, and statistically significant effects on five dimensions of student reading comprehension skills in previous rigorous research with diverse samples. As a result, a new rigorous study of KATE is being designed to answer the question, can KATE replicate or improve on the positive effects in previous research at scale in 64 schools, 384 teachers, and 8448 students across multiple districts and states? Accurately answering this question requires thoughtful planning, designing, and recruiting with attention to Evidence Synthesis Clearinghouses review standards. Study results may be reviewed, rated, and publicly disseminated by these Clearinghouses beyond just peer-review journals.

Biology education research provides important guidance for educators aiming to ensure access for disabled students. However, there is still work to be done in developing similar guidelines for research settings. By using critical frameworks that amplify the voices of people facing multiple forms of marginalization, there is potential to transform current biology education research practices. Many biology education researchers are still in the early stages of understanding critical disability frameworks, such as Disability Critical Race Studies (DisCrit), which consists of seven tenets designed to explore the intersecting experiences of ableism and racism. Our Research Methods Essay uses DisCrit as a model framework and pulls from other related critical disability frameworks to empower disabled voices in biology education research. Drawing from existing scholarship, we discuss how biology education researchers can design, conduct, and share research findings. Additionally, we highlight strategies that biology education scholars can use in their research to support access for participants. We propose the creation and sharing of Access and Equity Maps to help plan--and make public--the steps researchers take to foster access in their research. We close by discussing frequently asked questions researchers may encounter in taking on critical frameworks, such as DisCrit.

Currently there is a severe lack of research on autism and Indigenous people in Canada. This scoping review explores this literature gap and assesses the same literature from an Indigenous perspective. Scoping reviews are an effective means to explore the literature in a specific area, in this case, autism and Indigenous people in Canada. We explored existing literature as it pertains to Indigenous populations and autism in Canada. To support this review, the Indigenous Quality Assessment Tool (QAT) was adapted to appraise the quality of literature. In total, there were a total of 212 articles identified of which 24 met the inclusion criteria: (1) some focus on autism, (2) a component specific to Indigenous people, and (3) specific to Canada. Of the 24 articles and reports, 15 were peer-reviewed and the rest considered grey literature. Most articles focused on program delivery with some literature using primary data (quantitative and/or qualitative). Overall, the quality of the research was appraised as poor, as determined by the QAT. Findings reaffirm the critical need for research that addresses autism in Indigenous communities within Canada and show the importance of having research done in full partnership with, or led by, Indigenous people.

Cluster randomized trials (CRTs) are commonly used to evaluate the causal effects of educational interventions, where the entire clusters (e.g., schools) are randomly assigned to treatment or control conditions. This study introduces statistical methods for designing and analyzing two-level (e.g., students nested within schools) and three-level (e.g., students nested within classrooms nested within schools) CRTs. Specifically, we utilize hierarchical linear models (HLMs) to account for the dependency of the intervention participants within the same clusters, estimating the average treatment effects (ATEs) of educational interventions and other effects of interest (e.g., moderator and mediator effects). We demonstrate methods and tools for sample size planning and statistical power analysis. Additionally, we discuss common challenges and potential solutions in the design and analysis phases, including the effects of omitting one level of clustering, non-compliance, heterogeneous variance, blocking, threats to external validity, and cost-effectiveness of the intervention. We conclude with some practical suggestions for CRT design and analysis, along with recommendations for further readings.

Education researchers often encounter scenarios where an abrupt policy change occurs within or across jurisdictions or populations that affect key student outcomes. Difference-in-differences is a research design analysts can use to estimate causal effects of these "natural experiments." This article introduces education researchers to the difference-in-differences approach. We provide an overview of the standard two-by-two design, which examines changes in outcomes over time between a treated and an unaffected group. Then, we discuss the key assumptions and threats to validity that researchers must address to have maximum confidence in their results. We also discuss commonly used alternative specifications that provide researchers with a more nuanced approach to estimating policy effects. Throughout the paper, we illustrate the difference-in-differences approach using the example of the implementation of an after-school tutoring program to increase economically disadvantaged students' academic performance. In supplementary material, we provide Stata code to help assist researchers adapt the approach to their own scholarship.

The randomized control trial (RCT) is the primary experimental design in education research due to its strong internal validity for causal inference. However, in situations where RCTs are not feasible or ethical, quasi-experiments are alternatives to establish causal inference. This paper serves as an introduction to several quasi-experimental designs: regression discontinuity design, difference-in-differences analysis, interrupted time series design, instrumental variable analysis, and propensity score analysis with examples in education research.

While research into PhD programs and doctoral students' experiences has increased in recent years, fieldwork is overlooked as a source of learning and support. In education, the focus of this paper, fieldwork remains laced with notions of the anthropologist gathering data in a place that is not their own, which narrowly construct the role of the novice and their expectations around 'doing' research. To demonstrate the relevance of these issues and key ethical tensions that they underpin, we explored our recent PhD fieldwork experiences within classrooms in Australian and Zimbabwean schools. By analysing fieldnotes from our lived experiences, we identified similarities between conducting fieldwork 'out there' (in Zimbabwe) and 'at home' (in Australia). These similarities highlighted a multitude of roles and dynamics associated with the researcher presence, as well as the importance of balancing complex needs during fieldwork. Our analyses also revealed how daily in situ interactions with participants--and others--were crucial to the development of our identities and data gathering practices. We argue that ongoing efforts to demystify fieldwork experiences are critical for understanding that 'the field' is not simply 'out there' and offer practical suggestions for current and future doctoral students to consider.

Computational thinking (CT) has received growing interest as a research subject in the last decade, with research contributions attempting to capitalize on the benefits that CT may provide. This study included a systematic analysis aimed at revealing current trends in the CT subject, identifying educational interventions, and emerging assessment instruments. It also gave an overview of how teachers learned CT skills and how they integrated the CT curriculum into classroom practices. We searched the data in the Web of Science database and identified 360 articles. Most importantly, it emphasized the following points: (a) the most popular subject areas in CT literature; (b) CT intervention tools; (c) CT assessment practices used so far within educational courses; and (d) effective CT approaches to influence pre-service teachers. Results from this review revealed that CT's promotion in education had achieved significant progress in recent years. Along with the growth in the number of CT studies, the number of subjects, research questions, and teaching approaches also increased in recent years. It was also found that CT was mostly used in science, mathematics, programming, and computer science tasks, with little work in artificial intelligence (AI) and non-STEM areas. The essence of this paper implicated the researchers in designing the curriculum based on different subject domains. Furthermore, we recommended integrating augmented reality-based games using CT methodologies into the curriculum.

The study of infant gaze has long been a key tool for understanding the developing mind. However, labor-intensive data collection and processing limit the speed at which this understanding can be advanced. Here, we demonstrate an asynchronous workflow for conducting violation-of-expectation (VoE) experiments, which is fully "hands-off" for the experimenter. We first replicate four classic VoE experiments in a synchronous online setting, and show that VoE can generate highly replicable effects through remote testing. We then confirm the accuracy of a state-of-the-art gaze annotation software, iCatcher+ in a new setting. Third, we train parents to control the experiment flow based on the infant's gaze. Combining all three innovations, we then conduct an asynchronous automated infant-contingent VoE experiment. The hands-off workflow successfully replicates a classic VoE effect: infants look longer at inefficient actions than efficient ones. We compare the resulting effect size and statistical power to the same study run in-lab and synchronously via Zoom. The hands-off workflow significantly reduces the marginal cost and time per participant, enabling larger sample sizes. By enhancing the reproducibility and robustness of findings relying on infant looking, this workflow could help support a cumulative science of infant cognition. Tools to implement the workflow are openly available.

Egocentric networks represent a popular research design for network research. However, to what extent and under what conditions egocentric network centrality can serve as reasonable substitutes for their sociocentric counterparts are important questions to study. The answers to these questions are uncertain simply because of the large variety of networks. Hence, this paper aims to provide exploratory answers to these questions by analyzing both empirical and simulated data. Through analyses of various empirical networks (including some classic albeit small ones), this paper shows that egocentric betweenness approximates sociocentric betweenness quite well (the correlation is high across almost all the networks being examined) while egocentric closeness approximates sociocentric closeness only reasonably well (the correlation is a bit lower on average with a larger variance across networks). Simulations also confirm this finding. Analyses further show that egocentric approximations of betweenness and closeness seem to work well in different types of networks (as featured by network size, density, centralization, reciprocity, transitivity, and geodistance). Lastly, the paper briefly presents three ideas to help improve egocentric approximations of centrality measures.

Grouped and right-censored (GRC) counts have been used in a wide range of attitudinal and behavioural surveys yet they cannot be readily analyzed or assessed by conventional statistical models. This study develops a unified regression framework for the design and optimality of GRC counts in surveys. To process infinitely many grouping schemes for the optimum design, we propose a new two-stage algorithm, the Fisher Information Maximizer (FIM), which utilizes estimates from generalized linear models to find a global optimal grouping scheme among all possible N-group schemes. After we define, decompose, and calculate different types of regressor-specific design errors, our analyses from both simulation and empirical examples suggest that: 1) the optimum design of GRC counts is able to reduce the grouping error to zero, 2) the performance of modified Poisson estimators using GRC counts can be comparable to that of Poisson regression, and 3) the optimum design is usually able to achieve the same estimation efficiency with a smaller sample size.

Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the well-established post-survey adjustment. This paper reports the results of an experiment that evaluated the additional effect of adaptive design to post-survey adjustments. The experiment was conducted in the Detroit Metro Area Communities Study in 2021. We evaluated the adaptive design in five outcomes: 1) response rates, 2) demographic composition of respondents, 3) bias and variance of key survey estimates, 4) changes in significant results of regression models, and 5) costs. The most significant benefit of the adaptive design was its ability to generate more efficient survey estimates with smaller variances and smaller design effects.

The present study sought to evaluate the reproducibility of prominent findings stated by Fehr et al. in their developmental resource allocation experiment "Egalitarianism in Young Children", published in 2008. The experiment involved children making decisions about distributing sweets between themselves and either an in-group or an out-group recipient. Fehr et al. found that (1) inequity aversion develops with age; (2) 3- to 4-year-old children are inclined toward self-advantageous allocations, whereas 7- to 8-year-olds distribute sweets more evenly in divisions, and (3) the influence of group status increases as children age. The original article stated that 229 Swiss school students aged 3 to 8 years (102 boys, 127 girls) participated in the study. However, no further demographics were reported. In our attempts to reproduce Fehr et al.'s original analyses and reanalyse the raw dataset, we found that one of the key variables was miscoded. After rectifying the miscoded variable, the reproduction results revealed only one ambiguously irreproducible result regarding a group status main effect in the sharing mini-game--with three other tests exhibiting either strong reproducibility or ambiguous reproducibility. Reanalysis results indicated that Fehr et al.'s conclusions are robust when tested with alternative analytical tests.

Fetters et al.'s (2013) mixed methods integration framework uses construction metaphors: building, connecting, merging, and embedding. In a similar vein, this article uses an architectural metaphor and introduces design patterns as building blocks for mixed methods research design. A design pattern embeds one specific design decision into its preceding design decisions. As an example, I will describe a design pattern for mixed methods matched comparisons sampling. Using one exemplar study, I will demonstrate the pattern's three design phases. Embedding matched comparisons sampling into its preceding design decisions shows that, to optimize the comparison of subpopulations in the qualitative research strand, the quantitative sample of this design pattern should aim to include almost all members of one small target population.

Qualitative thematic analysis is a commonly used and widely applicable form of qualitative analysis, though it can be challenging to implement. Due to its use across research questions, qualitative traditions, and fields, thematic analysis is also prevalent in mixed methods studies. Despite its widespread use, the term "thematic analysis" is often confused and not always well described in empirical studies. In addition, there is limited guidance on how to use thematic analysis within the context of mixed methods research to ensure rigorous study design and mixed methods integration. Therefore, the purpose of this paper is to describe the definitions, use, and variations of thematic analysis and explore how integration and mixed methods validity may be impacted in mixed methods studies.

The purpose of this article is to illustrate the process and insights gleaned from developing an implementation matrix to convey a concise, yet detailed representation of the project integration steps in a single diagram. The article is based on an explanatory sequential study conducted with 248 teachers exploring how beliefs shaped their use of technology. This article contributes to mixed methods research (MMR) by providing an example that can be used as guide by other researchers in developing and using the implementation matrix as a tool for communicating procedurally the mixed methods project integration steps for an explanatory sequential study. It also provides analytical insights gleaned and recommendations for how the implementation matrix can be developed and utilized.

In 1974, the United States Congress asked a question prompting a national conversation about ethics: which ethical principles should govern research involving human participants? To embark on an answer, Congress passed the National Research Act, and charged this task to the newly established National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. The Commission's mandate was modest however, the results were anything but. The outcome was "The Belmont Report:" a trio of principles -- respect for persons, beneficence, and justice -- serving as an ethical compass for scientists, researchers, and institutional review boards (IRBs). Almost 50 years later, the utility, legacy, and ingenuity of "The Belmont Report" continues to be both admired and challenged. Critics argue that Belmont is not fit for the 21st century, while supporters praise "Belmont" for its enduring wisdom. The goal of this paper is to equip IRB practitioners with the tools necessary to maximally interpret "The Belmont Report" and meaningfully engage in ethical analysis that reconsiders outmoded legacy thinking and fixed decision-making. Through historical and contextual reflection, this paper describes how IRB practitioners can contemporize review of ethical human research using their moral imagination - a skill found at the intersection of creativity, deliberation, and empathy.

Since its onset, scholars have characterized social media as a valuable source for data collection since it presents several benefits (e.g. exploring research questions with hard-to-reach populations). Nonetheless, methods of online data collection are riddled with ethical and methodological challenges that researchers must consider if they want to adopt good practices when collecting and analyzing online data. Drawing from our primary research project, where we collected passive online data on Reddit, we explore and detail the steps that researchers must consider before collecting online data: (1) planning online data collection; (2) ethical considerations; and (3) data collection. We also discuss two atypical questions that researchers should also consider: (1) how to handle deleted user-generated content; and (2) how to quote user-generated content. Moving on from the dichotomous discussion between what is public and private data, we present recommendations for good practices when collecting and analyzing qualitative online data.

Although well established in developed countries, Ethics review boards in the academia, and specifically for social and behavioral sciences (SBS) research, is a relatively new, and still a controversy inducing endeavor. This study explores the establishment and functioning of ERBs in Israeli academia, serving as a case study for the challenges and progress made in ensuring ethical research practices in non-medical related spheres. A purposeful sample of 46 participants was selected, comprising ERB current or past members and SBS researchers, who each interacted extensively with ERB's evaluation processes. The participants came from all eight research universities of Israel, as well as seven large public and private academic colleges. Open, semi structured In-depth interviews were conducted in order to facilitate a critical reflective stance among the various participants, exploring their experiences, behaviors and the meanings they assign to ERB processes. Our research revealed two major themes. The first is the developmental trajectories in the construction processes of ERBs in Israel, comprised of the following stages: Initiation, expansion, opposition, and acceptance and assimilation. The second was a typology of participation throughout the ERBs' construction process. Inspired by Merton's strain theory, this typology includes conformists, ritualists, ideologists, control-freaks, and insurgents. The findings expose a unique perspective into the initiation, establishment, and development of ERBs, which can shed light on the role of ERBs in general, as well as point out how resistance to ERBs, as well as the different reasons for championing them, affected not only ERBs form and their legitimacy, but also their interaction with researchers.

Concerns have been raised about genomic studies of autism. Most recently, the Spectrum 10 K study was paused due to criticism from the autistic community. This situation raised important questions about how the autistic and autism communities perceive genomic research. The Personal Experiences of Autism and Perceptions of DNA-based-research study was established to address this issue. Twenty parents of nonverbal or minimally verbal autistic children took part in the current study. Data were provided in diverse formats including online interviews, telephone interviews, and writing. This approach was co-produced with autistic experts by experience. Data were analysed using reflexive Thematic Analysis. We found that participants were supportive of autism research, including some genomic research, if it is designed to support autistic people and is ethical and transparent. However, while some believed that polygenic scores, genomic predictors of the statistical probability of being autistic, would be helpful, others argued that this would only be true in an ideal world. Participants felt that they and their children were often excluded from, and unrepresented by, the autistic and autism communities. We conclude that genomic researchers need to work with the autistic and autism communities to design future work, and that it is important to ensure a representative range of voices are heard.

To best prepare students for the real-world research environment, key skills, including experimental design, data analysis, communication of results, and critical thinking, should be key components of undergraduate science courses. Furthermore, the impact of the COVID-19 pandemic on in-person teaching has resulted in a need to develop courses that enable flexible learning. This paper details the laboratory component of a senior-level toxicology class that was developed to emphasize all these skills and allow for flexible learning. The aim of the laboratory class was for students to determine how curcumin protected against acetaminophen-induced hepatoxicity. To stimulate critical thinking, students were required to choose a maximum of four experiments from the six on offer. Before conducting an experiment, students stated a hypothesis and selected the appropriate treatment groups. Once an experiment was completed, students were given access to a complete dataset, on which they performed statistical analysis and drew conclusions. Students who were unable to attend the laboratory session in person were able to complete the required pre-lab work and access the dataset. Following each experiment, students could write a lab summary, and receive thorough feedback. The final assessment was a written manuscript of their findings as well as a chance to respond to reviewer comments. This teaching approach prioritized the critical thinking, analysis, and experimental design aspects of scientific research. Overall, this structure was well received by students and it could easily be adapted for use on other life science courses.

Using a sample of 70,399 published p-values from 192 meta-analyses, we empirically estimate the counterfactual distribution of p-values in the absence of any biases. Comparing observed p-values with counterfactually expected p-values allows us to estimate how many p-values are published as being statistically significant when they should have been published as non-significant. We estimate the extent of selectively reported p-values to range between 57.7% and 71.9% of the significant p-values. The counterfactual p-value distribution also allows us to assess shifts of p-values along the entire distribution of published p-values, revealing that particularly very small p-values (p < 0.001) are unexpectedly abundant in the published literature. Subsample analysis suggests that the extent of selective reporting is reduced in research fields that use experimental designs, analyze microeconomics research questions, and have at least some adequately powered studies.

A primary goal of educational settings in the United States is to produce competent writers. However, most students do not receive adequate instruction and practice beyond grade three. Furthermore, only 29% of high school graduates without disabilities, and 5% with disabilities exit with proficient writing skills (U.S. Department of Education, 2011). There is growing body of evidence for the use of explicit instruction and timed practice interventions to teach writing skills to struggling writers. However, to date there is no review of these combined strategies (i.e., explicit instruction and timed practice) to teach writing skills. The current review analyzed 10 studies that met the What Works Clearinghouse Single Case Design Standards 5.0 and included 53 students who received explicit instruction and timed practice interventions for sentence-level writing skills. Results from the independent analysis show that explicit instruction and timed practice have a significant impact on decreasing the frequency of incorrect writing performance and establish the need for additional research on frequency building strategies for writing skills. Results of the review, recommendations for educators, and future directions for researchers are discussed.