Search

In this study, LiNaCO3‐ and (Li‐Na‐K)2CO3‐based porous carbon composites were synthesized from terephthalic acid, lithium hydroxide, sodium hydroxide, and potassium hydroxide at different calcination temperatures. These composite materials were characterized with X‐Ray diffraction, scanning electron microscopy, and nitrogen adsorption and desorption. According to their CO2 capture performance measured, LiNaC‐700 °C had the largest CO2 adsorption capacity of 66 mg CO2 g−1, while the CO2 capture capacity of other materials doped with three metal ions was only up to 8.57 mg CO2 g−1. Additionally, the CO2 adsorption capacity of each adsorbent was significantly higher than the N2 adsorption capacity, showing their high CO2 adsorption selectivity. Lithium‐containing carbonate‐based porous carbon materials (LiNaCO3‐ and (Li‐Na‐K)2CO3‐based porous carbon could effectively capture CO2 with excellent reproducibility. [ABSTRACT FROM AUTHOR]

This study introduces an agent‐based model (ABM) pedestrian simulation tool to assess the risk of close contact (6 feet) in dynamic indoor environments, specifically in urban settings with diverse social activities and spatial structures. Our approach uses machine learning‐based sensitivity analysis (SA) to identify factors impacting the number of individual contacts, such as individual stay time and area. In addition, we conducted an in‐depth quantitative analysis to evaluate how specific factors, such as the strategic placement of obstacles, dwell time, and stay time near the entrances, mitigate the number of contacts. This analysis provides valuable insights for developing practical guidelines to curb contact risks in indoor environments. Lastly, we share the model, validation methods, and associated data as an open‐source Python library, complete with comprehensive documentation. This aims at fostering collaborative research and enables the application of our model across various scenarios, contributing to the development of spatially explicit models. Such efforts enhance the understanding of contact risks in urban indoor settings and promote joint research efforts, thus advancing the field through shared knowledge and tools. [ABSTRACT FROM AUTHOR]

In the past decade, various recommendations have been published to enhance the methodological rigor and publication standards in psychological science. However, adhering to these recommendations may have limited impact on the reproducibility of causal effects as long as psychological phenomena continue to be viewed as decomposable into separate and additive statistical structures of causal relationships. In this article, we show that (a) psychological phenomena are patterns emerging from nondecomposable and nonisolable complex processes that obey idiosyncratic nonlinear dynamics, (b) these processual features jeopardize the chances of standard reproducibility of statistical results, and (c) these features call on researchers to reconsider what can and should be reproduced, that is, the psychological processes per se, and the signatures of their complexity and dynamics. Accordingly, we argue for a greater consideration of process causality of psychological phenomena reflected by key properties of complex dynamical systems (CDSs). This implies developing and testing formal models of psychological dynamics, which can be implemented by computer simulation. The scope of the CDS paradigm and its convergences with other paradigms are discussed regarding the reproducibility issue. Ironically, the CDS approach could account for both reproducibility and nonreproducibility of the statistical effects usually sought in mainstream psychological science. [ABSTRACT FROM AUTHOR]

Real-world evidence (RWE) studies are increasingly used to inform policy and clinical decisions. However, there remain concerns about the credibility and reproducibility of RWE studies. While there is universal agreement on the critical importance of transparent and reproducible science, the building blocks of open science practice that are common across many disciplines have not yet been built into routine workflows for pharmacoepidemiology and outcomes researchers. Observational researchers should highlight the level of transparency of their studies by providing a succinct statement addressing study transparency with the publication of every paper, poster, or presentation that reports on an RWE study. In this paper, we propose a framework for an explicit transparency statement that declares the level of transparency a given RWE study has achieved across 5 key domains: (1) protocol, (2) preregistration, (3) data, (4) code-sharing, and (5) reporting checklists. The transparency statement outlined in the present paper can be used by research teams to proudly display the open science practices that were used to generate evidence designed to inform public health policy and practice. While transparency does not guarantee validity, such a statement signals confidence from the research team in the scientific choices that were made. [ABSTRACT FROM AUTHOR]

Purpose: To assess and compare intrareader and interreader reproducibility of magnetic resonance imaging (MRI) diagnosis of female genital anomalies (FGAs) using the American Society for Reproductive Medicine-Mullerian anomalies classification 2021 (ASRM-MAC 2021) and European Society of Human Reproduction and Embryology-European Society for Gynecological Endoscopy (ESHRE-ESGE) 2016 classification. Methods: In this retrospective study, we searched our electronic MRI database from April 2021 to September 2023, selecting MRI studies with FGAs. Seventy-six consecutive studies were included and reviewed by 4 independent radiologists using both classifications. Studies were re-evaluated after 1 month. Reproducibility was assessed using kappa (κ) scores with 95% confidence intervals (CI). Results: Intrareader agreement for MRI diagnosis of FGAs was substantial to excellent, with κ scores ranging from 0.684 (95% CI, 0.534-0.834) to 0.985 (95% CI, 0.963-1.01) using the ASRM-MAC 2021 and from 0.743 (95% CI, 0.621-0.865) to 0.846 (95% CI, 0.719-0.973) using the ESHRE-ESGE 2016 classification. Pairwise interreader agreement was higher with the ASRM-MAC 2021, ranging from moderate (κ = 0.491; 95% CI, 0.341-0.642) to substantial (κ = 0.709; 95% CI, 0.597-0.821), compared to the ESHRE-ESGE 2016 classification, with weak (κ = 0.080; 95% CI, 0.068-0.228) to moderate (κ = 0.511; 95% CI, 0.344-0.678) agreement. Overall interreader agreement was moderate for both classifications (κ = 0.599; 95% CI, 0.562-0.638 for ASRM-MAC 2021 and κ = 0.429; 95% CI, 0.396-0.463 for ESHRE-ESGE 2016 classification), but with significant differences (non-overlapping CIs). Conclusion: The intrareader reproducibility was high for both classifications, whereas the interreader reproducibility was higher using the ASRM-MAC 2021, highlighting the impact of classification criteria on the reproducibility of MRI diagnosis of FGAs. [ABSTRACT FROM AUTHOR]

Defining the required trackability level of the target condition for the testing facility reconditioning unit represents an unresolved challenge in improving the reproducibility of load-based tests and corresponding performance rating standards development. To enhance the reproducibility of such testing methodology, this paper presents and discusses a new feed-forward compensation technique based on the development of a transfer function model for the delay and offset characteristics of the psychrometric room's air temperature and humidity modulations with reference to the target signal from the room emulator. It is demonstrated that the proposed methodology enables offset and delay reduction in the trackability of the return air condition within 60 s at different testing conditions, enhances the reproducibility of the test results to limit performance deviations to within 2 %, and achieves closely matched controlled parameter modulations during load-based tests. [ABSTRACT FROM AUTHOR]

ABSTRACT Billions of fishes are kept in captivity for research and food production world‐wide, with a strong impetus for maintaining high welfare standards. Accordingly, the importance of empirical research into the welfare and husbandry of captive fishes is increasingly acknowledged in both science and aquaculture, alongside growing public and governmental interest. Physical enrichment can have an important influence on welfare in of captive fishes, but many questions remain. Here, we summarise the current state of research and outline knowledge gaps in the area of physical enrichment, which is a fundamental aspect to improving welfare of captive fishes. To explore the level of research interest this area across time we conducted a series of surveys, using the number of papers published per year as a metric. These surveys highlight that work on fish welfare, while representing a relatively low proportion of fish research overall, is increasing rapidly. For species that are of aquaculture importance or used commonly as laboratory subjects, we show a positive relationship between general research interest and number of welfare‐related papers. However, for many, particularly relatively less studied, species the proportion of papers on enrichment remains low, with a slower increase compared to welfare‐related papers in general. In terms of common metrics used to quantify fish welfare, there is a reliance on growth and behaviour, with scope for inclusion and combination of a more comprehensive range of reproducible measures. We finish by highlighting recent progress, promising areas for future research and suggestions for advances in this area. [ABSTRACT FROM AUTHOR]

Background Purpose Materials and methods Results Conclusion Coronary artery disease (CAD) has one of the highest mortality rates in humans worldwide. Single‐photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI) provides clinicians with myocardial metabolic information non‐invasively. However, there are some limitations to interpreting SPECT images performed by physicians or automatic quantitative approaches. Radiomics analyzes images objectively by extracting quantitative features and can potentially reveal biological characteristics that the human eye cannot detect. However, the reproducibility and repeatability of some radiomic features can be highly susceptible to segmentation and imaging conditions.We aimed to assess the reproducibility of radiomic features extracted from uncorrected MPI‐SPECT images reconstructed with 15 different settings before and after ComBat harmonization, along with evaluating the effectiveness of ComBat in realigning feature distributions.A total of 200 patients (50% normal and 50% abnormal) including rest and stress (without attenuation and scatter corrections) MPI‐SPECT images were included. Images were reconstructed using 15 combinations of filter cut‐off frequencies, filter orders, filter types, reconstruction algorithms, number of iterations and subsets resulting in 6000 images. Image segmentation was performed on the left ventricle in the first reconstruction for each patient and applied to 14 others. A total of 93 radiomic features were extracted from the segmented area, and ComBat was used to harmonize them. The intraclass correlation coefficient (ICC) and overall concordance correlation coefficient (OCCC) tests were performed before and after ComBat to examine the impact of each parameter on feature robustness and to assess harmonization efficiency. The ANOVA and the Kruskal–Wallis tests were performed to evaluate the effectiveness of ComBat in correcting feature distributions. In addition, the Student's t‐test, Wilcoxon rank‐sum, and signed‐rank tests were implemented to assess the significance level of the impacts made by each parameter of different batches and patient groups (normal vs. abnormal) on radiomic features.Before applying ComBat, the majority of features (ICC: 82, OCCC: 61) achieved high reproducibility (ICC/OCCC ≥ 0.900) under every batch except Reconstruction. The largest and smallest number of poor features (ICC/OCCC < 0.500) were obtained by IterationSubset and Order batches, respectively. The most reliable features were from the first‐order (FO) and gray‐level co‐occurrence matrix (GLCM) families. Following harmonization, the minimum number of robust features increased (ICC: 84, OCCC: 78). Applying ComBat showed that Order and Reconstruction were the least and the most responsive batches, respectively. The most robust families, in a descending order, were found to be FO, neighborhood gray‐tone difference matrix (NGTDM), GLCM, gray‐level run length matrix (GLRLM), gray‐level size zone matrix (GLSZM), and gray‐level dependence matrix (GLDM) under Cut‐off, Filter, and Order batches. The Wilcoxon rank‐sum test showed that the number of robust features significantly differed under most batches in the Normal and Abnormal groups.The majority of radiomic features show high levels of robustness across different OSEM reconstruction parameters in uncorrected MPI‐SPECT. ComBat is effective in realigning feature distributions and enhancing radiomic features reproducibility. [ABSTRACT FROM AUTHOR]

Chemical exchange saturation transfer (CEST) imaging may provide novel contrast for the diagnosis, prognosis, and monitoring of the progression or treatment of neurological applications. However, the reproducibility of prominent CEST contrasts like amide CEST and nuclear Overhauser enhancement (NOE) CEST must be characterized in healthy brain gray matter (GM) and white matter (GM) prior to clinical implementation. The objective of this study was to characterize the reproducibility of four different CEST contrasts in the healthy human brain. Using a 3T MRI scanner, two 3D CEST scans were acquired in 12 healthy subjects (7 females, mean age (± SD) 26 ± 4 years) approximately 10 days apart. Scan-rescan reproducibility was measured for four contrasts: amine/amide concentration-independent detection (AACID), Amide*, and inverse magnetization transfer ratio (MTRRex) contrast for amide and NOE. Reproducibility was evaluated between- and within-subjects using coefficients of variation (CV) and the percent difference between measurements. AACID and NOE-MTRRex contrasts demonstrated the lowest within-subject CVs (0.8–1.2% and 1.6-2.0%, respectively), between-subject CVs (1.2–2.1% and 3.4–4.2%, respectively), and percent difference (1.2–1.4% and 2.2–2.8%, respectively) for both GM and WM. AACID and NOE-MTRRex contrasts demonstrated the highest reproducibility and represented stable measurements suitable for characterizing changes in brain tissue caused by pathological processes. [ABSTRACT FROM AUTHOR]

A concern in the field of autism electroencephalography (EEG) biomarker discovery is their lack of reproducibility. In the present study, we considered the problem of learning reproducible associations between multiple features of resting state (RS) neural activity and autism, using EEG data collected during a RS paradigm from 36 to 96 month-old children diagnosed with autism (N = 224) and neurotypical children (N = 69). Specifically, EEG spectral power and functional connectivity features were used as inputs to a regularized generalized linear model trained to predict diagnostic group (autism versus neurotypical). To evaluate our model, we proposed a procedure that quantified both the predictive generalization and reproducibility of learned associations produced by the model. When prioritizing both model predictive performance and reproducibility of associations, a highly reproducible profile of associations emerged. This profile revealed a distinct pattern of increased gamma power and connectivity in occipital and posterior midline regions associated with an autism diagnosis. Conversely, model selection based on predictive performance alone resulted in non-robust associations. Finally, we built a custom machine learning model that further empirically improved robustness of learned associations. Our results highlight the need for model selection criteria that maximize the scientific utility provided by reproducibility instead of predictive performance. [ABSTRACT FROM AUTHOR]

Purpose: Steatotic liver disease (SLD) has become the most common cause of chronic liver disease. Nevertheless, the non-invasive quantitative diagnosis of steatosis is still lacking in clinical practice. This study aimed to evaluate the reproducibility of the new parameter for steatosis quantification named ultrasound-derived fat fraction (UDFF). Materials and methods: The UDFF values were independently executed by two operators in two periods. In the process, repeated measurements of the same patient were performed by the same operator under different conditions (liver segments, respiration, positions, and dietary). Finally, the results of some subjects (28) were compared with the MRI-derived proton density fat fraction (PDFF). The concordance analysis was mainly achieved by the intraclass correlation coefficient (ICC) and Bland–Altman. Results: One hundred-five participants were included in the study. UDFF had good reliability in measuring the adult liver (ICCintra-observer = 0.96, ICCinter-observer = 0.94). Meanwhile, the ICC of the two operators increased over time. The variable measurement states did not influence the UDFF values on the surface, but they affected the coefficient of variation (Cov) of the results. Segment 8 (S8), end-expiratory, supine, and fasting images had the most minor variability. On the other hand, the UDFF value of S8 displayed satisfied consistency with PDFF (mean difference, −0.24 ± 1.44), and the results of both S5 (mean difference: −0.56 ± 3.95) and S8 (mean difference: 0.73 ± 1.87) agreed well with the whole-liver PDFF. Conclusion: UDFF measurements had good reproducibility. Furthermore, the state of S8, end-expiration, supine, and fasting might be the more stable measurement approach. Critical relevance statement: UDFF is the quantitative ultrasound parameter of hepatic steatosis and has good reproducibility. It can show more robust performance under specific measurement conditions (S8, end-expiratory, supine, and fasting). Trial registration: The research protocol was registered at the Chinese Clinical Trial Registry on October 9, 2023 (http://www.chictr.org.cn/). The registration number is ChiCTR 2300076457. Key Points: There is a lack of non-invasive quantitative measurement options for hepatic steatosis. UDFF demonstrated excellent reproducibility in measuring hepatic steatosis. S8, end-expiratory, supine, and fasting may be the more stable measuring condition. Training could improve the operators' measurement stability. Variable measurement state affects the repeatability of the UDFF values (Cov). [ABSTRACT FROM AUTHOR]

Critical to the foundation of scientific research, the reproducibility of studies and their results is a fundamental element, ensuring the credibility of the findings and fostering trust. Maps play an important role here, as they are used across disciplines to visualize complex insights and outcomes from a wide range of studies. Due to their relevance in this context, it is essential to be able to reproduce maps as well, and consequently, to assess whether a map reproduction was successful. In this paper, we present our research on which aspects affect the success of map reproduction and how to assess map reproduction based on the visual differences between the original and the reproduced map. We collected data from two focus groups and an online survey to gain a deeper understanding of how geoscientists and map experts conceptualize map reproduction, which factors they consider relevant in this process, and how strong their impact is relative to each other. We analyzed this data qualitatively and quantitatively to create a conceptual model that describes the assessment of map reproduction and a set of criteria that influence the success of the reproduction. With these contributions, we aim to provide an initial toolkit for systematically assessing the success of map reproduction attempts. [ABSTRACT FROM AUTHOR]

Background and objective: The primary cilium is a small protrusion found on most mammalian cells. It acts as a cellular antenna, being involved in various cell signaling pathways. The length of the primary cilium affects its function. To study the impact of physical or chemical stimuli on cilia, their lengths must be determined easily and reproducibly. Methods: We have developed and evaluated an open-source R package called detectCilia to detect and measure primary cilia automatically. As a case study to demonstrate the capability of our tool, we compared the influence of 4 different cell culture media compositions on the lengths of primary cilia in human chondrocytes. These media compositions include (1) insulin-transferrin-selenium (ITS); (2) ITS and dexamethasone (Dexa); (3) ITS, Dexa, insulin-like growth factor 1 (IGF-1), and transforming growth factor beta 1 (TGF-β1); and (4) fetal bovine serum (FBS). Results: The assessment of detectCilia included a comparison with 2 similar tools: ACDC (Automated Cilia Detection in Cells) and CiliaQ. Several differences and advantages of our package make it a valuable addition to these tools. In the case study, we have observed variations in the ciliary lengths associated with using different media compositions. Conclusions: We conclude that detectCilia can automatically and reproducibly detect and measure primary cilia in confocal microscopy images with low false-positive rates without requiring extensive user interaction. [ABSTRACT FROM AUTHOR]

Having the ability to reproduce empirical results is foundational to the scientific process. Increasingly, there is an emphasis within the research community to create workflows which are not only reproducible but also replicable in that analytical approaches can be applied to new data. However, a disproportionate number of technical solutions designed to foster reproducibility and replicability have focused on data analysis, particularly within geography. This paper argues for greater attention on a phase of the research process which precedes analysis and is often taken for granted – that of data acquisition. Through code examples using the R Project for Statistical Computing, this paper demonstrates a path toward replicable spatial data acquisition for both secondary and primary data acquisition, with a focus on crowdsourced geographic information. The modular approach demonstrated is flexible in that it allows for straightforward replication but also enables extension to new spatial questions. Such work is valuable because it conserves labor, promotes research provenance, and allows for more robust analyses. [ABSTRACT FROM AUTHOR]

Background and Purpose Experimental Approach Key Results Conclusion and Implications Irwin tests are key preclinical study elements for characterising drug‐induced neurological side effects. This multicentre study aimed to assess the robustness of Irwin tests across multinational sites during three stages of protocol harmonisation. The projects were part of the Enhanced Quality in Preclinical Data framework, aiming to increase success rates in transition from preclinical testing to clinical application.Female and male NMRI mice were assigned to one of three groups (vehicle, MK‐801 0.1 and 0.3 mg kg−1). Irwin scores were assessed at baseline and multiple times following intraperitoneal injection of MK‐801 using local protocols (Stage 1), shared protocols with harmonised environmental design (Stage 2) and fully harmonised Irwin scoring protocols (Stage 3).The analysis based on the four functional domains (motor, autonomic, sedation and excitation) revealed substantial data variability in Stages 1 and 2. Although there was still marked overall heterogeneity between sites in Stage 3 after complete harmonisation of the Irwin scoring scheme, heterogeneity was only moderate within functional domains. When comparing treatment groups versus vehicle, we found large effect sizes in the motor domain and subtle to moderate effects in the excitation‐related and autonomic domains.The pronounced interlaboratory variability in Irwin datasets for the CNS‐active compound MK‐801 needs to be carefully considered when making decisions during drug development. While environmental and general study design had a minor impact, the study suggests that harmonisation of parameters and their scoring can limit variability and increase robustness. [ABSTRACT FROM AUTHOR]

The rapid advancement in the field of medical imaging presents a challenge in keeping up to date with the necessary objective evaluations and optimizations for safe and effective use in clinical settings. These evaluations are traditionally done using clinical imaging trials, which while effective, pose several limitations including high costs, ethical considerations for repetitive experiments, time constraints, and lack of ground truth. To tackle these issues, virtual trials (aka in silico trials) have emerged as a promising alternative, using computational models of human subjects and imaging devices, and observer models/analysis to carry out experiments. To facilitate the widespread use of virtual trials within the medical imaging research community, a major need is to establish a common consensus framework that all can use. Based on the ongoing efforts of an AAPM Task Group (TG387), this article provides a comprehensive overview of the requirements for establishing virtual imaging trial frameworks, paving the way toward their widespread use within the medical imaging research community. These requirements include credibility, reproducibility, and accessibility. Credibility assessment involves verification, validation, uncertainty quantification, and sensitivity analysis, ensuring the accuracy and realism of computational models. A proper credibility assessment requires a clear context of use and the questions that the study is intended to objectively answer. For reproducibility and accessibility, this article highlights the need for detailed documentation, user‐friendly software packages, and standard input/output formats. Challenges in data and software sharing, including proprietary data and inconsistent file formats, are discussed. Recommended solutions to enhance accessibility include containerized environments and data‐sharing hubs, along with following standards such as CDISC (Clinical Data Interchange Standards Consortium). By addressing challenges associated with credibility, reproducibility, and accessibility, virtual imaging trials can be positioned as a powerful and inclusive resource, advancing medical imaging innovation and regulatory science. [ABSTRACT FROM AUTHOR]

Background: The Bethesda System for Reporting Thyroid Cytology (TBSRTC) recommended for the interpretation of needle aspiration cytology of the thyroid, is the most widely used worldwide. Studies have shown that the disagreement between observers, especially in the Bethesda III and IV diagnostic categories, is not insignificant at 10%–40%. In the TBSRTC 2023 version, some definitions were removed and simplified, and molecular pathology was proposed as a complement to cytopathology. The current availability of molecular tests is limited because they can be performed in a few centers and are expensive. Therefore, our study investigated intra- and inter-observer agreement according to TBSRTC 2023 using only immunohistochemically BRAFV600E antibodies. Materials and Methods: The study included 173 cases with aspiration cytology evaluated between 2019 and 2022. The immunohistochemical procedure applied BRAFV600E (RM8) monoclonal antibody to cell block sections. All slides were assessed and categorized by three different observers. Data were interpreted using Cohen's kappa and Fleiss's kappa test in the Statistical Package for Social Sciences Windows 2021 program. Results: For the applied RM8 antibody, sensitivity was 64.71% and specificity was 87.27%. In terms of diagnostic categories, inter-observer agreement was good for Bethesda II (K = 0.606) and moderate for Bethesda III (K = 0.429), Bethesda IV (K = 0.523), Bethesda V (K = 0,464), and Bethesda VI (K = 0.544), respectively. Conclusion: In conclusion, the study reveals that the 2023 version of TBSRTC provides improvement, especially in the categories of uncertain diagnosis, but is still insufficient to improve cytological diagnostic accuracy, at which point molecular analyses become even more important. [ABSTRACT FROM AUTHOR]

Anti-AAV neutralizing Abs (NAbs) titer is usually measured by cell-based microneutralization (MN) assay and is crucial for patient screening in AAV-based gene therapy clinical trials. However, achieving uniform operation and comparable results among different laboratories remains challenging. Here, we established a standardized MN assay for anti-AAV9 NAbs in human sera or plasma and transferred the method to the other two research teams. Then, we validated its parameters and tested a set of eight human samples in blind across all laboratories. The end-point titer, defined by a transduction inhibition of 50% (IC50), was calculated using curve-fit modelling. A mouse neutralizing monoclonal antibody in human negative serum was used for system quality control (QC), requiring inter-assay titer variation of <4-fold difference or geometric coefficient of variation (%GCV) of <50%. The assay demonstrated a sensitivity of 54 ng/mL and no cross-reactivity to 20 μg/mL anti-AAV8 MoAb. The intra-assay and inter-assay variation for the low positive QC were 7–35% and 22–41%, respectively. The titers of the blind samples showed excellent reproducibility within and among laboratories, with a %GCV of 18–59% and 23–46%, respectively. This study provides a commonly transferrable MN assay for evaluating anti-AAV9 NAbs in humans, supporting its application in clinical trials. [ABSTRACT FROM AUTHOR]

The article "The Replication Crisis: A Persistent Challenge in Biomedical Research" published in the Bangladesh Journal of Medical Science discusses the ongoing replication crisis in scientific research, particularly in fields like psychology. The crisis undermines the credibility of studies, wastes resources, and may lead to misguided clinical trials. Various factors contribute to this issue, such as publication bias and poor study design. The scientific community has implemented initiatives like preregistration of studies to address these challenges and improve research practices. [Extracted from the article]

Background: Mandibular range of motion (MROM) variables are widely used to evaluate oral function. Objective: The aim of this study was to establish the reliability of MROM variables in healthy children. Methods: In this cross‐sectional study, healthy children were examined 2 weeks apart. The following MROM variables were established: active maximum interincisal opening (AMIO), passive maximum interincisal opening (PMIO), protrusion and left and right laterotrusion. The reliability of the MROM measurements was determined by analysing the intra‐class correlation coefficient (ICC), standard error of measurement (SEM), smallest detectable change (SDC) and limits of agreement (LoA). Results: A total of 167 healthy children were examined. The ICC indicated good reliability for AMIO (0.885); excellent reliability for PMIO (0.925); and moderate reliability for protrusion (0.578), laterotrusion left (0.601) and laterotrusion right (0.634). The SDC was 0.9 mm for AMIO, 0.4 mm for PMIO, 2.2 mm for protrusion, 1.6 mm for laterotrusion left and 1.4 mm for laterotrusion right. The LoA was −5.67 to 5.82 for AMIO, −3.90 to 3.57 for PMIO, −3.89 to 3.55 for protrusion, −2.99 to 2.77 for laterotrusion left, and − 2.71 to 2.77 for laterotrusion right. Conclusions: AMIO and PMIO measurements are both highly reliable in healthy children. The low SDC indicate that AMIO and PMIO are promising longitudinal measurements. Protrusion and laterotrusion measurements had moderate reliability. These results support our clinical recommendation to measure AMIO rather than PMIO, as PMIO is more difficult and more time‐consuming to perform than AMIO. [ABSTRACT FROM AUTHOR]

Background: T1-weighted (T1W) magnetic resonance imaging (MRI) using the delay alternating with nutation for excitation-sampling perfection with application-optimized contrasts using different flip angle evolution (DANTE-SPACE) is the preferred imaging technique for evaluation of the vessel wall. Purpose: To evaluate the intra- and inter-rater reproducibility of carotid wall segmentation on T1W DANTE-SPACE in patients with symptomatic (acute stroke or transient ischemic attack) internal carotid artery (ICA) stenosis. Material and Methods: This prospective study included 25 patients with acute (≤3 months) stroke or transient ischemic attack and 50%–99% stenosis of the ICA. All patients underwent 3.0-T high-resolution carotid MRI. Two radiologists independently performed the manual segmentation of the vessel wall and inner lumen of the bilateral carotid artery on DANTE-SPACE. The intraclass correlation coefficient (ICC), Dice similarity coefficient (DSC), and Hausdorff distance (HD) were calculated. Results: The ICCs for intra-rater reproducibility of carotid wall volume, inner lumen volume, and normalized wall index were 0.965, 0.990, and 0.962, respectively. The ICCs for inter-rater reproducibility of carotid wall volume, inner lumen, and normalized wall index were 0.856, 0.981, and 0.904. DSC and HD for intra- and inter-rater reproducibility of carotid wall segmentation were as follows: 0.873 and 0.809 (DSC); and 0.079 and 0.118 (HD), respectively. For evaluation of reproducibility only in the carotid artery with symptomatic stenosis, the ICCs for intra- and inter-rater reproducibility indicated all perfect agreement. Conclusion: T1W DANTE-SPACE is a reproducible sequence for evaluation of the carotid wall using carotid MRI in patients with symptomatic ICA stenosis. [ABSTRACT FROM AUTHOR]

Null hypothesis significance testing is a statistical tool commonly employed throughout laboratory animal research. When experimental results are reported, the reproducibility of the results is of utmost importance. Establishing standard, robust, and adequately powered statistical methodology in the analysis of laboratory animal data is critical to ensure reproducible and valid results. Simulation studies are a reliable method for assessing the power of statistical tests, however, biologists may not be familiar with simulation studies for power despite their efficacy and accessibility. Through an example of simulated Harlan Sprague-Dawley (HSD) rat organ weight data, we highlight the importance of conducting power analyses in laboratory animal research. Using simulations to determine statistical power prior to an experiment is a financially and ethically sound way to validate statistical tests and to help ensure reproducibility of findings in line with the 4R principles of animal welfare. [ABSTRACT FROM AUTHOR]

This systematic review aimed to summarise and analyse the evidence on the reliability and validity of linear tranducers (LTs) in exercises of different nature and different modes of execution. This systematic review was carried out under PRISMA guidelines, and was carried out using three databases (PubMed, Web of Sciences, and Scopus). Of the 351 initially found, 21 were included in the qualitative synthesis. The results reflected that linear position transducers (LPTs) were valid and reliable in monitoring movement velocity in non-plyometric exercises. However, precision and reliability were lower in execution protocols without isometric phase and in the execution of exercises in multiple planes of movement, with greater measurement errors at higher sampling frequencies. On the other hand, linear velocity transducers (LVTs) proved to be valid and reliable in measuring velocity during plyometric and non-plyometric exercises performed on the Smith machine, with less variation in measurement in the latter. Finally, the use of peak values is recommended, since they are less dependent on the technological errors of LTs. Therefore, the performance of non-plyometric exercises, carried out in the Smith machine and with an isometric phase in the execution of the movement, will help to minimise the technological error of the LTs. [ABSTRACT FROM AUTHOR]

The current controversy surrounding research replication in biomedical and psychosocial sciences often overlooks the uncertainties surrounding both the original and replication studies. Overemphasizing single attempts as definitive replication successes or failures, as exemplified by media coverage of the landmark Reproducibility Project: Psychology, fosters misleading dichotomies and erodes public trust. To avoid such unintended consequences, science communicators should more clearly articulate statistical variation and other uncertainty sources in replication, while emphasizing the cumulative nature of science in general and replication in particular. [ABSTRACT FROM AUTHOR]

Objectives: To evaluate radiomics features' reproducibility using inter-package/inter-observer measurement analysis in renal masses (RMs) based on MRI and to employ machine learning (ML) models for RM characterization. Methods: 32 Patients (23M/9F; age 61.8 ± 10.6 years) with RMs (25 renal cell carcinomas (RCC)/7 benign masses; mean size, 3.43 ± 1.73 cm) undergoing resection were prospectively recruited. All patients underwent 1.5 T MRI with T2-weighted (T2-WI), diffusion-weighted (DWI)/apparent diffusion coefficient (ADC), and pre-/post-contrast-enhanced T1-weighted imaging (T1-WI). RMs were manually segmented using volume of interest (VOI) on T2-WI, DWI/ADC, and T1-WI pre-/post-contrast imaging (1-min, 3-min post-injection) by two independent observers using two radiomics software packages for inter-package and inter-observer assessments of shape/histogram/texture features common to both packages (104 features; n = 26 patients). Intra-class correlation coefficients (ICCs) were calculated to assess inter-observer and inter-package reproducibility of radiomics measurements [good (ICC ≥ 0.8)/moderate (ICC = 0.5–0.8)/poor (ICC < 0.5)]. ML models were employed using reproducible features (between observers and packages, ICC > 0.8) to distinguish RCC from benign RM. Results: Inter-package comparisons demonstrated that radiomics features from T1-WI-post-contrast had the highest proportion of good/moderate ICCs (54.8–58.6% for T1-WI-1 min), while most features extracted from T2-WI, T1-WI-pre-contrast, and ADC exhibited poor ICCs. Inter-observer comparisons found that radiomics measurements from T1-WI pre/post-contrast and T2-WI had the greatest proportion of features with good/moderate ICCs (95.3–99.1% T1-WI-post-contrast 1-min), while ADC measurements yielded mostly poor ICCs. ML models generated an AUC of 0.71 [95% confidence interval = 0.67–0.75] for diagnosis of RCC vs. benign RM. Conclusion: Radiomics features extracted from T1-WI-post-contrast demonstrated greater inter-package and inter-observer reproducibility compared to ADC, with fair accuracy for distinguishing RCC from benign RM. Clinical relevance: Knowledge of reproducibility of MRI radiomics features obtained on renal masses will aid in future study design and may enhance the diagnostic utility of radiomics models for renal mass characterization. [ABSTRACT FROM AUTHOR]

Computer code plays a vital role in modern science, from the conception and design of experiments through to final data analyses. Open sharing of code has been widely discussed as being advantageous to the scientific process, allowing experiments to be more easily replicated, helping with error detection, and reducing wasted effort and resources. In the case of psychology, the code used to present stimuli is a fundamental component of many experiments. It is not known, however, the degree to which researchers are sharing this type of code. To estimate this, we conducted a survey of 400 psychology papers published between 2016 and 2021, identifying those working with the open-source tools Psychtoolbox and PsychoPy that openly share stimulus presentation code. For those that did, we established if it would run following download and also appraised the code's usability in terms of style and documentation. It was found that only 8.4% of papers shared stimulus code, compared to 17.9% sharing analysis code and 31.7% sharing data. Of shared code, 70% ran directly or after minor corrections. For code that did not run, the main error was missing dependencies (66.7%). The usability of the code was moderate, with low levels of code annotation and minimal documentation provided. These results suggest that stimulus presentation code sharing lags behind other forms of code and data sharing, potentially due to less emphasis on such code in open-science discussions and in journal policies. The results also highlight a need for improved documentation to maximize code utility. [ABSTRACT FROM AUTHOR]

Background: White blood cell (WBC) scintigraphy plays a major role in the diagnostic approach to periprosthetic infections. Although the procedure has been standardized by the publication of several guidelines, the interpretation of this technique may be susceptible to intra and inter-variability. We aimed to assess the reproducibility of interpretation between nuclear medicine physicians and by the same physician and to demonstrate that Cohen's coefficient is more unstable than Gwet's coefficient, as the latter is influenced by the prevalence rates. Methods: We enrolled 59 patients who performed a Technetium-99m WBC (99mTc-WBC) scintigraphy for suspected hip or knee prosthesis infection. Three physicians, blinded to all patient clinical data, performed two image readings. Each WBC study was assessed both visually and semi-quantitatively according to the guidelines of the European Association of Nuclear Medicine (EANM). For semi-quantitative analysis, readers drew an irregular Region of Interest (ROI) over the suspected infectious lesion and copied it to the normal contralateral bone. The mean counts per ROI were used to calculate lesion-to-reference tissue ( L R ) ratios for both late and delayed images. An increase in L R over time ( L R late > L R delayed ) of more than 20% was considered indicative of infection. Agreement between readers and between readings was assessed by the first-order agreement coefficient (Gwet's AC1). Reading time for each scan was compared between the three readers in both the first and the second reading, using the Generalized Linear Mixed Model. Results: An excellent agreement was found among all three readers: 0.90 for the first reading and 0.94 for the second reading. Both inter- and intra-variability showed values ≥0.86. Gwet's method demonstrated greater robustness than the Cohen coefficient when assessing the intra and inter-rater variability, since it is not influenced by the prevalence rate. Conclusions: These studies can contribute to improving the reliability of nuclear medicine imaging techniques and to evaluating the effectiveness of trainee preparation. [ABSTRACT FROM AUTHOR]

We describe a Python-based software tool called RADIAN (RAnDom spatIal dAta geNerator) developed with the purpose of generating simple synthetic spatial datasets. These datasets can be used in many contexts such as teaching and learning of GIS, testing of spatial algorithms, testing and visualization approaches. This paper provides a motivation for the need for a tool such as RADIAN along with a survey of other similar approaches. The methodological component of how RADIAN generates synthetic spatial datasets is described. We describe experimental results from the comparison of RADIAN with QGIS, which is the most closely comparable tool available at the time of writing. Finally, we provide some conclusions on the impact and potential of RADIAN with some interesting avenues for future work and development. RADIAN is available as open-source software. [ABSTRACT FROM AUTHOR]

Understanding the functions of metal ions in biological systems is crucial for many aspects of research, including deciphering their roles in diseases and potential therapeutic use. Structural information about the molecular or atomic details of these interactions, generated by methods like X-ray crystallography, cryo-electron microscopy, or nucleic magnetic resonance, frequently provides details that no other method can. As with any experimental method, they have inherent limitations that sometimes lead to an erroneous interpretation. This manuscript highlights different aspects of structural data available for metal-protein complexes. We examine the quality of modeling metal ion binding sites across different structure determination methods, where different kinds of errors stem from, and how they can impact correct interpretations and conclusions. [ABSTRACT FROM AUTHOR]

Highlights Doppler ultrasound may be used to assess leg blood flow (Q̇leg${{\dot{Q}}_{{\mathrm{leg}}}}$), but the reliability of this method remains unexplored in patients with chronic obstructive pulmonary disease (COPD), where between‐subject variability may be larger than healthy due to peripheral vascular changes. This study aimed to investigate the reliability of Doppler ultrasound in quantifying Q̇leg${{\dot{Q}}_{{\mathrm{leg}}}}$ during single‐leg knee‐extensor exercise (KEE) in COPD patients compared with those obtained from healthy matched controls. In this case–control study, 16 participants with COPD were matched based on sex and age with 16 healthy controls. All participants underwent measurement of Q̇leg${{\dot{Q}}_{{\mathrm{leg}}}}$ using Doppler ultrasound in a KEE set‐up at various intensities on two separate visits. Confounding factors on Q̇leg${{\dot{Q}}_{{\mathrm{leg}}}}$ were controlled for, and the ultrasound scans were consistently performed by the same sonographer. During exercise, smallest real difference (SRD) ranged from 367 mL to 583 mL in COPD and 438 mL to 667 mL in the control group. The coefficient of variation (CV) ranged from 7.9% to 14.3% in COPD and 9.4% to 10.4% in the control group. The intraclass correlation coefficient ranged from 0.75 to 0.92 in COPD and 0.67 to 0.84 in the control group. CV was lower in the control group during exercise at 0 W, but apart from that, reliability was not different between groups during exercise. Doppler ultrasound showed nearly equal reliability when evaluating Q̇leg${{\dot{Q}}_{{\mathrm{leg}}}}$ in COPD patients and healthy individuals with a CV below 15% during exercise for both groups. What is the central question of this study? What is the between‐day reliability of Doppler ultrasound when quantifying leg blood flow during single‐leg knee‐extensor exercise in COPD patients compared to healthy matched controls? What is the main finding and its importance? This study demonstrates a coefficient of variation ranging from 7.9 to 14.3% during single‐leg knee‐extensor exercise for between‐day reliability when applying Doppler ultrasound to assess leg blood flow in patients with COPD. Furthermore, it offers insights into the peripheral circulatory constraints in COPD, as evidenced by diminished leg blood flow. This study is the first of its kind to evaluate the reliability of Doppler ultrasound in the assessment of the peripheral circulation during exercise in COPD. What is the central question of this study?What is the between‐day reliability of Doppler ultrasound when quantifying leg blood flow during single‐leg knee‐extensor exercise in COPD patients compared to healthy matched controls?What is the main finding and its importance?This study demonstrates a coefficient of variation ranging from 7.9 to 14.3% during single‐leg knee‐extensor exercise for between‐day reliability when applying Doppler ultrasound to assess leg blood flow in patients with COPD. Furthermore, it offers insights into the peripheral circulatory constraints in COPD, as evidenced by diminished leg blood flow. This study is the first of its kind to evaluate the reliability of Doppler ultrasound in the assessment of the peripheral circulation during exercise in COPD. [ABSTRACT FROM AUTHOR]

While interest in using wearable sensors to measure infant leg movement is increasing, attention should be paid to the characteristics of the sensors. Specifically, offset error in the measurement of gravitational acceleration (g) is common among commercially available sensors. In this brief report, we demonstrate how we measured the offset and other errors in three different off-the-shelf wearable sensors available to professionals and how they affected a threshold-based movement detection algorithm for the quantification of infant leg movement. We describe how to calibrate and correct for these offsets and how conducting this improves the reproducibility of results across sensors. [ABSTRACT FROM AUTHOR]

The purpose of this study was to analyze the criterion‐related validity and the reliability of the standing long jump test (SLJ) for evaluating the lower‐body explosive muscular strength in adults. A total of 410 adults participated in this study. Sociodemographic, anthropometric measurements, laboratory lower‐body muscular strength tests, and the field‐based SLJ were performed. In validity analysis, stepwise regression analysis showed that maximal horizontal power, sex, percentage of body fat, maximal horizontal force, and lean mass were significantly associated with the SLJ distance (R2 = 0.78; p < 0.001). Reliability analysis showed significant differences between test–retest in the SLJ test, with an overestimation of the second measurement compared to the first [12.14 ± 14.46 cm, intraclass correlation coefficient (ICC) = 0.94 (0.75–0.97), p < 0.001; Cohen's d = 0.31]. The coefficient of variation (CV) was 7.06% and the minimal detectable change (MDC90) was 29 cm. After a learning period, higher reliability values were found [0.45 ± 1.04 cm, ICC = 1.00 (0.99–1.00); p = 0.001; CV = 0.53 %; MDC90 = 1 cm]. The SLJ test may be a valid tool to assess lower‐body explosive muscular strength in the adult population. A learning period may be necessary to provide reliability on the SLJ test. Highlights: The standing long jump (SLJ) test is the most used field‐based test for assessing lower‐body explosive muscular strength. However, its criterion‐related validity and reliability have not been explored in the adult population.The SLJ is a valid test. Maximal horizontal power, sex, percentage of body fat, maximal horizontal force, and lean mass account for validity variance in SLJ distance.The SLJ test is a reliable tool, regardless of sex, age and physical activity levels. It may be beneficial to implement a familiarization period before evaluation to ensure reliability.The SLJ test is practical, time‐efficient, and low in cost and equipment requirements. [ABSTRACT FROM AUTHOR]

Significance: Near‐infrared spectroscopy (NIRS) measurement is a widely used technique to measure muscle oxygenation. A knowledge of the reproducibility of NIRS measurements is essential for the correct interpretation of data. Aim: Our aim was to test the reproducibility and sex differences of NIRS measurements during brachial artery occlusion in healthy participants. Approach: An NIRS device was used to measure muscle oxygenation and microvascular function during a 5 min brachial occlusion. Muscle oxygen consumption (mVO2) and tissue saturation index (TSI%) were used. The occlusion test was performed three times on separate days for males (n = 13, 28 ± 8 years) and females (n = 13, 29 ± 7 years). Results: During the occlusion phase, the reproducibility of mVO2 was excellent (intraclass correlation; ICC = 0.90). During the reperfusion phase, the maximal change in TSI% revealed the best reproducibility (ICC = 0.77). There were no sex differences in reproducibility. Male participants had higher muscle oxygenation during occlusion (mVO2, 0.054 ± 0.010 vs. 0.038 ± 0.012 mLO2/min/100 g, p = 0.001, male and female, respectively). There were no sex differences during the reperfusion phase. Conclusion: The reproducibility of NIRS to measure muscle oxygenation and microvascular function during circulation occlusion and reperfusion is good to excellent. Muscle oxygen capacity measured during occlusion is higher in males compared to females, and there are no sex differences in microvascular function during the reperfusion phase. [ABSTRACT FROM AUTHOR]

Purpose: To assess intra‐ (repeatability) and inter‐observer (reproducibility) variability of laser speckle flowgraphy (LSFG) for retinal blood flow (RBF) measurement in 20 eyes of wild type (C57BL/6J) mice and effect of intravitreal Aflibercept on RBF in optic nerve head (ONH) region of 10 eyes of Ins2 (Akita) diabetic mice. Methods: 'Mean blur rate (MBR)' was measured for all quadrants of tissue area (MT), vessel (MV) and total area (MA) of ONH region. Changes in MT were analysed at each timepoint. Repeatability was evaluated by measuring MBR variability without changing mouse head position, and reproducibility after resetting mouse head position by another operator. Coefficient of repeatability (CR) through Bland–Altman plot method coefficient of variation (COV) and Intraclass correlation coefficient (ICC) was calculated. Intravitreal Aflibercept (1 μg) was administered to Akita eyes and intraocular pressure (IOP) was measured using a tonometer at baseline, day 7, 14, 21 and 28 post‐injection. Hurvich and Tsai's criterion was used. Results: Coefficient of repeatability values of repeatability and reproducibility for all quadrants were within limits of agreement. Reliability was excellent (ICC 0.98–0.99) and reproducibility was moderate to excellent (ICC 0.64–0.96). There was a non‐significant IOP increase in all Akita eyes at Day 28 (p > 0.05), and significant increase in MT in all quadrants at Day 21 and superior, inferior and temporal quadrants at Day 28 (p < 0.05). Conclusion: Laser speckle flowgraphy demonstrates excellent repeatability and moderate to excellent reproducibility in measuring RBF. Intravitreal Aflibercept injection results in a significant increase in MT up to 28 days post‐injection without significant increase in IOP. [ABSTRACT FROM AUTHOR]

There is widespread misuse of statistics in research, particularly in the life sciences, which is one of the contributing factors to reproducibility concerns in research. However, the formal quantitative training that life sciences research trainees receive is often quite limited. Our survey of statistics requirements in undergraduate life sciences programmes offered by the top research-intensive universities in Canada, the U15 Group of Canadian Research Universities, confirmed that training in statistics tends to be limited and more general in nature. To help raise awareness and address these limitations, this paper shares findings of this statistics requirements survey and describes the evidence-based framework for a second-year undergraduate course at the University of Toronto, which was introduced to integrate statistics instruction with the life sciences research process. We hope these insights will inform future quantitative course offerings, and ultimately, better prepare students to effectively engage with statistics in life sciences research. [ABSTRACT FROM AUTHOR]

Purpose: This study aimed to assess the reliability of lower limb muscle function (knee extensor/flexor peak torque, rate of torque development (RTD), impulse, and countermovement jump (CMJ) performance) and sprint performance (acceleration capacity). Methods: CMJ performance was evaluated on a force plate. MVIC, RTD and impulse variables were investigated using a portable isometric dynamometer and sprint performance was assessed with dual-beam photocells in elite female athletes. Results: CMJ test variables maximal vertical jump height, peak and mean power, concentric work, and body center of mass displacement demonstrated good-to-excellent test–retest correlations between Test 1 and Test 2 (ICC ≥ 0.70, CWw-s = 3.4–11.0%). Peak MVIC torque for the knee extensors and flexors demonstrated excellent test–retest correlations (both ICC = 0.84) along with CVw-s values of 6.8 and 6.0%, respectively. Late-phase (0–100 ms, 0–200 ms) RTD for the knee flexors demonstrated excellent test–retest correlations (ICC = 0.89–0.91, CVw-s = 4.8–8.5%). Sprint times at 10- and 20-m demonstrated excellent test–retest reproducibility (ICC = 0.83 and ICC = 0.90, respectively) with CVw-s values of 1.9 and 1.5%. For 5-m sprint times, test–retest reproducibility was good (ICC = 0.71) with CVw-s of 2.8%. Sprint testing performed while dribbling a handball improved (p < 0.05) from test to retest at 5-, 10- and 20-m. Conclusion: In conclusion, the force plate, the mobile isometric dynamometer, and dual-beam photocells provide reproducible tools for field-based testing of countermovement jump performance, knee extensor and flexor strength and sprint performance. [ABSTRACT FROM AUTHOR]

Purpose: SpotChecks is a new contrast sensitivity (CS) test designed for self‐monitoring of vision. This study assessed the test–retest repeatability of take‐home SpotChecks, in‐office SpotChecks and near Pelli–Robson charts in healthy adults. Methods: One eye of 61 healthy adults with near visual acuity (VA) of 6/9 or better (age range 22–84, mean 49 [18] years) was tested during two office visits (mean 10 [8] days apart). Each visit included high‐contrast VA, then 12 randomly ordered CS tests (6 different SpotChecks and 6 different Pelli–Robson) under the same lighting (luminance 110 cd/m2), all at near in the same eye with habitual correction. The same eye was self‐tested with take‐home SpotChecks once a day on 6 days between the office visits. SpotChecks was scored by the logCS at the highest line with ≥2 errors. Pelli–Robson was scored by [0.05 × number of letters read correctly − 0.15]. Repeatability of logCS was defined as 1.96 2Sw, Sw representing within‐subject standard deviation. Comparison for repeatability was performed with Bootstrap hypothesis test. Results: SpotChecks and Pelli–Robson showed similar intra‐session or inter‐visit repeatability (p = 0.14–0.81). Inter‐day repeatability for take‐home SpotChecks was 0.18 logCS, the same as that from the first measurements of two office visits with SpotChecks or Pelli–Robson. Inter‐visit repeatability improved to 0.15 by using the average of two repeated measurements for SpotChecks (p = 0.02) or three repeated measurements for Pelli–Robson (p = 0.04). Age showed a small effect on logCS (−0.015/decade, p = 0.02) for both SpotChecks and Pelli–Robson. Mean logCS was 0.05 lower in those ≥50 years (SpotChecks 1.84 [0.10] and Pelli–Robson 1.77 [0.10]) compared with those <50 years of age (SpotChecks 1.89 [0.07] and Pelli–Robson 1.83 [0.07]). Conclusions: SpotChecks showed good repeatability with take‐home and in‐office testing in healthy adults, making it a promising tool for monitoring disease progression at home. [ABSTRACT FROM AUTHOR]

Economics has become increasingly empirical and, alongside this shift, has come more demand for improved transparency and reproducibility in empirical economic research. In this article, we distribute a survey to almost 1500 economics faculty from the top 161 liberal arts colleges with an economics major (according to U.S. News & World Report) in the United States to determine the prevalence of teaching reproducible methods in undergraduate economics, summarize the most-common methods of instruction, and determine the intended student learning objectives. We find that of the economics faculty at liberal arts colleges who teach these reproducible methods, most do so in advanced upper-level (42%) and basic econometrics (31%) courses. Those faculty report teaching reproducibility using the following methods: transparent coding (85%), organizational skills (78%), and producing replication documentation (47%) through individual research projects (82%), homework assignments (55%), and/or workshops (33%). We conclude with some qualitative text analysis to shed light on the intended learning objectives and find that research skills (59%) and the importance of reproducibility (37%) are the most common reasons cited for teaching these methods. [ABSTRACT FROM AUTHOR]

Naturalistic body stimuli are necessary for understanding many aspects of human psychology, yet there are no centralized databases of body stimuli. Furthermore, there are a high number of independently developed stimulus sets lacking in standardization and reproducibility potential, and a general lack of organization, contributing to issues of both replicability and generalizability in body-related research. We conducted a comprehensive scoping review to index and explore existing naturalistic whole-body stimuli. Our research questions were as follows: (1) What sets of naturalistic human whole-body stimuli are present in the literature? And (2) On what factors (e.g., demographics, emotion expression) do these stimuli vary? To be included, stimulus sets had to (1) include human bodies as stimuli; (2) be photographs, videos, or other depictions of real human bodies (not computer generated, drawn, etc.); (3) include the whole body (defined as torso, arms, and legs); and (4) could include edited images, but still had to be recognizable as human bodies. We identified a relatively large number of existing stimulus sets (N = 79) which offered relative variability in terms of main manipulated factors and the degree of visual information included (i.e., inclusion of heads and/or faces). However, stimulus sets were demographically homogenous, skewed towards White, young adult, and female bodies. We identified significant issues in reporting and availability practices, posing a challenge to the generalizability, reliability, and reproducibility of body-related research. Accordingly, we urge researchers to adopt transparent and accessible practices and to take steps to diversify body stimuli. [ABSTRACT FROM AUTHOR]

Context: Lower extremity physical performance tests (PPTs) have been widely used in sports rehabilitation and are commonly performed in person. However, some situations may disrupt the in-person health care delivery, such as social distancing due to the pandemic, traveling, and living in remote locations. Those situations may require adjustments in planning and applying measurement tests, and telehealth has become an alternative. Nevertheless, the reliability of lower extremity PPT tests via telehealth is still unknown. Objectives: To verify the test–retest reliability, SEM, and the minimum detectable change (MDC95) of PPTs via telehealth. Methods: Fifty asymptomatic athletes completed 2 assessment sessions 7 to 14 days apart. The assessment via telehealth consisted of warm-up exercises followed by the single-, triple-, and side-hop tests, and the long jump test, in random order. Intraclass correlation coefficient, SEM, and MDC95 were calculated for each PPT. Results: Single-hop test showed good to excellent reliability, with SEM and MDC95 ranging from 6.06 to 9.24 cm and 16.79 to 25.61 cm, respectively. The triple-hop test showed excellent reliability, with SEM and MDC95 ranging from 13.17 to 28.17 cm and 30.72 to 78.07 cm, respectively. Side-hop tests showed moderate reliability, with SEM and MDC95 ranging from 0.67 to 1.22 seconds and 2.00 to 3.39 seconds, respectively. The long jump test showed excellent reliability, with SEM and MDC95 ranging from 5.34 to 8.34 cm and 14.80 to 23.11 cm, respectively. Conclusion: The test–retest reliability of those PPTs via telehealth was acceptable. The SEM and MDC were provided to assist clinicians in interpreting those PPTs. [ABSTRACT FROM AUTHOR]

Psychological science has thrived thanks to new methods and innovative practices. Journals, including Behavior Research Methods (BRM), continue to support the dissemination and evaluation of research assets including data, software/hardware, statistical code, and databases of stimuli. However, such research assets rarely allow for computational reproducibility, meaning they are difficult to reuse. Therefore, in this preregistered report, we explore how BRM's authors and BRM structures shape the landscape of functional research assets. Our broad research questions concern: (1) How quickly methods and analytical techniques reported in BRM can be used and developed further by other scientists; (2) Whether functionality has improved following changes to BRM journal policy in support of computational reproducibility; (3) Whether we can disentangle such policy changes from changes in reproducibility over time. We randomly sampled equal numbers of papers (N = 204) published in BRM before and after the implementation of policy changes. Pairs of researchers recorded how long it took to ensure assets (data, software/hardware, statistical code, and materials) were fully operational. They also coded the completeness and reusability of the assets. While improvements were observed in all measures, only changes to completeness were altered significantly following the policy changes (d =.37). The effects varied between different types of research assets, with data sets from surveys/experiments showing the largest improvements in completeness and reusability. Perhaps more importantly, changes to policy do appear to have improved the life span of research products by reducing natural decline. We conclude with a discussion of how, in the future, research and policy might better support computational reproducibility within and beyond psychological science. [ABSTRACT FROM AUTHOR]

Passive smartphone measures hold significant potential and are increasingly employed in psychological and biomedical research to capture an individual's behavior. These measures involve the near-continuous and unobtrusive collection of data from smartphones without requiring active input from participants. For example, GPS sensors are used to determine the (social) context of a person, and accelerometers to measure movement. However, utilizing passive smartphone measures presents methodological challenges during data collection and analysis. Researchers must make multiple decisions when working with such measures, which can result in different conclusions. Unfortunately, the transparency of these decision-making processes is often lacking. The implementation of open science practices is only beginning to emerge in digital phenotyping studies and varies widely across studies. Well-intentioned researchers may fail to report on some decisions due to the variety of choices that must be made. To address this issue and enhance reproducibility in digital phenotyping studies, we propose the adoption of preregistration as a way forward. Although there have been some attempts to preregister digital phenotyping studies, a template for registering such studies is currently missing. This could be problematic due to the high level of complexity that requires a well-structured template. Therefore, our objective was to develop a preregistration template that is easy to use and understandable for researchers. Additionally, we explain this template and provide resources to assist researchers in making informed decisions regarding data collection, cleaning, and analysis. Overall, we aim to make researchers' choices explicit, enhance transparency, and elevate the standards for studies utilizing passive smartphone measures. [ABSTRACT FROM AUTHOR]

Workflows are a standard and a crucial part of data-intensive research. They are iterative processes that support replicability and reproducibility by organising problem-solving tasks into well-documented sequential steps. Given the emergence of data-intensive design research, there is a need to adapt these practices in design research to help increase the transparency and, thus, quality of research. We present a step-by-step guide to applying a data analysis workflow in design research using an example of measuring empathic understanding via facial expression analysis. This note demonstrates the importance of a systematic workflow in data-intensive design research and how it adds the necessary transparency and detail to the method section. It shows how various research outcomes emerge throughout the process. Standardised data analysis, emphasising data preprocessing and exploration, and thorough reporting form the basis for research replicability, reproducibility, and transparency in data-intensive design research. [ABSTRACT FROM AUTHOR]

Rapid, in situ, and real‐time molecule mapping on rough surfaces with high accuracy has long been one of the paramount challenges in many fields. Here, an effortless Ag NPs doped glycerol liquid film SERS substrate (g‐LFS) is developed to investigate the distribution of contaminants on different types of rough surfaces. After substrate optimization, the g‐LFS is characterized in terms of uniformity, reproducibility, and stability with time. The substrate showed an excellent signal stability, even after 96.5 h of usage or 19 days of storage, together with great uniformity (7.4% RSD) and reproducibility (7.1% RSD). As a proof of concept, the distribution of Rhodamine 6G(R6G) dye on rough fabric and the R6G migration in different plant types and tissues have been explored. The g‐LFS substrate demonstrated great accuracy, detecting R6G even in deep fabric grooves, recovering 82.4% of the initial concentration. Moreover, the g‐LFS SERS substrate detected significantly different concentrations in root, stem and leave tissues of bean sprouts, as well as between xylem and phloem in vascular plant branches. Overall, the g‐LFS substrate is proven to be well‐suited for in situ detection on rough surfaces with great versatility and robustness, aggregating new opportunities for contaminant investigation on food and plants using SERS. [ABSTRACT FROM AUTHOR]

Three-dimensional echocardiography (3DE) is currently the preferred method for monitoring left ventricular ejection fraction (LVEF) in cancer patients receiving potentially cardiotoxic anti-neoplastic therapy. In Denmark, however, the traditional standard for LVEF monitoring has been rooted in nuclear medicine departments utilizing equilibrium radionuclide angiography (ERNA). Although ERNA remains a principal modality, there is an emerging trend towards the adoption of echocardiography for this purpose. Given this context, assessing the reproducibility of 3DE among non-specialized medical personnel is crucial for its clinical adoption in such departments. To assess the feasibility of 3DE for LVEF measurements by technologists, we evaluated the repeatability and reproducibility of two moderately experienced technologists. They performed 3DE on 12 volunteers over two sessions, with a collaborative review of the results from the first session before the second session. Two-way intraclass correlation values increased from 0.03 to 0.77 across the sessions. This increase in agreement was mainly due to the recognition of false low measurements. Our findings underscore the importance of incorporating reproducibility exercises in the context of 3DE, especially when operated by technologists. Additionally, routine control of the acquisitions by physicians is deemed necessary. Ensuring these hurdles are adequately managed enables the adoption of 3DE for LVEF measurements by technologists. [ABSTRACT FROM AUTHOR]

This study aimed to (1) replicate a deep-learning-based model for cerebral aneurysm segmentation in TOF-MRAs, (2) improve the approach by testing various fully automatic pre-processing pipelines, and (3) rigorously validate the model's transferability on independent, external test-datasets. A convolutional neural network was trained on 235 TOF-MRAs acquired on local scanners from a single vendor to segment intracranial aneurysms. Different pre-processing pipelines including bias field correction, resampling, cropping and intensity-normalization were compared regarding their effect on model performance. The models were tested on independent, external same-vendor and other-vendor test-datasets, each comprised of 70 TOF-MRAs, including patients with and without aneurysms. The best-performing model achieved excellent results on the external same-vendor test-dataset, surpassing the results of the previous publication with an improved sensitivity (0.97 vs. ~ 0.86), a higher Dice score coefficient (DSC, 0.60 ± 0.25 vs. 0.53 ± 0.31), and an improved false-positive rate (0.87 ± 1.35 vs. ~ 2.7 FPs/case). The model further showed excellent performance in the external other-vendor test-datasets (DSC 0.65 ± 0.26; sensitivity 0.92, 0.96 ± 2.38 FPs/case). Specificity was 0.38 and 0.53, respectively. Raising the voxel-size from 0.5 × 0.5×0.5 mm to 1 × 1×1 mm reduced the false-positive rate seven-fold. This study successfully replicated core principles of a previous approach for detecting and segmenting cerebral aneurysms in TOF-MRAs with a robust, fully automatable pre-processing pipeline. The model demonstrated robust transferability on two independent external datasets using TOF-MRAs from the same scanner vendor as the training dataset and from other vendors. These findings are very encouraging regarding the clinical application of such an approach. [ABSTRACT FROM AUTHOR]

This study investigates the perceptions of high school students regarding the concepts of evidence related to the reproducibility of experimental data, also in addition to analyzing the evolution of these concepts over a school year, considering the implementation of a series of diverse practical activities integrated into the school curriculum. In total, 164 first-year high school students fully participated in the research, based on a quantitative approach covering a pre-experimental design with two tests, one at the beginning and another at the end of the school year. In addition to the tests, some students were interviewed. The comparison of the pre- and post-test results indicates, for the group of students surveyed, that there was a certain sophistication in thinking about the constructs researched. However, the analysis of the justifications revealed that a large portion of the participants did not understand the real reasons of the importance of working with a larger number of measurements properly. Based on the results, educational implications are discussed, and new research questions are proposed. [ABSTRACT FROM AUTHOR]

Purpose: Preclinical imaging, with translational potential, lacks a standardized method for defining volumes of interest (VOIs), impacting data reproducibility. The aim of this study was to determine the interobserver variability of VOI sizes and standard uptake values (SUVmean and SUVmax) of different organs using the same [18F]FDG-PET and PET/CT datasets analyzed by multiple observers. In addition, the effect of a standardized analysis approach was evaluated. Procedures: In total, 12 observers (4 beginners and 8 experts) analyzed identical preclinical [18F]FDG-PET-only and PET/CT datasets according to their local default image analysis protocols for multiple organs. Furthermore, a standardized protocol was defined, including detailed information on the respective VOI size and position for multiple organs, and all observers reanalyzed the PET/CT datasets following this protocol. Results: Without standardization, significant differences in the SUVmean and SUVmax were found among the observers. Coregistering CT images with PET images improved the comparability to a limited extent. The introduction of a standardized protocol that details the VOI size and position for multiple organs reduced interobserver variability and enhanced comparability. Conclusions: The protocol offered clear guidelines and was particularly beneficial for beginners, resulting in improved comparability of SUVmean and SUVmax values for various organs. The study suggested that incorporating an additional VOI template could further enhance the comparability of the findings in preclinical imaging analyses. [ABSTRACT FROM AUTHOR]

Biologists increasingly rely on computer code to collect and analyze their data, reinforcing the importance of published code for transparency, reproducibility, training, and a basis for further work. Here, we conduct a literature review estimating temporal trends in code sharing in ecology and evolution publications since 2010, and test for an influence of code sharing on citation rate. We find that code is rarely published (only 6% of papers), with little improvement over time. We also found there may be incentives to publish code: Publications that share code have tended to be low‐impact initially, but accumulate citations faster, compensating for this deficit. Studies that additionally meet other Open Science criteria, open‐access publication, or data sharing, have still higher citation rates, with publications meeting all three criteria (code sharing, data sharing, and open access publication) tending to have the most citations and highest rate of citation accumulation. [ABSTRACT FROM AUTHOR]

One aspect of reproducibility in preclinical research that is frequently overlooked is the physical condition in which physiological, pharmacological, or behavioural recordings are conducted. In this study, the physical conditions of mice were altered through the attachments of wireless electrophysiological recording devices (Neural Activity Tracker-1, NAT-1). NAT-1 devices are miniaturised multichannel devices with onboard memory for direct high-resolution recording of brain activity for >48 h. Such devices may limit the mobility of animals and affect their behavioural performance due to the added weight (total weight of approximately 3.4 g). The mice were additionally treated with saline (control), N-methyl-D-aspartate (NMDA) receptor antagonist MK801 (0.85 mg/kg), or the muscarinic acetylcholine receptor blocker scopolamine (0.65 mg/kg) to allow exploration of the effect of NAT-1 attachments in pharmacologically treated mice. We found only minimal differences in behavioural outcomes with NAT-1 attachments in standard parameters of locomotor activity widely reported for the open field test between the drug treatments. Hypoactivity was globally observed as a consistent outcome in the MK801-treated mice and hyperactivity in scopolamine groups regardless of NAT-1 attachments. These data collectively confirm the reproducibility for combined behavioural, pharmacological, and physiological endpoints even in the presence of lightweight wireless data loggers. The NAT-1 therefore constitutes a pertinent tool for investigating brain activity in, e.g., drug discovery and models of neuropsychiatric and/or neurodegenerative diseases with minimal effects on pharmacological and behavioural outcomes. [ABSTRACT FROM AUTHOR]