Search

Objectives To comprehensively synthesise evidence regarding the validity and reliability of the Anaesthetists’ Non-Technical Skills (ANTS) behavioural marker system and its application as a tool for the training and assessment of non-technical skills to improve patient safety.Design Systematic review.Data sources We employed a citation search strategy. The Scopus and Web of Science databases were searched for articles published from 2002 to May 2022.Eligibility criteria English-language publications that applied the ANTS system in a meaningful way, including its use to guide data collection, analysis and reporting.Data extraction and synthesis Study screening, data extraction and quality assessment were performed by two independent reviewers. We appraised the quality of included studies using the Joanna Briggs Institute Critical Appraisal Checklists. A framework analysis approach was used to summarise and synthesise the included articles.Results 54 studies were identified. The ANTS system was applied across a wide variety of study objectives, settings and units of analysis. The methods used in these studies varied and included quantitative (n=42), mixed (n=8) and qualitative (n=4) approaches. Most studies (n=47) used the ANTS system to guide data collection. The most commonly reported reliability statistic was inter-rater reliability (n=35). Validity evidence was reported in 51 (94%) studies. The qualitative application outcomes of the ANTS system provided a reference for the analysis and generation of new theories across disciplines.Conclusion Our results suggest that the ANTS system has been used in a wide range of studies. It is an effective tool for assessing non-technical skills. Investigating the methods by which the ANTS system can be evaluated and implemented for training within clinical environments is anticipated to significantly enhance ongoing enhancements in staff performance and patient safety.PROSPERO registration number CRD42022297773.

Introduction The high incidence of unsafe anaesthetic care leads to adverse events and increases the burden on patient safety. An important reason for unsafe anaesthesia care is the lack of non-technical skills (NTS), which are defined as personal cognitive, social or interpersonal skills, among anaesthetists. The anaesthetists’ NTS (ANTS) behavioural marker system has been widely used to evaluate and improve anaesthetists’ behavioural performance to ensure patient safety. This protocol describes a planned systematic review aiming to determine the validity and reliability of the ANTS behavioural marker system and its application as a tool for the training and assessment of ANTS and for improving patient safety.Methods and analysis This systematic review follows the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocol. Studies that applied the ANTS behavioural marker system in a meaningful way, including using the ANTS behavioural marker system to guide data collection, analysis, coding, measurement, and/or reporting, which have been published in peer-reviewed journals, will be eligible. A citation search strategy will be employed. We will search Scopus and Web of Science for publications from 2002 to May 2022, which cite the three original ANTS behavioural marker system publications by Fletcher et al. We will also search the references of the relevant reviews for additional eligible studies. For each study, two authors will independently screen papers to determine eligibility and will extract the data. The quality of the included studies will be assessed using the Joanna Briggs Institute (JBI) Critical Appraisal Checklists. A framework analysis approach that consists of five steps—familiarisation, identifying a thematic data extraction framework, indexing, charting, mapping and interpretation—will be used to synthesise and report the data.Ethics and dissemination Ethics approval is not required for this study. The findings will be disseminated primarily through peer-reviewed publications and conference presentations.PROSPERO registration number CRD42022297773.