Search

While several competency frameworks have been proposed for Human Factors and Ergonomics (HFE) practitioners, these are not commonly based on structured analyses. The aim of this research was to develop a sociotechnical systems model of the HFE practitioner role in Australia and identify the competencies required to fulfil the role. Study One applied the Work Domain Analysis phase of cognitive work analysis (CWA) to model the HFE practitioner role. Model refinement was undertaken with seven subject matter experts. In Study Two, the model was used to elicit the competencies (knowledge, skills, abilities, other characteristics) required for successful performance, via a survey of 28 HFE practitioners. Most competencies related to skills (i.e. communication skills) and knowledge (i.e. domain knowledge). Gaps in competencies were also identified, linked to a lack of HFE education pathways in Australia. The findings have practical utility for designing HFE practitioner roles and educational programs. Practitioner summary: Cognitive work analysis provided a structured analysis of the role of the Human Factors and Ergonomics (HFE) practitioner and to support the identification of competencies. The results suggest that HFE practitioners are generalists rather than specialists and have implications for the job design and education of HFE practitioners. Abbreviations: BCPE: board of certification in professional ergonomics; CIEHF: chartered institute of ergonomics and human factors; CWA: cognitive work analysis; HFE: human factors and ergonomics; HFESA: human factors and ergonomics society of Australia; IEA: International Ergonomics Association; KSAO: knowledge, skills, abilities and other characteristics; O*NET: occupation information network; SME: subject matter expert; SRK: skills, rules, knowledge; UK: United Kingdom; USA: United States of America; WDA: work domain analysis.

There have been recent calls for Human Factors and Ergonomics (HFE) to expand its reach and focus to address larger scale societal and global issues. An area of growing awareness is the issue of the gender data gap, whereby women are under-represented in research data, leading to inequitable outcomes when research findings are used to design real world technologies, products, environments, processes, and policies. The aim of this paper is to showcase how structured HFE methods can be used to address the gender data gap. We applied the Sociotechnical Systems Design Toolkit which involved using causal loop diagrams and abstraction hierarchy modelling from Cognitive Work Analysis to understand the system in which the issue occurs and key pain points, followed by the application of the Design with Intent Toolkit to generate design ideas. A total of 43 ideas were developed that could be implemented by universities to address the research data gap. The application demonstrates the utility of HFE methods in tackling complex issues and offers an opportunity for the HFE community to reflect upon the importance of gender sensitive research practices and gender equity more broadly., (Copyright © 2021 Elsevier Ltd. All rights reserved.)

This state of the science review brings together the disparate literature of effective strategies for enhancing and accelerating team performance. The review evaluates and synthesises models and proposes recommended avenues for future research. The two major models of the Input-Mediator-Output-Input (IMOI) framework and the Big Five dimensions of teamwork were reviewed and both will need significant development for application to future teams comprising non-human agents. Research suggests that a multi-method approach is appropriate for team measurements, such as the integration of methods from self-report, observer ratings, event-based measurement and automated recordings. Simulations are recommended as the most effective team-based training interventions. The impact of new technology and autonomous agents is discussed with respect to the changing nature of teamwork. In particular, whether existing teamwork models and measures are suitable to support the design, operation and evaluation of human-nonhuman teams of the future. Practitioner summary: This review recommends a multi-method approach to the measurement and evaluation of teamwork. Team models will need to be adapted to describe interaction with non-human agents, which is what the future is most likely to hold. The most effective team training interventions use simulation-based approaches.

Ecological Interface Design (EID) is a framework for developing dynamic interfaces that support operators to understand and take appropriate actions within highly-complex systems. This two-part study involved the development and evaluation of a novel EID-based static aviation risk management display. A within-subjects survey-based experiment employed measures of decision accuracy, situation awareness, user workload, usability, and user perceptions. Results from 23 participants showed that when compared to a risk interface utilised by a large aviation company, the EID display achieved higher usability and lower workload ratings with large effect sizes, with no differences in decision accuracy and situation awareness. The findings provide evidence that the EID framework can improve upon static traditional displays. Research contributions also include a novel model of an aviation ground operations system and an example application of EID to the development of a static display. Further research is necessary to identify the extent of the applications and benefits to static displays., (Copyright © 2021 Elsevier Ltd. All rights reserved.)

A large component of Neville Stanton's work has focused on situation awareness in domains such as defence, transport, and process control. A significant contribution has been to initiate a shift from considering individual human operator situation awareness to considering the situation awareness of human and non-human teams, organisations, and even sociotechnical systems. Though controversial when introduced, the distributed situation awareness model has become increasingly relevant for modern day systems and problems. In this article we reflect on Stanton's contribution and point to a pressing need to consider a. The situation awareness of advanced technologies, and b. situation awareness at a sociotechnical system, societal and even global level. This is demonstrated via discussion on two contemporaneous issues: automated vehicles and the COVID-19 pandemic. It is concluded that, given advances such as artificial intelligence, the increased connectedness of society, emerging issues such as disinformation, and an increasing set of global threats, Stanton's distributed situation awareness model and associated analysis framework provide a useful toolkit for future Human Factors and Ergonomics applications., (Copyright © 2021 Elsevier Ltd. All rights reserved.)

Purpose: The broad aim of sport-science research is to enhance the performance of coaches and athletes. Despite decades of such research, it is well documented that sport-science research lacks empirical evidence, and critics have questioned its scientific methods. Moreover, many have pointed to a research-practice gap, whereby the work undertaken by researchers is not readily applied by practitioners. The aim of this study was to use a systems thinking analysis method, causal loop diagrams, to understand the systemic issues that interact to influence the quality of sport-science research., Methods: A group model-building process was utilized to develop the causal loop diagram based on data obtained from relevant peer-reviewed literature and subject-matter experts., Results: The findings demonstrate the panoply of systemic influences associated with sport-science research, including the existence of silos, a focus on quantitative research, archaic practices, and an academic system that is incongruous with what it actually purports to achieve., Conclusions: The emergent outcome of the interacting components is the creation of an underperforming sport-science research system, as indicated by a lack of ecological validity, translation to practice, and, ultimately, a research-practice gap.

This paper reviews the key perspectives on human error and analyses the core theories and methods developed and applied over the last 60 years. These theories and methods have sought to improve our understanding of what human error is, and how and why it occurs, to facilitate the prediction of errors and use these insights to support safer work and societal systems. Yet, while this area of Ergonomics and Human Factors (EHF) has been influential and long-standing, the benefits of the 'human error approach' to understanding accidents and optimising system performance have been questioned. This state of science review analyses the construct of human error within EHF. It then discusses the key conceptual difficulties the construct faces in an era of systems EHF. Finally, a way forward is proposed to prompt further discussion within the EHF community. Practitioner statement This state-of-science review discusses the evolution of perspectives on human error as well as trends in the theories and methods applied to understand, prevent and mitigate error. It concludes that, although a useful contribution has been made, we must move beyond a focus on an individual error to systems failure to understand and optimise whole systems.

Communication failure within health care teams is a major cause of patient harm across health care settings. Factors which contribute to communication failure include actual or perceived 'power'. Whilst a great deal of ergonomics research has focussed on teamwork in health care, the role of power in relation to measurable patient safety and performance outcomes remains relatively unknown. This article presents the findings from a review of the literature on power within multidisciplinary health care team settings. Following a systematic literature search, nineteen studies were evaluated in terms of research design, methods and analyses across the included studies. The main impacts resulting from power imbalances include negative effects on team collaboration, decision-making, communication and overall performance. Wider patient safety research, and more specifically the ergonomics discipline, is encouraged to address the complex interplay between power and teamwork in the health care sector. Practitioner Statement: We conducted a review of studies focussed on the influence of power on teamwork in health care. The findings show that power can have negative impacts on collaboration, decision-making, communication, and team performance. We conclude that power represents an important area for ergonomics, both in health care and other settings. Abbreviations: CRM: crew resource management; TEM: threat and error management; SNA: social network analysis; EAST: event analysis of systemic teamwork.

The coronavirus disease 2019 (COVID-19) pandemic has had a dramatic impact on the way in which the community interacts within public spaces. Consequently, the design of these urban environments requires new approaches. It is our view that Human Factors and Ergonomics approaches can be used to provide these insights. This article explores the opportunities for making public spaces safer and more accessible for community use under pandemic conditions. The study utilizes a sociotechnical systems model of an archetype public space, developed pre-COVID-19, to explore the infrastructure and activities that are impacted by the introduction of the virus to the public space system. The aim was to identify those elements of the system that are completely unavailable under pandemic conditions, those elements that become limited in use, and those which remained unaffected by the presence of the virus. The findings show that under pandemic conditions pre-COVID-19 public spaces were surprisingly resilient with proportionally few elements within the model completely unavailable. They also demonstrate that overall, the public spaces system, while still operating, is significantly constrained in achieving and optimizing community and individual health and well-being. The insertion of five (5) urban design interventions within the system model presented unique insights into the possibilities for optimizing adaptive capacity. These interventions revealed design opportunities across several levels of the systems model. Such insights are argued to assist in not only re-establishing community access under pandemic conditions but also more inclusive access to a broader range of the community under all conditions., (© 2021 Wiley Periodicals LLC.)

The quest to explain and understand the cause of accidents is both ever-present and ongoing amongst the safety science community. In an attempt to advance the theory and science of accident causation, researchers have recently formalised a set of '15 systems thinking tenets' that cover the conditions and characteristics of work systems that are believed to contribute to the cause of accidents. The purpose of this study was to attempt to identify the systems thinking tenets across a range of different systems and accidents using the Accident Mapping (AcciMap) method. The findings suggest that the tenets can be attributed to play a role in accident causation, however as a result of this process, the capability of AcciMap has been brought into question. Implications and directions for future research are described. Practitioner Summary : This study is an extension of previous work that suggested there was a need to test for the 'systems thinking tenets of accident causation' in a multi-incident dataset. We used AcciMap to evaluate whether it has the capability to support ongoing accident analysis activities in ergonomics research.

Following strict "lockdown" restrictions designed to control the spread of the COVID-19 virus, many jurisdictions are now engaged in a process of easing restrictions in an attempt to stimulate economic and social activity while continuing to suppress virus transmission. This is challenging and complex, and in several regions, new outbreaks have emerged. We argue that systems Human Factors and Ergonomics methods can assist in understanding and optimizing the return from lockdown. To demonstrate, we used work domain analysis to develop an abstraction hierarchy model of a generic "return from lockdown restrictions" system. The model was assessed to identify (a) issues preventing a successful return from lockdown; and (b) leverage points that could be exploited to optimize future processes. The findings show that the aim of continuing to suppress virus transmission conflicts with the aims of returning to pre-virus economic and social activity levels. As a result, many functions act against each other, ensuring that the system cannot optimally achieve all three of its primary aims. Potential leverage points include modifying the goals and rules of the system and enhancing communications and feedback. Specifically, it is argued that moderating economic aims and modifying how social and community activities are undertaken will result in longer term suppression of the virus., (© 2021 Wiley Periodicals LLC.)

Introduction: This article presents a detailed systems analysis of injury incidents from 35 Australian led outdoor activity organisations between 2014 to 2017., Method: Injury incident reports were collected using a specific led outdoor activity incident reporting system known as UPLOADS (Understanding and Preventing Led Outdoor Accidents Data System)., Results: In total, 1367 people sustained injuries from across 20 different activities, with an injury rate of 1.9 injured people per 1000 participants over the three-year period. A total of 2234 contributory factors from multiple levels of the led outdoor activity system were identified from the incident reports, and 361 relationships were identified between contributory factors., Discussion: This systems analysis of injury incidents demonstrates that it is not only factors within the immediate context of the incident ( Participants, Environment, Equipment ) but factors from across multiple systemic levels that contributes to injury incidents ( Schools, Parents, Activity centre management ). Prevention efforts should focus on addressing the whole network of contributing factors and not only the prominent factors at the lower system levels within the immediate context of the injury incident occurrences., Competing Interests: Competing interests: None declared., (© Author(s) (or their employer(s)) 2021. No commercial re-use. See rights and permissions. Published by BMJ.)

There is increasing interest in applying systems Human Factors and Ergonomics (HFE) methods in sport. Risk assessment (RA) methods can be used identify risks which may impact the performance of individual athletes, teams, and overall sports systems; however, they have not yet been tested in sport. This study sets out to apply and compare three systems thinking-based RA methods in the context of elite sports performance and report on the frequency and types of the risks identified. The Systems-Theoretic Process Analysis (STPA) method, the Event Analysis of Systemic Teamwork Broken Links (EAST-BL) method, and the Networked Hazard Analysis and Risk Management System (Net-HARMS) method were applied to elite women's road cycling to identify all the credible risks that could degrade optimal team performance. The findings demonstrate that all three methods appear to provide useful results in a context other than safety, and that multiple risks threatening the performance of the cycling team were identified. Whilst the frequency and types of risks differed across the methods applied, there are additional theoretical, methodological, and practical implications to be considered prior to the selection and use of systems thinking-based RA approaches. Recommendations and directions for future HFE and sports science research are discussed., (Copyright © 2020 Elsevier Ltd. All rights reserved.)

Determining the connectivity of team members in sport provides important information on team functioning. In soccer, teams that are highly connected via passing have been shown to be more successful compared to teams less connected via passing. In addition to passing connectivity, players are connected with each other via intra-team communication (ITC) through verbal instruction, and nonverbal cues. Despite ITC being a known component of effective teamwork to enhance strategy, efficiency, motivation and concentration, ITC of individual playing positions has not previously been measured during soccer games, nor has it been associated with passing connections in a performance context. In this study, the received ITC that was perceived to be beneficial to performance during 22 competitive professional soccer matches was measured, in conjunction with the passing connections between team members. In total, 526 ITC ratings were collected and analysed, and a total of 7,693 passes were analysed. From the ITC and passing measures, a player connectivity index (PCI) representing the coupling of ITC and passing, was developed to determine the overall connectivity of the individual playing positions. Social network analysis (SNA) centrality metrics were used to determine the connectivity of the playing positions. There were significant (p < .05) main effects between playing positions for beneficial ITC, passing, and the PCI for centrality metrics, indicating that different playing positions interact with other team members differently. Pairwise comparisons indicated significant differences between individual playing positions for ITC, passing and the PCI. The two central defenders and the two central defensive midfielders had the highest mean values for ITC, passing, and the PCI compared to the other playing positions. The current findings suggest that central defenders and central defensive midfielders are positioned tactically to be highly involved in the build-up of passing moves, and to deliver beneficial task related information to team members. These findings have implications for performance analysis, coaches, and for talent identification., (© 2021 Scott McLean, Paul M Salmon, Adam D Gorman, Karl Dodd, Colin Solomon, published by Sciendo.)

The suspension of major sporting competitions due to the global COVID-19 pandemic had a substantial negative impact on the sporting industry. As such, a successful and sustainable return to sport will require extensive modifications to the current operations of sporting organizations. In this article we argue that methods from the realm of sociotechnical systems (STS) theory are highly suited for this purpose. The aim of the study was to use such methods to develop a model of an Australian Football League (AFL) club's football department. The intention was to identify potential modifications to the club's operations to support a return to competition following the COVID-19 crisis. Subject Matter Experts from an AFL club participated in three online workshops to develop Work Domain Analysis and Social Organization and Cooperation Analysis models. The results demonstrated the inherent complexity of an AFL football department via numerous interacting values, functions and processes influencing the goals of the system. Conflicts within the system were captured via the modeling and included pursing goals that may not fully reflect the state of the system, a lack of formal assessment of core values, overlapping functions and objects, and an overemphasis on specialized roles. The current analysis has highlighted potential areas for modification in the football department, and sports performance departments in general., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2021 McLean, Rath, Lethlean, Hornsby, Gallagher, Anderson and Salmon.)

Darknet marketplaces have emerged as a facilitator of identity crime and trading. This study aimed to (1) understand the entities and control and feedback mechanisms that influence identity crime prevention and occurrence on the darknet in the Australian system and to (2) comprehensively identify the implications of control failures across all system levels. The Systems-Theoretic Accident Model and Processes (STAMP) was used to develop an identity crime control structure in consultation with subject matter experts and then the Systems-Theoretic Process Analysis (STPA) was applied. The STPA identified 310 risk states, resulting from control failures and which were associated with the range of agencies, organisations, and individuals present across system levels. As darknet marketplaces rapidly evolve, alignment between these entities is necessary to enable agile system responses. STAMP and STPA have promise in understanding the potential for intervention across all system levels in preventing societal issues such as identity crime., (Copyright © 2020 Elsevier Ltd. All rights reserved.)

Crashes at intersections represent an important road safety problem. Interactions between different road user types, such as between vehicles and vulnerable road users, are a particular concern. It has been suggested driver-centric road design plays a role in crashes. A multi-road user evaluation of three novel intersection designs is described. The designs were generated using the Cognitive Work Analysis Design Toolkit, underpinned by sociotechnical systems theory. The desktop evaluation involved drivers, motorcyclists, cyclists and pedestrians rating the design concepts against alignment with design goals, sociotechnical systems theory and usability, and providing feedback on the positive and negative aspects. Two concepts received more positive ratings and feedback in comparison to a concept that provided more user autonomy. The evaluation results also highlight clear differences in needs across road user groups. The design and evaluation process demonstrates how sociotechnical systems values and principles can be applied in the design of public spaces. Practitioner Summary: This study involved a participatory evaluation of novel road intersection designs, based on sociotechnical systems theory. The results identified important differences in needs and preferences across road user groups and demonstrate the value of sociotechnical systems theory and user participation in road transport design and evaluation processes. Abbreviations: CWA-DT: cognitive work analysis design toolkit; WDA: work domain analysis; SUS: system usability scale.

System dynamics is a computational modelling method that is used to understand the dynamic interactions influencing behaviour in complex systems. In this article we argue that the method provides a useful tool for ergonomists wishing to model the behaviour of complex systems. We present a system dynamics model that simulates the behaviour of a drink driving-related trauma system and explore the potential impact of different road safety policy interventions. The model was simulated over thirty-year periods with different policy interventions. The findings suggest that the greatest reduction in drink driving-related trauma can be achieved by policies that integrate standard road safety interventions (e.g. education and enforcement) with interventions designed to address the societal issue of alcohol misuse and addiction. In closing we discuss the potential use of system dynamics modelling in future ergonomics applications and outline its strengths and weaknesses in relation to existing systems ergonomics methods. Practitioner Summary: The outputs of systems ergonomics methods are typically static and cannot simulate behaviour over time. We propose system dynamics as a useful approach for modelling the behaviour of complex systems. Applied to drink driving-related road trauma, the method was able to dynamically model the potential impacts of different policy interventions.

How humans will adapt and respond to the introduction of autonomous vehicles (AVs) is uncertain. This study used an agent-based model to explore how AVs, human-operated vehicles, and cyclists might interact based on the introduction of flawlessly performing AVs. Under two separate experimental conditions, results of experiment 1 showed that, despite no conflicts occurring between cyclists and AVs, modelled conflicts among human-operated cars and cyclists increased with the introduction of AVs due to cyclists' adjusted expectations of the behaviour and capability of human-operated and autonomous cars. Similarly, when human-operated cars were replaced with AVs over time in experiment 2, cyclist conflict rates did not follow a linear reduction consistent with the replacement rate but decreased more slowly in the early stages of replacement before 50% substitution. It is concluded that, although flawlessly performing AVs might reduce total conflicts, the introduction of AVs into a transport system where humans adjust to the behaviour and risk presented by AVs could create new sources of error that offset some of AVs assumed safety benefits. Practitioner summary: Ergonomics is an applied science that studies interactions between humans and other elements of a system, including non-human agents. Agent-Based Modelling (ABM) provides an approach for exploring dynamic and emergent interactions between agents. In this article, we demonstrate ABM through an analysis of how cyclists and pedestrians might interact with Autonomous Vehicles (AVs) in future road transport systems. Abbreviations: ABM: agent-based model; AV: autonomous vehicle; ODD; overview, design concepts and details; RW: rescorla-wagner.

Introduction: Talent identification and development programmes that retain and develop athletes are integral to the sporting success of National Governing Bodies in football. Currently, player attributes are studied in isolation without considering the complexity of interacting components of football performance. The current study applied a systems analysis framework to describe, in a structured and systematic way, the attributes for specific playing positions in football match-play. Methods : Eight high-level football coaches were interviewed. Models of the interacting attributes were developed for each position using Work Domain Analysis (WDA). Results : Six WDA models detail the attributes associated with each playing position. The models identified purposes of playing positions (restrict opposition actions, organise and coordinate, building up of offence, goal scoring and stretch opposition), performance-related measures and the functions required to achieve the playing position purposes (game play, psychological functions, time and space and player actions). Critically, the relationships between the purposes, measures, functions, processes, and objects are described in the models., Discussion: The WDA models describe the interacting attributes of different playing positions in football match-play. The findings demonstrate football performance is complex, consisting of multiple interacting and dynamic components. Implications to support coaches in talent identification and development are discussed.

The introduction of fully autonomous vehicles is approaching. This warrants a re-consideration of road crash liability, given drivers will have diminished control. This study, underpinned by attribution theory, investigated blame attribution to different road transport system actors following crashes involving manually driven, semi-autonomous and fully autonomous vehicles. It also examined whether outcome severity alters blame ratings. 396 participants attributed blame to five actors (vehicle driver/user, pedestrian, vehicle, manufacturer, government) in vehicle-pedestrian crash scenarios. Different and unique patterns of blame were found across actors, according to the three vehicle types. In crashes involving fully autonomous vehicles, vehicle users received low blame, while vehicle manufacturers and government were highly blamed. There was no difference in the level of blame attributed between high and low severity crashes regarding vehicle type. However, the government received more blame in high severity crashes. The findings have implications for policy and legislation surrounding crash liability. Practitioner summary: Public views relating to blame and liability in transport accidents is a vital consideration for the introduction of new technologies such as autonomous vehicles. This study demonstrates how a systems ergonomics framework can assist to identify the implications of changing public opinion on blame for future road transport systems. Abbreviation: ANOVA: analysis of variance; DAT: defensive attribution theory; IV: independent variable.

Treatment access remains low for people with eating disorders. In addressing the complexity inherent in this challenge, this article introduces systems thinking and argues that it could provide new insights. Systems thinking views behavior as an emergent property of a system and considers the relationships between technical, organizational, and social components. Several methods used in safety science incorporate this thinking. For example, AcciMap draws focus to the influence of decisions and actions made across hierarchical levels of a system, including those by government, regulatory bodies, management, services, and individuals. By examining the findings of the existing literature on barriers to eating disorder treatment access according to these levels, it is evident that most identified barriers relate to individuals and that further research is needed to consider the influence of high-level stakeholders. Research using systems thinking should consider the causal networks of influence from government, regulatory, and organizational decisions and actions through to outcomes for clinicians and individuals. The understanding of how barriers operate within specific healthcare systems also warrants investigation. Systems thinking is yet to be formally applied in the area of eating disorders and thus represents an opportunity to inform the development and implementation of more effective, system wide interventions., (© 2019 Wiley Periodicals, Inc.)

There is increasing interest in the adoption of a complex systems thinking approach when attempting to understand and optimize sports performance. Despite this, few studies have attempted to model elite sports organizations. The aim of this study was to use methods from the Cognitive Work Analysis (CWA) framework to develop a model of an elite netball organization and identify wider organizational functions and constraints influencing performance. Two phases of CWA were used: (i) Work Domain Analysis (WDA); and, (ii) Social Organization and Co-operation Analysis (SOCA). A WDA model of the elite netball organization was developed via subject matter expert (SME) workshops, and a SOCA was undertaken to identify the different functions, roles, and responsibilities of key actors within the organization. The findings identify various factors that influence performance. Functions that appear to provide a competitive edge are discussed, including a strong club ethos, a shared responsibility for performance, and a focus on player and staff health and well-being. Factors that potentially have a negative impact on performance include organizational priorities not related to playing netball, and additional coach and athlete roles beyond coaching, training, and playing. The implications for understanding and optimizing elite sports organizations are discussed., (Copyright © 2019 Hulme, McLean, Read, Dallat, Bedford and Salmon.)

The effective management of sports-related concussion is an on-going problem in amateur sport due to a number of systemic issues. These factors have often been studied in isolation with minimal consideration for the interactions between them, or the overall system in which they occur. The aim of this research was to model the actors, controls, and feedback mechanisms influencing the management of concussion in community rugby union using the Systems-Theoretic Accident Model and Processes (STAMP) method. Findings show that there are currently many inadequate controls, that are directly and indirectly impacting effective concussion management. The practical implications of these findings are discussed (e.g. improved guideline education, mandatory medical presence, rule amendments). Additionally, the model provides a sound framework similar team sports can use to inform research into injury management and prevention (e.g. rugby league, hockey, AFL). Practitioner Summary: Research shows that concussion management in regional sport is inconsistent due to contextual limitations. Systems-Theoretic Accident Model and Processes was applied to identify the systemic factors currently influencing concussion management practices in community sport. Findings show inadequate controls precipitate concussion management gaps. Practical implications of the findings are discussed.

Background: Systems thinking, a fundamental approach for understanding complexity, is beginning to gain traction in sports science. Systems archetypes (SAs) describe common recurring patterns of system behaviors and have been used extensively in other domains to explain the system wide influences on behavior. SAs look at the deeper levels of systemic structure by identifying what creates system behaviors, which supports the development of interventions to identify and resolve problem sources. Methods: Four commonly used SAs were used to explain the dynamics underpinning recurring issues for coaching in football: (1) Fixes that fail, (2) Shifting the burden, (3) Drifting goals, and (4) Success to the successful. The SAs models were built, refined and validated by seven subject matter experts (SMEs) including experienced football researchers, systems thinking experts, an international football coach, a skill acquisition specialist, and an experienced exercise scientist. Results: The findings show that the SAs fit well in the football coaching context, providing further evidence that a complex system thinking approach is required when considering football performance and its optimization. The developed SAs identify the factors that play a role in recurring issues in football coaching and highlight the systemic structures that contribute to the issues. The developed SAs identify the appropriate leverage points in the system where sustainable change can be made to improve coaching practice and subsequent performance of players. Discussion: A common theme emerging across the analyses was that systemic problems often arise in football when quick fixes are attempted. Whereas, improvements to system behavior usually require a delay after the implementation of the appropriate corrective action. The SAs developed in the current study also provide practical templates of common problems in football that can be used to prompt discussions around how to avoid ineffective interventions and instead make sustainable improvements across multiple aspects of football performance., (Copyright © 2019 McLean, Read, Hulme, Dodd, Gorman, Solomon and Salmon.)

Introduction: As sports systems become increasingly more complex, competitive, and technology-centric, there is a greater need for systems ergonomics methods to consider the performance, health, and safety of athletes in context with the wider settings in which they operate. Therefore, the purpose of this systematic review was to identify and critically evaluate studies which have applied a systems ergonomics research approach in the context of sports performance and injury management., Material and Methods: Five databases (PubMed, Scopus, ScienceDirect, Web of Science, and SPORTDiscus) were searched for the dates 01 January 1990 to 01 August 2017, inclusive, for original peer-reviewed journal articles and conference papers. Reported analyses were underpinned by a recognised systems ergonomics method, and study aims were related to the optimisation of sports performance (e.g. communication, playing style, technique, tactics, or equipment), and/or the management of sports injury (i.e. identification, prevention, or treatment)., Results: A total of seven articles were identified. Two articles were focussed on understanding and optimising sports performance, whereas five examined sports injury management. The methods used were the Event Analysis of Systemic Teamwork, Cognitive Work Analysis (the Work Domain Analysis Abstraction Hierarchy), Rasmussen's Risk Management Framework, and the Systems Theoretic Accident Model and Processes method. The individual sport application was distance running, whereas the team sports contexts examined were cycling, football, Australian Football League, and rugby union., Conclusions: The included systems ergonomics applications were highly flexible, covering both amateur and elite sports contexts. The studies were rated as valuable, providing descriptions of injury controls and causation, the factors influencing injury management, the allocation of responsibilities for injury prevention, as well as the factors and their interactions underpinning sports performance. Implications and future directions for research are described., (Copyright © 2018 Elsevier Ltd. All rights reserved.)

Like most work systems, the domain of adventure activities has seen a series of serious incidents and subsequent calls to improve regulation. Safety regulation systems aim to promote safety and reduce accidents. However, there is scant evidence they have led to improved safety outcomes. In fact there is some evidence that the poor integration of regulatory system components has led to adverse safety outcomes in some contexts. Despite this, there is an absence of methods for evaluating regulatory and compliance systems. This article argues that sociotechnical systems theory and methods provide a suitable framework for evaluating regulatory systems. This is demonstrated through an analysis of a recently introduced set of adventure activity regulations. Work Domain Analysis (WDA) was used to describe the regulatory system in terms of its functional purposes, values and priority measures, purpose-related functions, object-related processes and cognitive objects. This allowed judgement to be made on the nature of the new regulatory system and on the constraints that may impact its efficacy following implementation. Importantly, the analysis suggests that the new system's functional purpose of ensuring safe activities is not fully supported in terms of the functions and objects available to fulfil them. Potential improvements to the design of the system are discussed along with the implications for regulatory system design and evaluation across the safety critical domains generally., (Copyright © 2017 Elsevier Ltd. All rights reserved.)

Background: Injury and incident (near miss) prevention is heavily dependent upon robust and high-quality data systems. Evaluations of surveillance systems designed to report factors associated with incidents and injuries are essential to understand their value, as well as to improve their performance and efficiency. Despite, this there have been few such evaluations published in the peer-review literature., Methods: The attitudes and experiences of industry representatives who used one of two variants of an incident and injury surveillance system to collect injury and incident data for the led outdoor activity setting were obtained through an online self-report survey following a 12-month trial. Survey respondents were 18 representatives of 33 organisations who were users of a comprehensive incident reporting and surveillance system - the Understanding and Preventing Led Outdoor Accidents Data System Software Tool (UPLOADS-ST) - and six out of 11 users of a modified system (UPLOADS-Lite). The survey collected information on user experiences in relation to system training, accessibility, ease of use, security, feedback and perceived value to the sector of collating and reporting data across organisations., Findings: Only four UPLOADS-ST responding users found the system easy to use and just three considered entering incident reports to be easy. However, many considered the training on reporting incidents to be sufficient and that the incident reports contained relevant details. Fewer than half of respondents (seven for UPLOADS-ST, three for UPLOADS-Lite) believed entering data was a good use of staff time and resources. Nonetheless, a majority of respondents (seven for UPLOADS-ST, five for UPLOADS-Lite) found the reporting format easy to read and felt the information provided was useful for their organisation., Conclusions: Usability barriers to incident reporting were identified, particularly for UPLOADS-ST, including time constraints and user friendliness. The majority of users believed aggregating and reporting incident and injury data across organisations would be of value in making the led outdoor activity sector safer. Improving the utility of the surveillance systems will assist in ensuring their sustainability in the led outdoor activity sector., Competing Interests: Competing interestsThe authors declare that they have no competing interests.

Darknet markets provide an anonymous, online platform for users to trade illicit drugs, fraudulent identity data, and other commodities. Although law enforcement agencies have been successful in seising many markets, the Darknet is an agile and dynamic environment and market activities often persist and emerge in a new form. Given this constantly changing environment, new ways of disrupting darknet markets are required. This study used Event Analysis of Systemic Teamwork (EAST) to analyse market activity and understand vulnerabilities to disruption. This involved using the EAST broken-links approach to assess the effects of compromising the transmission of information between tasks and between agents. The analysis identified critical vulnerabilities in the system, which included information involved in registering, depositing funds, communicating listing details to buyers, and communicating dispute resolution messages. This study indicates that systems ergonomics methods-in particular, EAST-can provide insight into system vulnerabilities that might be targeted for disruption. Practitioner summary This study provides a conceptualisation of the processes, people, structures, and information involved in the buying and selling of goods on a darknet market. Law enforcement agencies may use broken-links analyses to systematically consider the effects of their interventions.

Work domain analysis (WDA) is used to model the functional structure of sociotechnical systems (STS) through the abstraction hierarchy (AH). By identifying objects, processes, functions and measures that support system purposes, WDA reveals constraints within the system. Traditionally, the AH describes system elements at the lowest level of abstraction as physical objects. Multiple analyses of complex systems reveal that many include objects that exist only at a conceptual level. This paper argues that, by extending the AH to include cognitive objects, the analytical power of WDA is extended, and novel areas of application are enabled. Three case studies are used to demonstrate the role that cognitive objects play within STS. It is concluded that cognitive objects are a valid construct that offer a significant enhancement of WDA and enable its application to some of the world's most pressing problems. Implications for future applications of WDA and the AH are discussed. Practitioner summary: Some sociotechnical systems include memes as part of their functional structure. Three case studies were used to evaluate the utility of introducing cognitive objects alongside physical ones in work domain analysis, the first phase of cognitive work analysis. Including cognitive objects increases the scope and accuracy of work domain analysis.

Traffic sign comprehension is significantly affected by their compliance with ergonomics design principles. Despite the UN Convention, designs vary among countries. The goal of this study was to establish theoretical and methodological bases for evaluating the design of conventional and alternative signs. Thirty-one conventional signs and 1-3 alternatives for each conventional sign were evaluated for their compliance with three ergonomics guidelines for sign design: physical and conceptual compatibility, familiarity and standardisation. Twenty-seven human factors and ergonomics experts from 10 countries evaluated the signs relative to their compliance with the guidelines. Analysis of variance across alternatives revealed that for 19 of the 31 signs, an alternative design received a significantly higher rating in its ergonomics design than the conventional sign with the same meaning. We also found a very high correlation between the experts' ratings and comprehension from previous studies. In conclusion, many countries use signs for which better alternative designs exist, and therefore UN Convention signs should be re-examined, and ergonomics experts evaluation can serve as a good surrogate for road users' comprehension surveys. Practitioner summary: This study presents theoretical and methodological bases for evaluating the design of UN Conventional and alternative traffic signs. Human factors and ergonomics experts evaluated 31 conventional and 68 alternative road signs, based on ergonomics principles for sign design. Results indicated the need to re-examine poorly designed UN Convention signs.

In complexity science, the many models thinking philosophy argues for a multi-method approach to complex problems. This article investigates whether the use of multiple systems ergonomics methods to examine the same problem is useful, or whether using different approaches creates incompatible analyses. Five systems ergonomics analyses of road trauma are examined and their key insights extracted. The extent to which these insights are compatible with one another and can be integrated when attempting to reduce road trauma is assessed. The findings indicate that applying several systems ergonomics methods to the same problem is useful, as multiple insights are developed and deficiencies in one approach are countered by the others. Importantly, the case study demonstrates that the insights gained are compatible and support the development of holistic systems thinking-based interventions. In conclusion it is recommended that a many systems ergonomics model thinking approach be adopted by ergonomists working in complex problem spaces. Practitioner Summary: Many model thinking uses multiple methods to understand complex problems. We explore whether this is beneficial in systems ergonomics. Five models of road trauma, developed using five systems ergonomics methods, are examined. The findings demonstrate that a many model systems ergonomics approach produces a diverse but complimentary set of insights.

Objectives: There have been recent calls for the application of the complex systems approach in sports injury research. However, beyond theoretical description and static models of complexity, little progress has been made towards formalising this approach in way that is practical to sports injury scientists and clinicians. Therefore, our objective was to use a computational modelling method and develop a dynamic simulation in sports injury research., Methods: Agent-based modelling (ABM) was used to model the occurrence of sports injury in a synthetic athlete population. The ABM was developed based on sports injury causal frameworks and was applied in the context of distance running-related injury (RRI). Using the acute:chronic workload ratio (ACWR), we simulated the dynamic relationship between changes in weekly running distance and RRI through the manipulation of various 'athlete management tools'., Results: The findings confirmed that building weekly running distances over time, even within the reported ACWR 'sweet spot', will eventually result in RRI as athletes reach and surpass their individual physical workload limits. Introducing training-related error into the simulation and the modelling of a 'hard ceiling' dynamic resulted in a higher RRI incidence proportion across the population at higher absolute workloads., Conclusions: The presented simulation offers a practical starting point to further apply more sophisticated computational models that can account for the complex nature of sports injury aetiology. Alongside traditional forms of scientific inquiry, the use of ABM and other simulation-based techniques could be considered as a complementary and alternative methodological approach in sports injury research., Competing Interests: Competing interests: None declared., (© Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2019. All rights reserved. No commercial use is permitted unless otherwise expressly granted.)

Netball is a newly professional women's sport, as such there has been little research conducted investigating performance analysis (PA) in elite netball. The aim of this study was to develop a model of the elite netball performance system to identify the complex relationships among key performance indicators. Eleven elite subject matter experts (SMEs) participated in workshops to produce a systems model of the netball match performance. The model was developed using the work domain analysis (WDA) method. A model of the netball match performance system was produced showing the interrelated objects, processes, functions, values, and purposes involved in elite level netball matches. The model identified the components of elite level netball performance and the interactions and relationships between them. The output of this research has identified novel PA measures including passing and possession measures, measures of cognitive performance, and measures related to physical activity. Netball is a complex sport, involving multiple dynamic and interrelated components. Consequently, there is an opportunity to develop holistic PA measures that focus on interacting components, as opposed to components in isolation.

The so-called 'fatal five' behaviours (drink and drug driving, distraction and inattention, speeding, fatigue, and failure to wear a seat belt) are known to be the major behavioural contributory factors to road trauma. However, little is known about the factors that lead to drivers engaging in each behaviour. This article presents the findings from a study which collected and analysed data on the factors that lead to drivers engaging in each behaviour. The study involved a survey of drivers' perceptions of the causes of each behaviour and a subject matter expert workshop to gain the views of road safety experts. The results were mapped onto a systems ergonomics model of the road transport system in Queensland, Australia, to show where in the system the factors reside. In addition to well-known factors relating to drivers' knowledge, experience and personality, additional factors at the higher levels of the road transport system related to road safety policy, transport system design, road rules and regulations, and societal issues were identified. It is concluded that the fatal five behaviours have a web of interacting contributory factors underpinning them and are systems problems rather than driver-centric problems. The implications for road safety interventions are discussed., (Copyright © 2018 Elsevier Ltd. All rights reserved.)

A driver text messaging in the vicinity of a rail level crossing represents the merging of a high-risk, high-workload driving environment with a highly distracting secondary task. In this simulator study, we examined how texting impacts driver behaviour on approach to actively controlled urban rail level crossings. Twenty-eight participants drove a series of simulated urban routes containing rail level crossings, while sending text messages and while driving without performing a secondary task. At half of the crossings, drivers were required to respond to the crossing warnings as a train approached. Results revealed that texting on approach to rail level crossings had a detrimental impact on a range of driver behaviour measures. Specifically, texting more than doubled the amount of time spent with eyes off the forward roadway, resulting in drivers spending more than half of their approach time to rail level crossings looking away from the road. This lack of visual attention to the roadway was associated with a range of decrements in driving that may be indicative of a loss of situation awareness, including increased brake reaction time to the crossing warnings and a reduction in lateral position control. The findings have safety implications, not only for urban level crossings, but also for passive level crossings where no warnings are present to re-orient the distracted driver's attention toward an approaching train., (Copyright © 2018 Elsevier Ltd. All rights reserved.)

The safety of vulnerable road users, including pedestrians, is an important issue worldwide. In line with the shift towards systems thinking in transport safety, the aim of this study was to compare the normal performance of pedestrians as they navigate the road system with that imagined by road system managers to gain insights into how safety management can be improved for this vulnerable road user group. The Event Analysis of Systemic Teamwork framework was used to compare pedestrian activity 'as imagined' and 'as done' at signalised road intersections and railway level crossings. Data regarding 'activity as imagined' was derived from documentation review, and data on 'activity as done' was derived from a semi-naturalistic study of ten participants. It is concluded that in both environments pedestrians exhibited more diversity and variability than anticipated by system managers. Insights for improving the design of the road environment for pedestrians are provided. Further, it is argued that wider changes to the processes used in the design and management of road systems are needed., (Copyright © 2018 Elsevier Ltd. All rights reserved.)

Intra-team communication plays an important role in team effectiveness in various domains including sport. As such, it is a key consideration when introducing new tools within systems that utilise teams. The difference in intra-team communication of Australian Rules Football (AFL) umpiring teams was studied when umpiring with or without radio communications technology. A cross-sectional observational study was conducted to analyse the verbal communication of seven umpiring teams (20 participants) grouped according to their experience with radio communication. The results identified that radio communication technology increased the frequency and altered the structure of intra-team communication. Examination of the content of the intra-team communication identified impacts on the 'Big Five' teamwork behaviours and associated coordinating mechanisms. Analysis revealed that the communications utilised did not align with the closed-loop form of communication described in the Big Five model. Implications for teamwork models, coaching and training of AFL umpires are discussed. Practitioner Summary: Assessing the impact of technology on performance is of interest to ergonomics practitioners. The impact of radio communications on teamwork is explored in the highly dynamic domain of AFL umpiring. When given radio technology, intra-team communication increased which supported teamwork behaviours, such as backup behaviour and mutual performance monitoring.

Improvisation represents the spontaneous and real-time conception and execution of a novel response to an unanticipated situation. In order to benefit from the positive safety potential of this phenomenon, it is necessary to understand what influences its appropriateness and effectiveness. This study has applied the system-based methodology Impromaps to analysing accounts of improvisation aimed at mitigating adverse safety outcomes. These accounts were obtained from led outdoor activity (LOA) leaders through critical decision method interviews. Influencing factors and interactions have been identified across all system levels. The factors most influential to leaders' ability to improvise are 'Policy, procedures and rules', 'Organisation culture', 'Training', 'Role responsibilities', 'Communication/instruction/demonstration', 'Situation awareness', 'Leader experience', 'Mental simulation', 'Equipment, clothing & PPE' and 'Terrain/physical environment'. To enhance the likelihood of effective, appropriate improvisation, LOA providers are recommended to focus on higher level factors over which they are able to exert greater control. Practitioner Summary: To enhance resilience in safety-critical situations, organisations need to understand what influences appropriate, effective improvisation. To elucidate this, the Impromaps methodology is applied to in-depth interview data. The Impromap affords a graphical depiction of the influencing factors and interactions across the system, providing a basis for the development of interventions.

In the current study, social network analysis (SNA) and notational analysis (NA) methods were applied to examine the goal scoring passing networks (GSPN) for all goals scored at the 2016 European Football Championships. The aim of the study was to determine the GSPN characteristics for the overall tournament, between the group and knock out stages, and for the successful and unsuccessful teams. The study also used degree centrality (DC) metrics as a novel method to determine the relative contributions of the pitch locations involved in the GSPN. To determine changes in GSPN characteristics as a function of changing score line, the analysis considered the match status of the game when goals were scored. There were significant differences for SNA metrics as a function of match status, and for the DC metrics in the comparison of the different pitch locations. There were no differences in the SNA metrics for the GSPN between teams in the group and knock out stages, or between the successful and unsuccessful teams. The results indicate that the GSPN had low values for network density, cohesion, connections, and duration. The networks were direct in terms of pitch zones utilised, where 85% of the GSPN included passes that were played within zones or progressed through the zones towards the goal. SNA and NA metrics were significantly different as a function of changing match status. The current study adds to the previous research on goal scoring in football, and demonstrates a novel method to determine the prominent pitch zones involved in the GSPN. These results have implications for match analysis and the coaching process., (Copyright © 2017 Elsevier B.V. All rights reserved.)

Safety leadership is an important factor in supporting safe performance in the workplace. The present case study examined the role of safety leadership during the Bingham Canyon Mine high-wall failure, a significant mining incident in which no fatalities or injuries were incurred. The Critical Decision Method (CDM) was used in conjunction with a self-reporting approach to examine safety leadership in terms of decisions, behaviours and actions that contributed to the incidents' safe outcome. Mapping the analysis onto Rasmussen's Risk Management Framework (Rasmussen, 1997), the findings demonstrate clear links between safety leadership decisions, and emergent behaviours and actions across the work system. Communication and engagement based decisions featured most prominently, and were linked to different leadership practices across the work system. Further, a core sub-set of CDM decision elements were linked to the open flow and exchange of information across the work system, which was critical to supporting the safe outcome. The findings provide practical implications for the development of safety leadership capability to support safety within the mining industry., (Copyright © 2017 Elsevier Ltd. All rights reserved.)

Introduction: There is a need for an ecological and complex systems approach for better understanding the development and prevention of running-related injury (RRI). In a previous article, we proposed a prototype model of the Australian recreational distance running system which was based on the Systems Theoretic Accident Mapping and Processes (STAMP) method. That model included the influence of political, organisational, managerial, and sociocultural determinants alongside individual-level factors in relation to RRI development. The purpose of this study was to validate that prototype model by drawing on the expertise of both systems thinking and distance running experts., Materials and Methods: This study used a modified Delphi technique involving a series of online surveys (December 2016- March 2017). The initial survey was divided into four sections containing a total of seven questions pertaining to different features associated with the prototype model. Consensus in opinion about the validity of the prototype model was reached when the number of experts who agreed or disagreed with survey statement was ≥75% of the total number of respondents., Results: A total of two Delphi rounds was needed to validate the prototype model. Out of a total of 51 experts who were initially contacted, 50.9% (n = 26) completed the first round of the Delphi, and 92.3% (n = 24) of those in the first round participated in the second. Most of the 24 full participants considered themselves to be a running expert (66.7%), and approximately a third indicated their expertise as a systems thinker (33.3%). After the second round, 91.7% of the experts agreed that the prototype model was a valid description of the Australian distance running system., Conclusion: This is the first study to formally examine the development and prevention of RRI from an ecological and complex systems perspective. The validated model of the Australian distance running system facilitates theoretical advancement in terms of identifying practical system-wide opportunities for the implementation of sustainable RRI prevention interventions. This 'big picture' perspective represents the first step required when thinking about the range of contributory causal factors that affect other system elements, as well as runners' behaviours in relation to RRI risk., (Copyright © 2017 Elsevier Ltd. All rights reserved.)

Many rail level crossings (RLXs) have only passive protection, such as static signs instructing road users to stop, yield, or look for trains. Stop signs have been suggested as a low-cost option to improve safety at passive RLXs, as requiring drivers to stop should encourage safe behaviour. However, field observations have noted high rates of non-compliance at stop-controlled RLXs. To explore this further, we conducted an on-road study to identify factors that influence compliance at stop-controlled RLXs. Twenty-two drivers drove a 30.5km route in rural Australia, encompassing three stop-controlled RLXs. In over half of all cases (59%) drivers stopped completely at the RLX; on 27% of crossings drivers executed a rolling stop, and on 14% of crossings drivers violated the stop controls. Rolling stops were defined as a continuous deceleration to <10km/h, but remaining above 0km/h, before accelerating to >10km/h. Behavioural patterns, including visual checks and decision-making, were similar when comparing drivers who made complete versus rolling stops. Non-compliant drivers did not differ from compliant drivers in approach speeds, but spent less time visually checking for trains. Post-drive interviews revealed some drivers wilfully disregarded the stop sign, whereas others did not notice the stop sign. Those who intentionally violated noted trains were infrequent and suggested sight distance was good enough (even though all crossings had been formally assessed as having inadequate sight distance). Overall the results suggest most drivers exhibit safe behaviour at passive RLXs, but a notable minority disregard or fail to notice signs. Potential avenues for redesigning passive RLXs to improve safety are discussed., (Copyright © 2017 Elsevier Ltd. All rights reserved.)

Broader contextual factors that influence concussion management have tended to be overlooked. To address this, the present study used a sociotechnical systems approach to identify perceived responsibilities and applied strategies for three domains of concussion management (i.e., prevention, identification and treatment). Participants were 118 members of the community rugby union system in Australia (69.2% male). Participants from throughout the rugby system (e.g., players, parents, coaches, club management) were asked open-ended questions about their perceived responsibilities and the strategies they use for concussion management. It was found that (a) proper training, technique correction and education were recurrent prevention themes; (b) the majority of key stakeholders felt that they could consistently identify concussion; however, medical aids (medics) were the only system actors who stated a responsibility to use standardised concussion assessment measures and (c) less than one third of the respondents indicated their involvement in treating concussion. This study identifies specific junctures in the system that prevents effective concussion management strategies. A sociotechnical systems approach improves the understanding of concussion prevention, and management beliefs and behaviours.

Safety leadership is an important factor in supporting safety in high-risk industries. This article contends that applying systems-thinking methods to examine safety leadership can support improved learning from incidents. A case study analysis was undertaken of a large-scale mining landslide incident in which no injuries or fatalities were incurred. A multi-method approach was adopted, in which the Critical Decision Method, Rasmussen's Risk Management Framework and Accimap method were applied to examine the safety leadership decisions and actions which enabled the safe outcome. The approach enabled Rasmussen's predictions regarding safety and performance to be examined in the safety leadership context, with findings demonstrating the distribution of safety leadership across leader and system levels, and the presence of vertical integration as key to supporting the successful safety outcome. In doing so, the findings also demonstrate the usefulness of applying systems-thinking methods to examine and learn from incidents in terms of what 'went right'. The implications, including future research directions, are discussed. Practitioner Summary: This paper presents a case study analysis, in which systems-thinking methods are applied to the examination of safety leadership decisions and actions during a large-scale mining landslide incident. The findings establish safety leadership as a systems phenomenon, and furthermore, demonstrate the usefulness of applying systems-thinking methods to learn from incidents in terms of what 'went right'. Implications, including future research directions, are discussed.

One factor potentially limiting the uptake of Rasmussen's (1997) Accimap method by practitioners is the lack of a contributing factor classification scheme to guide accident analyses. This article evaluates the intra- and inter-rater reliability and criterion-referenced validity of a classification scheme developed to support the use of Accimap by led outdoor activity (LOA) practitioners. The classification scheme has two levels: the system level describes the actors, artefacts and activity context in terms of 14 codes; the descriptor level breaks the system level codes down into 107 specific contributing factors. The study involved 11 LOA practitioners using the scheme on two separate occasions to code a pre-determined list of contributing factors identified from four incident reports. Criterion-referenced validity was assessed by comparing the codes selected by LOA practitioners to those selected by the method creators. Mean intra-rater reliability scores at the system (M = 83.6%) and descriptor (M = 74%) levels were acceptable. Mean inter-rater reliability scores were not consistently acceptable for both coding attempts at the system level (M T1  = 68.8%; M T2  = 73.9%), and were poor at the descriptor level (M T1  = 58.5%; M T2  = 64.1%). Mean criterion referenced validity scores at the system level were acceptable (M T1  = 73.9%; M T2  = 75.3%). However, they were not consistently acceptable at the descriptor level (M T1  = 67.6%; M T2  = 70.8%). Overall, the results indicate that the classification scheme does not currently satisfy reliability and validity requirements, and that further work is required. The implications for the design and development of contributing factors classification schemes are discussed., (Copyright © 2017 Elsevier Ltd. All rights reserved.)