Search

In orthopedic surgery, there is an increasing number of papers about online studies on the reliability of classification systems. Useful classification systems need to be reliable and valid. Measurement of validity can be variable and is prone to observer bias. These online collaboratives derive adequate power to study reliability by having a large group of trained surgeons review a small number of cases instead of the "classic" reliability studies in which a small number of observers evaluate many cases. Large online interobserver studies have advantages (i.e., less than 15 minutes to complete the survey, the ability to randomize, and the ability to study factors associated with reliability, accuracy, or decision-making). This 'handbook' paper gives an overview of current methods for online reliability studies. We discuss the study design, sample size calculation, statistical analyses of results, pitfalls, and limitations of the study design.

Background: Treatment decisions regarding volar base fractures of the middle phalanx depend on whether the proximal interphalangeal (PIP) joint is reduced. Our aim was to study the agreement among hand surgeons in determining whether the PIP joint fractures are subluxated and to study the factors associated with subluxation of these fractures. Methods: In this retrospective chart review, 413 volar base fractures of the middle phalanx were included. Demographic and injury-related factors were gathered from medical records and radiographs. Using a Web-based survey, interobserver agreement was determined among 105 hand surgeons on the assessment of PIP joint subluxation of a series of 26 cases. Using the cohort of 413 fractures, a threshold for percent articular involvement and relative fracture displacement that corresponds with subluxation of the PIP joint was analyzed. Results: We found moderate to substantial agreement between hand surgeons on subluxation (κ = 0.59, P < .0001) and an overall percent agreement of 85%. Percent articular involvement and relative fracture displacement were independently associated with subluxation of the PIP joint ( P < .001). Percent articular involvement of 35% had a specificity of 90% and a negative predicting value (NPV) of 92% for joint subluxation. Relative fracture displacement of 35% had a specificity of 92% and an NPV of 94% for joint subluxation. Conclusions: Surgeons generally agree on whether a PIP joint is subluxated. Percent articular involvement and relative fragment displacement are objective measurements that can help characterize joint stability and assist with decision-making.

Background: Treatment recommendations for trapeziometacarpal (TMC) arthrosis are highly variable from surgeon to surgeon. This study addressed the influence of viewing radiographs on a decision to offer surgery for TMC arthrosis., Methods: In an online survey, 92 hand surgeons viewed clinical scenarios and were asked if they would offer surgery to 30 patients with TMC arthrosis. Forty-two observers were randomly assigned to review clinical information alone and 50 to review clinical information as well as radiographs. The degree of limitation of daily activities, time since diagnosis, prior treatment, pain with grind, crepitation with grind, and metacarpal adduction with metacarpophalangeal hyperextension were randomized for each patient scenario to determine the influence of these factors on offers of surgery. A cross-classified binary logistic multilevel regression analysis identified factors associated with surgeon offer of surgery., Results: Surgeons were more likely to offer surgery when they viewed radiographs (42% vs. 32%, P = 0.01 ). Other factors associated variation in offer of surgery included greater limitation of daily activities, symptoms for a year, prior splint or injection, deformity of the metacarpophalangeal joint. Factors not associated included limb dominance, prominence of the TMC joint, crepitation with the grind test, and pinch and grip strength., Conclusion: Surgeons that view radiographs are more likely to offer surgery to people with TMC arthrosis. urgeons are also more likely to offer surgery when people do not adapt with time and nonoperative treatment. Given the notable influence of surgeon bias, and the potential for surgeon and patient impatience with the adaptation process, methods for increasing patient participation in the decision-making process merit additional attention and study.

Background: Nearly 44% of practicing physicians in the USA report symptoms of burnout. Psychological distress and loss of joy in medicine are associated with malpractice lawsuits and attrition from medical practice and may correlate with the rate of perceived medical errors., Questions/purposes: We sought to answer two questions: (1) What physician factors are associated with the number of perceived medical errors among practicing surgeons in the prior 3 months? (2) What characteristics are associated with symptoms of burnout among practicing surgeons?, Methods: We created a cross-sectional survey and invited members of the Science of Variation Group to respond between December 2018 and January 2019. Participating surgeons completed the Abbreviated Maslach Burnout Inventory, the two-item Patient Health Questionnaire (PHQ-2), and information about practice characteristics and demographics. We created a negative binomial and a multivariable linear regression model to seek factors independently associated with the number of perceived medical errors and symptoms of burnout., Results: A greater level of emotional exhaustion was associated with a greater number of perceived medical errors, while practice location in Europe was associated with fewer perceived errors. A higher PHQ-2 score was independently associated with symptoms of burnout., Conclusion: It is possible that symptoms of burnout cause surgeons to be more likely to perceive an imperfection as an error or that burnout distracts surgeons, contributing to a greater likelihood of a verifiable error. Additional studies are merited to investigate a potential causal relationship between symptoms of burnout and medical errors., Competing Interests: Conflict of InterestTom J. Crijns, MD, Joost T. P. Kortlever, MD, Thierry G. Guitton, MD, PhD, and Grace C. Barron MD, declare that they have no conflicts of interest. David Ring, MD, PhD, reports royalties from Wright Medical, grants and royalties from Skeletal Dynamics, editorial board membership at Clinical Orthopaedics and Related Research, honoraria as a lecturer from various hospitals and universities, and fees as a legal consultant, outside the submitted work., (© Hospital for Special Surgery 2020.)

Background: When the best treatment option is uncertain, a patient's preference based on personal values should be the source of most variation in diagnostic and therapeutic interventions. Unexplained surgeon-to-surgeon variation in treatment for hand and upper extremity conditions suggests that surgeon preferences have more influence than patient preferences., Methods: A total of 184 surgeons reviewed 18 fictional scenarios of upper extremity conditions for which operative treatment is discretionary and preference sensitive, and recommended either operative or non-operative treatment. To test the influence of six specific patient preferences the preference was randomly assigned to each scenario in an affirmative or negative manner. Surgeon characteristics were collected for each participant., Results: Of the six preferences studied, four influenced surgeon recommendations. Surgeons were more likely to recommend non-operative treatment when patients; preferred the least expensive treatment (adjusted OR, 0.82; 95% CI, 0.71 - 0.94; P=0.005 ), preferred non-operative treatment (adjusted OR, 0.82; 95% CI, 0.72 - 0.95; P=0.006 ), were not concerned about aesthetics (adjusted OR, 1.15; 95% CI, 1.0 - 1.3; P=0.046 ), and when patients only preferred operative treatment if there is consensus among surgeons that operative treatment is a useful option (adjusted OR, 0.78; 95% CI, 0.68 - 0.89; P<0.001 )., Conclusion: Patient preferences were found to have a measurable influence on surgeon treatment recommendations though not as much as we expected-and surgeons on average interpreted surgery as more aesthetic. This emphasizes the importance of strategies to help patients reflect on their values and ensure their preferences are consistent with those values (e.g. use of decision-aids)., Competing Interests: The authors report no conflict of interest concerning the materials or methods used in this study or the findings specified in this paper.

Computed tomography (CT) is increasingly used not just to diagnose union but also to estimate the percentage of the fracture gap that is bridged by healing bone. This study tested the primary null hypothesis that there is no agreement between observers on the extent of union of a scaphoid waist fracture on CT. CT scans of 13 nondisplaced scaphoid waist fractures treated nonoperatively were rated by 145 observers. CT scans were done 10 to 12 weeks after injury. Observers were asked to "eyeball" measure percentage of union. We found that there was a moderate agreement on the categorical degree of partial union of a scaphoid waist fracture on CT (k = 0.34). Agreement on the location of bony bridging was slight (k = 0.31). We concluded that there is limited reliability of diagnosis of partial union of a scaphoid waist fracture on CT and that this should be taken into account in both patient care and research. This is a Level III, diagnostic study.

Purpose  Fractures of the proximal pole of the scaphoid are prone to adverse outcomes such as nonunion and avascular necrosis. Distinction of scaphoid proximal pole fractures from waist fractures is important for management but it is unclear if the distinction is reliable. Methods  A consecutive series of 29 scaphoid fractures from one tertiary hospital was collected consisting of 5 scaphoid proximal pole and 24 scaphoid waist fractures. Fifty-seven members of the Science of Variation Group (SOVG) were randomized to diagnose fracture location and displacement by using radiographs alone or radiographs and a computed tomography (CT) scan. Results  Observers reviewing radiographs alone and observers reviewing radiographs and CT scans both had substantial agreement on fracture location (κ = 0.82 and κ = 0.80, respectively; p  = 0.54). Both groups had only fair agreement on fracture displacement (κ = 0.28 and κ = 0.35, respectively; p  = 0.029). Conclusion  Proximal pole fractures are sufficiently distinct from proximal waist fractures that CT does not improve reliability of diagnosis. Level of Evidence  Level IV interobserver reliability case-control study.

Background  Patients with Madelung deformity exhibit a spectrum of mild to severe deformity and distortion of wrist geometry. It may be difficult to reliably distinguish mild Madelung deformity from normal. Purpose  This study thus tested the reliability of the diagnosis of mild Madelung deformity on a single posteroanterior (PA) radiograph. Materials and Methods  An online survey was sent to hand and wrist surgeons of the Science of Variation Study Group for evaluation of 25 PA wrist radiographs comprising five adults with suspected mild Madelung deformity and 20 radiographs without any evident wrist pathology. Interobserver agreement was evaluated both via average percent agreement and Fleiss' kappa. To evaluate the relationship of rater characteristics and accuracy, a linear regression model was computed. Results  The interobserver agreement among the 69 participating surgeons was low ( Κ  = 0.12). The overall sensitivity, specificity, and accuracy were 0.30, 0.86, and 0.75, respectively. The mean confidence was 7.4 ± 0.4 for mild Madelung and 7.8 ± 0.5 for normal ( p  = 0.112). The observers' confidence level was the only factor which had a mild but significant effect on the accuracy of the ratings. Conclusion  The diagnosis of mild Madelung deformity on a single PA radiograph is unreliable. Level of Evidence  The level of evidence is II, diagnostic study.

Hypothesis: This study assessed, if there was a difference in surgical decision making for metastatic humeral lesions based on; orthopaedic subspecialty, tumor characteristics., Study Type: Cross sectional survey study., Materials and Methods: Twenty-four case scenarios were created by combining: tumor type, life expectancy, fracture type, and anatomical location. Participants were asked for every case: what treatment would you recommend? Participants were 78 (48%) orthopaedic oncologists and 83 (52%) orthopaedic surgeons that were not regularly involved in the treatment of bone tumors., Results: There was a difference between orthopaedic oncologists and other subspecialty surgeons in recommendation for specific treatments: intramedullary nailing was less often recommended by orthopaedic oncologists (53%, 95%CI: 47-59) compared to other surgeons (62%, 95%CI: 57-67) (p=0.023); while endoprosthetic reconstruction (orthopaedic oncologists: 8.8% [95%CI: 6.6-11], other surgeons: 3.6%[95%CI: 2.3-4.8], p<0.001) and plate-screw fixation (orthopaedic oncologists: 19%[95%CI: 14-25], other surgeons: 9.5%[95%CI: 5.9-13], p=0.003) were more often recommended by orthopaedic oncologists. There was no difference in recommendation for nonoperative management. There were differences in recommendation for specific treatments based on tumor type, life expectancy, and anatomical location, but not fracture type., Discussion: Subspecialty training and patient and tumor characteristics influence the decision for operative management and the decision for a specific implant in metastatic humeral fractures., Level of Evidence: Level 3., (Copyright © 2017 Elsevier Masson SAS. All rights reserved.)

Background: The appearance of early Kienböck disease on radiographs and magnetic resonance imaging (MRI) may be difficult to distinguish from other conditions that affect the lunate. We aimed to assess the interobserver agreement in the diagnosis of early Kienböck disease when evaluated on different imaging modalities., Methods: Forty-three hand surgeon members of the Science of Variation Group were randomized to evaluate radiographs and 35 hand surgeons to evaluate radiographs and MRI scans of 26 patients for the presence of Kienböck disease, the lunate type, and the ulnar variance. We used Fleiss' kappa analysis to assess the interobserver agreement for categorical variables and compared the κ values between the 2 groups., Results: We found that agreement on the diagnosis of early Kienböck disease was fair (κ, 0.36) among observers who evaluated radiographs alone and moderate (κ, 0.58) among observers who evaluated MRI scans in addition to radiographs, and that the difference in κ values was not statistically significant ( P = .057). Agreement did not differ between observers based on imaging modality with regard to the assessment of the lunate type ( P = .75) and ulnar variance ( P = .15)., Conclusions: We found, with the numbers evaluated, a notable but nonsignificant difference in agreement in favor of observers who evaluated MRI scans in addition to radiographs compared with radiographs alone. Surgeons should be aware that the diagnosis of Kienböck disease in the precollapse stages is not well defined, as evidenced by the substantial interobserver variability.

The purpose of this study was to compare the observer participation and satisfaction as well as interobserver reliability between two online platforms, Science of Variation Group (SOVG) and Traumaplatform Study Collaborative, for the evaluation of complex tibial plateau fractures using computed tomography in MPEG4 and DICOM format. A total of 143 observers started with the online evaluation of 15 complex tibial plateau fractures via either the SOVG or Traumaplatform Study Collaborative websites using MPEG4 videos or a DICOM viewer, respectively. Observers were asked to indicate the absence or presence of four tibial plateau fracture characteristics and to rate their satisfaction with the evaluation as provided by the respective online platforms. The observer participation rate was significantly higher in the SOVG (MPEG4 video) group compared to that in the Traumaplatform Study Collaborative (DICOM viewer) group (75 and 43%, respectively; P < 0.001). The median observer satisfaction with the online evaluation was seven (range, 0-10) using MPEG4 video compared to six (range, 1-9) using DICOM viewer (P = 0.11). The interobserver reliability for recognition of fracture characteristics in complex tibial plateau fractures was higher for the evaluation using MPEG4 video. In conclusion, observer participation and interobserver reliability for the characterization of tibial plateau fractures was greater with MPEG4 videos than with a standard DICOM viewer, while there was no difference in observer satisfaction. Future reliability studies should account for the method of delivering images.

Background: Radiological grading of wrist osteoarthritis associated with scaphoid nonunion advanced collapse (SNAC) can be difficult. A comparison radiograph of the contralateral healthy wrist and an educational training in the various SNAC stages may improve reliability. Our purposes were to evaluate the difference in the reliability: (1) between observers who rate SNAC wrists with and without a comparison radiograph; and (2) between observers who receive training prior to ratings and those who do not., Methods: In this cross-sectional survey study, 82 fully trained orthopedic or hand surgeons rated anteroposterior radiographs of 19 patient wrists following a scaphoid nonunion based on SNAC stages 0 to 4. Observers were randomized online in 4 groups: one group rated unilateral views without training, a second group unilateral views with training, a third group bilateral views without training, and a fourth group bilateral views with training. Training included a 1-page clarification of the SNAC stages. Interobserver agreement was calculated using kappa statistics., Results: There was no significant difference between agreement between observers who rated unilateral radiographs (κ = 0.55) and who rated bilateral radiographs (κ = 0.58) ( P = .14), nor between agreement between observers who received training (κ = 0.59) and who did not (κ = 0.54) ( P = .058)., Conclusions: The use of an additional comparison view and/or training does not seem to be clinically relevant in SNAC staging. There is room for improvement in the way we assess patients with SNAC wrists.

Background: Orthopaedic surgeons have a pivotal role in transitioning the care of orthopedic patients from a biomedical to a biopsychosocial model. In an effort to foster this transition, we designed a study aimed to determine surgeons' attitudes and practice of noticing, screening, discussing psychological illness with patients, as well as making referrals to address psychosocial issues in patients in need. Additionally, we asked surgeons to rank order potential barriers to and reasons for referrals to psychosocial treatment., Methods: Orthopaedic surgeons members of the Science and Variation Group and Ankle Platform (N =350) completed demographics, and a 4-part survey assessing the degree to which surgeons notice, assess, screen and refer for psychological treatments, as well ranked ordered barriers to engaging in these processes., Results: As a group surgeons were neutral to referral for psychological treatment and formal screening of psychological factors, and somewhat likely to notice and discuss psychological factors. Surgeons were more likely to refer for psychological treatment if they engaged in research, or if they reside in South America as opposed to North America. The highest ranked barriers to screening, noticing, discussing and referring for psychological treatment were lack of time, stigma and feeling uncomfortable., Conclusion: Overall surgeons are likely to notice and discuss psychological factors, but less likely to formally screen or refer for psychological treatment. Transition to biopsychosocial models should focus on problem solving these barriers by teaching surgeons communication skills to increase comfort with discussing psychoemotional factors associated with orthopedic problems. The use of empathic communication can be very helpful in normalizing the difficulty of coping with an orthopedic condition, and may facilitate referral.

Background: As an early step in the development of a decision aid for idiopathic trigger finger (TF) we were interested in the level of decisional conflict experienced by patients and hand surgeons. This study tested the null hypothesis that there is no difference in decisional conflict between patients with one or more idiopathic trigger fingers and hand surgeons. Secondary analyses address the differences between patients and surgeons regarding the influence of the DCS-subcategories on the level of decisional conflict, as well as the influence of patient and physician demographics, the level of self-efficacy, and satisfaction with care on decisional conflict., Methods: One hundred and five hand surgeon-members of the Science of Variation Group (SOVG) and 84 patients with idiopathic TF completed the survey regarding the Decisional Conflict Scale. Patients also filled out the Pain Self-efficacy Questionnaire (PSEQ) and the Patient Doctor Relationship Questionnaire (PDRQ-9)., Results: On average, patients had decisional conflict comparable to physicians, but by specific category patients felt less informed and supported than physicians. The only factors associated with greater decisional conflict was the relationship between the patient and doctor., Conclusions: There is a low, but measurable level of decisional conflict among patients and surgeons regarding idiopathic trigger finger. Studies testing the ability of decision aids to reduce decisional conflict and improve patient empowerment and satisfaction with care are merited.

Background: Burnout is common in professions such as medicine in which employees have frequent and often stressful interpersonal interactions where empathy and emotional control are important. Burnout can lead to decreased effectiveness at work, negative health outcomes, and less job satisfaction. A relationship between burnout and job satisfaction is established for several types of physicians but is less studied among surgeons who treat musculoskeletal conditions., Questions/purposes: We asked: (1) For surgeons treating musculoskeletal conditions, what risk factors are associated with worse job dissatisfaction? (2) What risk factors are associated with burnout symptoms?, Methods: Two hundred ten (52% of all active members of the Science of Variation Group [SOVG]) surgeons who treat musculoskeletal conditions (94% orthopaedic surgeons and 6% trauma surgeons; in Europe, general trauma surgeons do most of the fracture surgery) completed the Global Job Satisfaction instrument, Shirom-Malamed Burnout Measure, and provided practice and surgeon characteristics. Most surgeons were male (193 surgeons, 92%) and most were academically employed (186 surgeons, 89%). Factors independently associated with job satisfaction and burnout were identified with multivariable analysis., Results: Greater symptoms of burnout (β, -7.13; standard error [SE], 0.75; 95% CI, -8.60 to -5.66; p < 0.001; adjusted R(2), 0.33) was the only factor independently associated with lower job satisfaction. Having children (β, -0.45; SE, 0.0.21; 95% CI, -0.85 to -0.043; p = 0.030; adjusted R(2), 0.046) was the only factor independently associated with fewer symptoms of burnout., Conclusions: Among an active research group of largely academic surgeons treating musculoskeletal conditions, most are satisfied with their job. Efforts to limit burnout and job satisfaction by optimizing engagement in and deriving meaning from the work are effective in other settings and merit attention among surgeons., Level of Evidence: Level II, prognostic study.

Background: Much of the decision-making in orthopaedics rests on uncertain evidence. Uncertainty is therefore part of our normal daily practice, and yet physician uncertainty regarding treatment could diminish patients' health. It is not known if physician uncertainty is a function of the evidence alone or if other factors are involved. With added experience, uncertainty could be expected to diminish, but perhaps more influential are things like physician confidence, belief in the veracity of what is published, and even one's religious beliefs. In addition, it is plausible that the kind of practice a physician works in can affect the experience of uncertainty. Practicing physicians may not be immediately aware of these effects on how uncertainty is experienced in their clinical decision-making., Questions/purposes: We asked: (1) Does uncertainty and overconfidence bias decrease with years of practice? (2) What sociodemographic factors are independently associated with less recognition of uncertainty, in particular belief in God or other deity or deities, and how is atheism associated with recognition of uncertainty? (3) Do confidence bias (confidence that one's skill is greater than it actually is), degree of trust in the orthopaedic evidence, and degree of statistical sophistication correlate independently with recognition of uncertainty?, Methods: We created a survey to establish an overall recognition of uncertainty score (four questions), trust in the orthopaedic evidence base (four questions), confidence bias (three questions), and statistical understanding (six questions). Seven hundred six members of the Science of Variation Group, a collaboration that aims to study variation in the definition and treatment of human illness, were approached to complete our survey. This group represents mainly orthopaedic surgeons specializing in trauma or hand and wrist surgery, practicing in Europe and North America, of whom the majority is involved in teaching. Approximately half of the group has more than 10 years of experience. Two hundred forty-two (34%) members completed the survey. We found no differences between responders and nonresponders. Each survey item measured its own trait better than any of the other traits. Recognition of uncertainty (0.70) and confidence bias (0.75) had relatively high Cronbach alpha levels, meaning that the questions making up these traits are closely related and probably measure the same construct. This was lower for statistical understanding (0.48) and trust in the orthopaedic evidence base (0.37). Subsequently, combining each trait's individual questions, we calculated a 0 to 10 score for each trait. The mean recognition of uncertainty score was 3.2 ± 1.4., Results: Recognition of uncertainty in daily practice did not vary by years in practice (0-5 years, 3.2 ± 1.3; 6-10 years, 2.9 ± 1.3; 11-20 years, 3.2 ± 1.4; 21-30 years, 3.3 ± 1.6 years; p = 0.51), but overconfidence bias did correlate with years in practice (0-5 years, 6.2 ± 1.4; 6-10 years, 7.1 ± 1.3; 11-20 years, 7.4 ± 1.4; 21-30 years, 7.1 ± 1.2 years; p < 0.001). Accounting for a potential interaction of variables using multivariable analysis, less recognition of uncertainty was independently but weakly associated with working in a multispecialty group compared with academic practice (β regression coefficient, -0.53; 95% confidence interval [CI], -1.0 to -0.055; partial R(2), 0.021; p = 0.029), belief in God or any other deity/deities (β, -0.57; 95% CI, -1.0 to -0.11; partial R(2), 0.026; p = 0.015), greater confidence bias (β, -0.26; 95% CI, -0.37 to -0.14; partial R(2), 0.084; p < 0.001), and greater trust in the orthopaedic evidence base (β, -0.16; 95% CI, -0.26 to -0.058; partial R(2), 0.040; p = 0.002). Better statistical understanding was independently, and more strongly, associated with greater recognition of uncertainty (β, 0.25; 95% CI, 0.17-0.34; partial R(2), 0.13; p < 0.001). Our full model accounted for 29% of the variability in recognition of uncertainty (adjusted R(2), 0.29)., Conclusions: The relatively low levels of uncertainty among orthopaedic surgeons and confidence bias seem inconsistent with the paucity of definitive evidence. If patients want to be informed of the areas of uncertainty and surgeon-to-surgeon variation relevant to their care, it seems possible that a low recognition of uncertainty and surgeon confidence bias might hinder adequately informing patients, informed decisions, and consent. Moreover, limited recognition of uncertainty is associated with modifiable factors such as confidence bias, trust in orthopaedic evidence base, and statistical understanding. Perhaps improved statistical teaching in residency, journal clubs to improve the critique of evidence and awareness of bias, and acknowledgment of knowledge gaps at courses and conferences might create awareness about existing uncertainties., Level of Evidence: Level 1, prognostic study.

Background: For greater tuberosity fractures, 5-mm displacement is a commonly used threshold for recommending surgery; however, it is unclear if displacement can be assessed with this degree of precision and reliability using plain radiographs. It also is unclear if CT images provide additional information that might change decision making., Question/purposes: We asked: (1) Does interobserver agreement for assessment of the amount and direction of fracture-fragment displacement vary based on imaging modality (radiographs only; 2-dimensional [2-D] CT images and radiographs; and 3-dimensional [3-D] and 2-D CT images and radiographs)? (2) Does the likelihood of recommending surgery vary based on imaging modality? (3) Does the level of confidence regarding the decision for treatment vary based on imaging modality?, Methods: We invited 791 orthopaedic surgeons to complete a survey on greater tuberosity fractures. One hundred eighty (23%) responded and were randomized on a 1:1:1 basis in one of the three imaging modality groups and evaluated the same set of 22 fractures. We described age, sex, mechanism of injury, days between injury and imaging, and that patients had no comorbidities or signs of neurovascular damage for every case. One hundred sixty-four of the 180 respondents completed the study and there was an imbalance in noncompletion between the three groups (two of 67 [3.0%] in the radiograph only group; nine of 57 [16%] in the 2-D CT and radiograph group; and five of 56 [8.9%] in the 3-D CT, 2-D CT, and radiograph group; p = 0.043 by Fisher's exact test). Participants assessed amount (in millimeters) and direction (posterosuperior/posteroinferior/anterosuperior/anteroinferior/no displacement) of displacement; recommended treatment (surgical or nonoperative); and indicated their level of confidence regarding the recommended treatment on a scale from 0 to 10 for every case. Overall recommendation for treatment was expressed as a surgery score per surgeon by dividing the amount of cases they would operate on by the total number of cases (n = 22) and presented as a percentage. Confidence regarding the decision for treatment was calculated by averaging the confidence score per surgeon, ranging from 0 to 10. We compared interobserver agreement using kappa for categorical variables and intraclass correlation (ICC) for continuous variables. We used multivariable linear regression to assess difference in surgery score and confidence level between imaging groups, controlling for surgeon characteristics., Results: Interobserver agreement for assessment of amount (radiographs: ICC, 0.55, 2-D CT + radiographs ICC, 0.53, 3-D CT + 2-D CT + radiographs ICC, 0.57; p values on all comparisons >0.7) and direction (radiographs: kappa, 0.30, 2-D CT + radiographs kappa, 0.43, 3-D CT + 2-D CT + radiographs kappa, 0.40; p values for all comparisons >0.096) of displacement did not vary by imaging modality. 2-D CT and radiographs (β regression coefficient [β], 3.1; p = 0.253) and 3-D CT, 2-D CT and radiographs (β, 1.6; p = 0.561) did not result in a difference in recommendation for surgery compared with radiographs alone. 2-D CT and radiographs (β, 0.40; p = 0.021) and 3-D CT, 2-D CT and radiographs (β, 0.44; p = 0.011) were associated with slightly higher levels of confidence compared with radiographs alone., Conclusions: Imaging modality, with the numbers evaluated, does not influence interobserver agreement of greater tuberosity fracture assessment, nor did it influence the recommendation for surgical treatment. However, surgeons did feel slightly more confident about their treatment recommendation when assessing CT images with radiographs compared with radiographs alone. Our results therefore suggest no additional value of CT scans for assessment of greater tuberosity fractures when displacement seems to be minimal on plain radiographs. CT scans could be helpful in borderline cases, or in case other fractures can be expected (eg, an occult surgical neck fracture)., Level of Evidence: Level III, diagnostic study.

Background: Fracture-dislocations of the proximal interphalangeal joint are vexing because subluxation and articular damage can lead to arthrosis and the treatments are imperfect. Ideally, a surgeon could advise a patient, based on radiographs, when the risk of problems merits operative intervention, but it is unclear if middle phalanx base fracture characteristics are sufficiently reliable to be useful for surgical decision making., Questions/purposes: We evaluated (1) the degree of interobserver agreement as a function of fracture characteristics, (2) the differences in interobserver agreement between experienced and less-experienced hand surgeons, and (3) what fracture characteristics and surgeon characteristics were associated with the decision for operative treatment., Methods: Ninety-nine (33%) of 296 hand surgeons evaluated 21 intraarticular middle phalanx base fractures on lateral radiographs. Eighty-one surgeons (82%) were in academic practice and 57 (58%) had less than 10 years experience. Participants assessed six fracture characteristics and recommended treatment (nonoperative or operative: extension block pinning, external fixation, open reduction and internal fixation, volar plate arthroplasty, or hemihamate autograft arthroplasty) for all cases., Results: With all surgeons pooled together, the interobserver agreement for fracture characteristics was substantial for assessment of a 2-mm articular step or gap (kappa, 0.73; 95% CI, 0.60-0.86; p < 0.001), subluxation or dislocation (kappa, 0.72; 95% CI, 0.58-0.86; p < 0.001), and percentage of articular surface involved (intraclass correlation coefficient [ICC], 0.67; 95% CI, 0.54-0.81; p < 0.001); moderate for comminution (kappa, 0.55; 95% CI, 0.39-0.70; p < 0.001) and stability (kappa, 0.54; 95% CI, 0.39-0.69; p < 0.001); and fair for the number of fracture fragments (ICC, 0.39; 95% CI, 0.27-0.57; p < 0.001). When recommending treatment, interobserver agreement was substantial (kappa, 0.69; 95% CI, 0.50-0.88; p < 0.001) for the recommendation to operate or not to operate, but only fair (kappa, 0.34; 95% CI, 0.21-0.47; p < 0.001) for the specific type of treatment, indicating variation in operative techniques. There were no differences in agreement for any of the fracture characteristics or treatment preference between less-experienced and more-experienced surgeons, although statistical power on this comparison was low. None of the surgeon characteristics was associated with the decision for operative treatment, whereas all fracture characteristics were, except for stable and uncertain joint stability. Articular step or gap (β, 0.90; R-squared, 0.89; 95% CI, 0.75-1.05; p < 0.001), likelihood of subluxation or dislocation (β, 0.80; R-squared, 0.76; 95% CI, 0.59-1.02; p < 0.001), and unstable fractures (β, 0.88; R-squared, 0.81; 95% CI, 0.67-1.1; p < 0.001), are most strongly associated with the decision for operative treatment., Conclusions: We found that assessment of a step or gap and likelihood of subluxation were most reliable and are strongly associated with the decision for operative treatment. Surgeons largely agree on which fractures might benefit from surgery, and the variation seems to be with the operative technique. Efforts at improving the care of these fractures should focus on the comparative effectiveness of the various operative treatment options., Level of Evidence: Level III, diagnostic study.

Purpose: When surgeons disagree about the role of surgery, patient values and preferences should drive decision-making, but there is evidence that surgeon preferences have substantial influence. Surgeon preferences may relate to surgeon personality. Our primary null hypothesis is that specific personality characteristics (work styles) are not associated with the recommendation for operative treatment accounting for surgeon demographics., Patients and Methods: We invited members of the Science of Variation Group to assess images of 15 upper extremity injuries with debatable indications for surgery, recommended operative or non-operative treatment, and grade their confidence in this decision (n = 270); subsequently, participants completed the validated Octogram Work and Leadership Style Test (n = 223). We selected injuries that could be treated either operatively or non-operatively including fractures of the clavicle, scapula, humerus, and radius fractures, and proximal and distal bicep ruptures., Results: A higher proportion of recommendations for surgery was independently associated with a higher Octogram test pioneer score (β regression coefficient [β] 0.0054, partial R (2) 0.065, 95 % confidence interval [CI] 0.0027-0.0080, P < 0.001) and practice location outside North America and Europe (β 0.13, partial R (2) 0.079, 95% CI 0.073-0.020, P < 0.001) (adjusted R (2) 0.12, P < 0.001). No work styles were associated with more confidence in treatment., Conclusions: A recommendation for discretionary surgery for musculoskeletal injury was related to surgeon personality. Surgeon self-awareness of how their work style can influence their recommendations might make them more receptive to techniques that ensure patient values have more influence than surgeon preferences on treatment decisions.

Background: There is substantial unexplained geographical and surgeon-to-surgeon variation in rates of surgery. One would expect surgeons to treat patients and themselves similarly based on best evidence and accounting for patient preferences., Questions/purposes: (1) Are surgeons more likely to recommend surgery when choosing for a patient than for themselves? (2) Are surgeons less confident in deciding for patients than for themselves?, Methods: Two hundred fifty-four (32%) of 790 Science of Variation Group (SOVG) members reviewed 21 fictional upper extremity cases (eg, distal radius fracture, De Quervain tendinopathy) for which surgery is optional answering two questions: (1) What treatment would you choose/recommend: operative or nonoperative? (2) On a scale from 0 to 10, how confident are you about this decision? Confidence is the degree that one believes that his or her decision is the right one (ie, most appropriate). Participants were orthopaedic, trauma, and plastic surgeons, all with an interest in treating upper extremity conditions. Half of the participants were randomized to choose for themselves if they had this injury or illness. The other half was randomized to make treatment recommendations for a patient of their age and gender. For the choice of operative or nonoperative, the overall recommendation for treatment was expressed as a surgery score per surgeon by dividing the number of cases they would operate on by the total number of cases (n = 21), where 100% is when every surgeon recommended surgery for every case. For confidence, we calculated the mean confidence for all 21 cases per surgeon; overall score ranges from 0 to 10 with a higher score indicating more confidence in the decision for treatment., Results: Surgeons were more likely to recommend surgery for a patient (44.2% ± 14.0%) than they were to choose surgery for themselves (38.5% ± 15.4%) with a mean difference of 6% (95% confidence interval [CI], 2.1%-9.4%; p = 0.002). Surgeons were more confident in deciding for themselves than they were for a patient of similar age and gender (self: 7.9 ± 1.0, patient: 7.5 ± 1.2, mean difference: 0.35 [CI, 0.075-0.62], p = 0.012)., Conclusions: Surgeons are slightly more likely to recommend surgery for a patient than they are to choose surgery for themselves and they choose for themselves with a little more confidence. Different perspectives, preferences, circumstantial information, and cognitive biases might explain the observed differences. This emphasizes the importance of (1) understanding patients' preferences and their considerations for treatment; (2) being aware that surgeons and patients might weigh various factors differently; (3) giving patients more autonomy by letting them balance risks and benefits themselves (ie, shared decision-making); and (4) assessing how dispassionate evidence-based decision aids help inform the patient and influences their decisional conflict., Level of Evidence: Level III, diagnostic study.

Surgeons use radiographic measures of deformity to help make treatment decisions in distal radius fractures. Precise threshold values are sometimes offered as a guide to treatment. The purpose was to evaluate if agreement on treatment recommendations would improve if surgeons were provided with radiographs rather than precise numeric radiographic measurements. We randomized 259 surgeons to review the scenarios of 30 consecutive adult patients with a distal radius fracture treated at our emergency department either with radiographs (135 surgeons) or with radiographic measurements (124 surgeons). Interrater reliability was measured with the Fleiss' generalized Kappa. Factors associated with a recommendation for operative treatment were sought in bivariate and multivariable analyses. Surgeons that received measurements only recommended operative treatment significantly more often, but were less likely to agree than surgeons evaluating actual radiographs. Patient factors - radiographic factors in particular - had a greater influence on treatment recommendation than surgeon factors. Agreement on treatment recommendations improved if surgeons were provided with radiographs instead of just measurements. There may be radiographic factors other than measures of deformity that some surgeons use to determine recommendations for surgery.

Background: So-called "hazardous attitudes" (macho, impulsive, antiauthority, resignation, invulnerable, and confident) were identified by the Federal Aviation Administration and the Canadian Air Transport Administration as contributing to road traffic incidents among college-aged drivers and felt to be useful for the prevention of aviation accidents. The concept of hazardous attitudes may also be useful in understanding adverse events in surgery, but it has not been widely studied., Questions/purposes: We surveyed a cohort of orthopaedic surgeons to determine the following: (1) What is the prevalence of hazardous attitudes in a large cohort of orthopaedic surgeons? (2) Do practice setting and/or demographics influence variation in hazardous attitudes in our cohort of surgeons? (3) Do surgeons feel they work in a climate that promotes patient safety?, Methods: We asked the members of the Science of Variation Group-fully trained, practicing orthopaedic and trauma surgeons from around the world-to complete a questionnaire validated in college-aged drivers measuring six attitudes associated with a greater likelihood of collision and used by pilots to assess and teach aviation safety. We accepted this validation as applicable to surgeons and modified the questionnaire accordingly. We also asked them to complete the Modified Safety Climate Questionnaire, a questionnaire assessing the absence of a safety climate that is based on the patient safety cultures in healthcare organizations instrument. Three hundred sixty-four orthopaedic surgeons participated, representing a 47% response rate of those with correct email addresses who were invited., Results: Thirty-eight percent (137 of 364 surgeons) had at least one score that would have been considered dangerously high in pilots (> 20), including 102 with dangerous levels of macho (28%) and 41 with dangerous levels of self-confidence (11%). After accounting for possible confounding variables, the variables most closely associated with a macho attitude deemed hazardous in pilots were supervision of surgical trainees in the operating room (p = 0.003); location of practice in Canada (p = 0.059), Europe (p = 0.021), and the United States (p = 0.005); and being an orthopaedic trauma surgeon (p = 0.046) (when compared with general orthopaedic surgeons), but accounted for only 5.3% of the variance (p < 0.001). On average, 19% of surgeon responses to the Modified Safety Climate Questionnaire implied absence of a safety climate., Conclusions: Hazardous attitudes are common among orthopaedic surgeons and relate in small part to demographics and practice setting. Future studies should further validate the measure of hazardous attitudes among surgeons and determine if they are associated with preventable adverse events. We agree with aviation safety experts that awareness of amelioration of such attitudes might improve safety in all complex, high-risk endeavors, including surgery-a line of thinking that merits additional research.

Background: The primary aim of this study was to determine predictors of missed research appointments in a prospective randomized placebo injection-controlled trial with evaluations 1 to 3 and 5 to 8 months after enrollment., Methods: This study represents a secondary use of data from 104 patients that were enrolled in a prospective randomized controlled trial of dexamethasone versus lidocaine (placebo) injection for various diagnoses. Patients were enrolled between June 2003 and February 2008. Sixty-three patients (61%) had lateral epicondylosis, 17 patients (16%) had trapeziometacarpal arthrosis, and 24 patients (23%) had de Quervain syndrome. Each patient completed a set of questionnaires at time of enrollment. Bivariable and multivariable analyses were used to determine factors associated with missed research appointments., Results: Fourteen patients (13%) did not return for the first follow-up and 33 patients (32%) did not return for the second follow-up. The best multivariable logistic regression model for missing the first research visit explained 35% of the variability and included younger age, belief that health can be controlled, and no college education. The best model for missing the second research visit explained 17% of the variability and included greater pain intensity, less personal responsibility for health, and diagnosis (trapeziometacarpal arthrosis and de Quervain syndrome)., Conclusions: Younger patients with no college education, who believe their health can be controlled, are more likely to miss a research appointment when enrolled in a randomized placebo injection-controlled trial.

Background: Operative treatment of a displaced, transverse, noncomminuted fracture of the olecranon is associated with good to excellent elbow function in retrospective short-term followup studies. However, to our knowledge, no studies have evaluated objective and subjective outcomes using standardized outcome instruments (ie, DASH and Mayo Elbow Performance Index [MEPI]) to quantify long-term outcome of these specific fractures., Questions/purposes: We evaluated (1) factors associated with disability, as measured with the DASH questionnaire; (2) factors associated with ulnohumeral motion; (3) factors associated with pain intensity; and (4) general descriptive findings for posttraumatic arthrosis, MEPI, ulnar neuropathy symptoms, and return to work between 10 and 32 years after open reduction and internal fixation (ORIF) of a transverse, noncomminuted fracture of the olecranon., Methods: Between 1977 and 1997, we performed ORIFs of transverse, noncomminuted olecranon fractures in 109 patients, of whom 35 had died, 14 had incomplete data in our registry, and 19 were lost to followup or declined participation, leaving 41 patients available for followup at a minimum of 10 years after surgery. During that time, our general indication for performing ORIF was greater than 2 mm displacement. The average age of these patients at the time of injury was 35 years (range, 18-73 years). Patient-reported outcome was quantified using the DASH questionnaire, and physician-based outcome was evaluated using the MEPI. To identify factors associated with disability (DASH), impairment (MEPI), ulnohumeral motion, and pain, we examined demographic and clinical data in bivariate analyses, and subsequently significant factors in multivariate analysis to identify independent predictors of outcome., Results: The sole factor associated with higher DASH scores in multivariable analysis was age at surgery, explaining 20% of the variability, with younger patients performing better. The mean arc of elbow flexion was 142° (range, 110°-160°), and the variation was associated with arthrosis alone (ie, a greater arc of motion was associated with a lesser grade of arthrosis according to the system of Broberg and Morrey). Pain was uncommon and generally was correlated with adverse events., Conclusions: The good results of operative fixation (tension-band wiring) of a transverse, displaced olecranon fracture are durable with time. Patient-reported outcomes are excellent in the majority of patients. Residual patient-rated disability does not correlate with arthrosis or loss of extension., Level of Evidence: Level IV, therapeutic study. See the Guidelines for Authors for a complete description of levels of evidence.

Unlabelled: To tests the hypothesis that classification and characterization of fractures of the radial head is more accurate with 3D than 2D computed tomography images and radiographs, using a prospective study design with intraoperative inspection as the reference standard. Treating surgeons and first assistants completed a questionnaire assigning a fracture type according to the Broberg and Morrey modification of Mason's classification, evaluating selected fracture characteristics, and electing preferred management based upon radiographs and 2D images alone; then adding 3D-CT; then 3D printed physical models; and finally intra-operative visualization. The addition of the 3D CT and physical models improved the sensitivity for fracture line separating the entire head from the neck, comminution of the radial neck, fracture involving the articular surface, articular fracture gap greater than 2 mm, impacted fracture fragments, greater than 3 articular fragments, and articular fragments judged too small to repair. There were no significant differences in diagnostic performance with the addition of 3D models. The addition of 3D CT and models improved the reliability of Broberg and Morrey classification. We conclude that 3DCT and 3D physical modeling provide more accurate fracture classification and characterization of fracture of the radial head with less proposed variability in treatment. We did not demonstrate a clear advantage for modeling over 3DCT reconstructions., Level of Evidence: Diagnostic, Level I.

Trapeziometacarpal arthrosis is expected with advancing age and a limited percentage of people seek medical attention for it. We studied patients after their first appointment to address trapeziometacarpal arthrosis with a hand surgeon to determine factors associated with return for a second visit and eventual election of operative treatment. A billing database identified 306 patients in the practice of three hand surgeons with a new diagnosis of TMC arthrosis and no associated diagnoses. Bivariate and multivariable logistic regression analyses sought factors associated with a second visit and operative treatment among demographic and visit related factors. One hundred and forty-three patients (47 %) returned for one or more additional visits and 46 (15 %) eventually elected operative treatment within the study period. Independent predictors of a return visit included injection at first visit, splint at first visit, and doctor's recommendation for a return visit. The predictors of surgery were treating surgeon and prescription of a splint at the first visit, but splint at first visit was only predictive for one of the three surgeons. When patients first learn about their trapeziometacarpal arthrosis, the behavior of the hand surgeon may have a strong influence on return visits and eventual choice of operative treatment.

Background: Studies of traumatic elbow instability suggest that recognition of a pattern in the combination and character of the fractures and joint displacements helps predict soft tissue injury and guide the treatment of traumatic elbow instability, but there is no evidence that patterns can be identified reliably., Questions/purposes: We therefore determined (1) the interobserver reliability of identifying specific patterns of traumatic elbow instability on radiographs for subgroups of orthopaedic surgeons; and (2) the diagnostic accuracy of radiographic diagnosis., Methods: Seventy-three orthopaedic surgeons evaluated 53 sets of radiographs and diagnosed one of five common patterns of traumatic elbow instability by using a web-based survey. The interobserver reliability was analyzed using Cohen's multirater kappa. Intraoperative diagnosis was the reference for fracture pattern in calculations of the sensitivity, specificity, accuracy, and positive predictive and negative predictive values of radiographic diagnosis., Results: The overall interobserver reliability for patterns of traumatic elbow instability on radiographs was κ=0.41. Treatment of greater than five such injuries a year was associated with greater interobserver agreement, but years in practice were not. Diagnostic accuracy ranged from 76% to 93% and was lowest for the terrible triad pattern of injury., Conclusions: Specific patterns of traumatic elbow instability can be diagnosed with moderate interobserver reliability and reasonable accuracy on radiographs., Level of Evidence: Level III, diagnostic study. See Guidelines for Authors for a complete description of levels of evidence.

Background: Several studies support the use of CT for diagnosing coronal fractures of the distal radius but the inter-observer reliability of these observations is less well studied. We tested the null hypothesis that radiographs alone and the combination of radiographs and two-dimensional computed tomography scans (2DCT) have the same inter-observer variation for the diagnosis of coronal articular fracture lines in the distal radius., Methods: Using a web-based survey, 63 surgeons were randomized to evaluate 16 fractures of the distal radius on radiographs alone or radiographs and 2DCT for the presence or absence of a coronal fracture line of the lunate facet and, if present, the stability of the fracture. The kappa multirater measure was calculated to estimate agreement between observers., Results: The inter-observer variation in diagnosis of a coronal fracture line was fair with both radiographs and 2DCT, as was the diagnosis of instability of the volar lunate facet fracture when present., Conclusion: Two-dimensional computed tomography does not improve observer agreement on the diagnosis of coronal plane articular fracture lines in the lunate facet of the distal radius.

Background: The diagnosis of displacement in scaphoid fractures is notorious for poor interobserver reliability., Questions/purposes: We tested whether training can improve interobserver reliability and sensitivity, specificity, and accuracy for the diagnosis of scaphoid fracture displacement on radiographs and CT scans., Methods: Sixty-four orthopaedic surgeons rated a set of radiographs and CT scans of 10 displaced and 10 nondisplaced scaphoid fractures for the presence of displacement, using a web-based rating application. Before rating, observers were randomized to a training group (34 observers) and a nontraining group (30 observers). The training group received an online training module before the rating session, and the nontraining group did not. Interobserver reliability for training and nontraining was assessed by Siegel's multirater kappa and the Z-test was used to test for significance., Results: There was a small, but significant difference in the interobserver reliability for displacement ratings in favor of the training group compared with the nontraining group. Ratings of radiographs and CT scans combined resulted in moderate agreement for both groups. The average sensitivity, specificity, and accuracy of diagnosing displacement of scaphoid fractures were, respectively, 83%, 85%, and 84% for the nontraining group and 87%, 86%, and 87% for the training group. Assuming a 5% prevalence of fracture displacement, the positive predictive value was 0.23 in the nontraining group and 0.25 in the training group. The negative predictive value was 0.99 in both groups., Conclusions: Our results suggest training can improve interobserver reliability and sensitivity, specificity and accuracy for the diagnosis of scaphoid fracture displacement, but the improvements are slight. These findings are encouraging for future research regarding interobserver variation and how to reduce it further.

Background: Orthopaedic surgical-site infections prolong hospital stays, double rehospitalization rates, and increase healthcare costs. Additionally, patients with orthopaedic surgical-site infections (SSI) have substantially greater physical limitations and reductions in their health-related quality of life. However, the risk factors for SSI after operative fracture care are unclear., Questions/purpose: We determined the incidence and quantified modifiable and nonmodifiable risk factors for SSIs in patients with orthopaedic trauma undergoing surgery., Patients and Methods: We retrospectively indentified, from our prospective trauma database and billing records, 1611 patients who underwent 1783 trauma-related procedures between 2006 and 2008. Medical records were reviewed and demographics, surgery-specific data, and whether the patients had an SSI were recorded. We determined which if any variables predicted SSI., Results: Six factors independently predicted SSI: (1) the use of a drain, OR 2.3, 95% CI (1.3-3.8); (2) number of operations OR 3.4, 95% CI (2.0-6.0); (3) diabetes, OR 2.1, 95% CI (1.2-3.8); (4) congestive heart failure (CHF), OR 2.8, 95% CI (1.3-6.5); (5) site of injury tibial shaft/plateau, OR 2.3, 95% CI (1.3-4.2); and (6) site of injury, elbow, OR 2.2, 95% CI (1.1-4.7)., Conclusion: The risk factors for SSIs after skeletal trauma are most strongly determined by nonmodifiable factors: patient infirmity (diabetes and heart failure) and injury complexity (site of injury, number of operations, use of a drain)., Level of Evidence: Level II, prognostic study. See the Guideline for Authors for a complete description of levels of evidence.

[This corrects the article DOI: 10.1007/s11552-009-9238-z.].

Diaphyseal radius fractures without associated ulna fracture or radioulnar dislocation (isolated fracture of the radius) are recognized in adults but are rarely described in skeletally immature patients. A search of our database (1974-2002) identified 17 pediatric patients that had an isolated fracture of the radius. Among the 13 patients with at least 1 year follow-up, ten were treated with manipulative reduction and immobilization in an above elbow cast and three had initial operative treatment with plate and screw fixation. These 13 patients were evaluated for an average of 18 months (range, 12 to 45 months) after injury using the system of Price and colleagues. The incidence of isolated diaphyseal radius fractures in skeletally immature patients was 0.56 per year in our database and represented 27% of the 63 patients with a diaphyseal forearm fracture. All 13 patients, with at least 1 year follow-up, regained full elbow flexion and extension and full forearm rotation. According to the classification system of Price, all 13 patients (100%) had an excellent result. As in adults, isolated radius fractures seem to occur in children more frequently than previously appreciated. Treatment of isolated radius fractures in skeletally immature patients has a low complication rate, and excellent functional outcomes are the rule.