Search

Objectives: To determine whether a new triage system safely diverts a proportion of emergency department (ED) patients to a general practitioner cooperative (GPC)., Methods: Unblinded randomised controlled trial with weekends serving as clusters (three intervention clusters for each control). The intervention was triage by a nurse using a new extension to the Manchester Triage System assigning low-risk patients to the GPC. During intervention weekends, patients were encouraged to follow this assignment; it was not communicated during control weekends (all patients remained at the ED). The primary outcome was the proportion of patients assigned to and handled by the GPC during intervention weekends. The trial was randomised for the secondary outcome: the proportion of patients assigned to the GPC. Additional outcomes were association of these outcomes with possible confounders (study tool parameters, nurse, and patient characteristics), proportion of patients referred back to the ED by the GPC, hospitalisations, and performance of the study tool to detect primary care patients (the opinion of the treating physician was the gold standard)., Results: In the intervention group, 838/6294 patients (13.3%, 95% CI 12.5 to 14.2) were assigned to the GPC, in the control group this was 431/1744 (24.7%, 95% CI 22.7 to 26.8). In total, 599/6294 patients (9.5%, 95% CI 8.8 to 10.3) experienced the primary outcome which was influenced by the reason for encounter, age, and the nurse. 24/599 patients (4.0%, 95% CI 2.7 to 5.9) were referred back to the ED, three were hospitalised. Positive and negative predictive values of the studied tool during intervention weekends were 0.96 (95%CI 0.94 to 0.97) and 0.60 (95% CI 0.58 to 0.62). Out of the patients assigned to the GPC, 2.4% (95% CI 1.7 to 3.4) were hospitalised., Conclusions: ED nurses using a new tool safely diverted 9.5% of the included patients to primary care., Trial Registration: ClinicalTrials.gov Identifier: NCT03793972., Competing Interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: The second author is a general practitioner working in the surroundings of the study site, and as such, he performed on call shifts at the study site and treated some of the studied patients. Due to the anonymity of the studied data, the exact number of study patients seen by him cannot be determined, but it was definitely below ten. He is also a board member of the studied general practice cooperative receiving meeting fees. Author HP is coordinator of the iCAREdata project (database used for this study). She had an appointment at the University of Antwerp for this project until September 2020. The authors declare no other relationships or activities that could appear to have influenced the submitted work.

Objective: Root cause analyses of serious adverse events (SAE) in out-of-hours primary care (OHS-PC) often point to errors in telephone triage. Such analyses are, however, hampered by hindsight bias. We assessed whether experts, blinded to the outcome, recognize (un)safety of triage of patients with chest discomfort, and we quantified inter-rater reliability., Study Design and Setting: This is a case-control study with triage recordings from 2013-2017 at OHS-PC. Cases were missed acute coronary syndromes (ACSs, considered as SAE). These cases were age- and gender-matched 1:8 with the controls, sampled from the remainder of people calling for chest discomfort. Fifteen experts listened to the recordings and rated the safety of triage. We calculated sensitivity and specificity of recognizing an ACS and the intraclass correlation., Results: In total, 135 calls (15 SAE, 120 matched controls) were relistened. The experts identified ACSs with a sensitivity of 0.86 (95% CI: 0.71-0.95) and a specificity of 0.51 (95% CI: 0.43-0.58). Cases were rated significantly more often as unsafe than the controls (73.3% vs. 22.5%, P < 0.001). The inter-rater reliability for safety was poor: ICC 0.16 (95% CI: 0.00-0.32)., Conclusions: Blinded experts rated calls of missed ACSs more often as unsafe than matched control calls, but with a low level of agreement among the experts., (Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.)

Objective: To determine the inter-rater reliability and validity of the Netherlands Triage Standard (NTS) for paediatric triage., Design: A cross-sectional study using fictional cases for telephone and physical triage., Method: An expert panel established in advance the urgency of 40 cases concerning emergency help requests from non-referred children (the reference standard). These requests were presented in an online survey to triagists from three general practitioner (GP) out-of-hours practices, three ambulance dispatching centres and three hospital emergency departments. Triagists assessed all cases, using the NTS. We determined the agreement on degrees of urgency between different triagists and compared them with the reference standard. The outcome measure for inter-rater reliability was the intraclass correlation coefficient (ICC). The outcome measures for validity were the degree of agreement with the reference standard, under-triage and over-triage, and sensitivity and specificity in identifying high-urgency (U0-U2) versus low-urgency cases (U30U5)., Results: In total, 116 triagists participated in the study (response: 86%). The ICC was 0.73 among all triagists, and was highest in the out-of-hours GP cooperatives. There was 62.3% agreement with the reference standard, 17.4% under-triage and 20.2% over-triage. Of the divergent urgencies, 77% differed by only one urgency category. The sensitivity was 85.2% and the specificity 89.7%. The sensitivity and specificity of triage by the GP out-of-hours practices (82.7% and 92.7%, respectively) were almost the same as that by the hospital emergency departments (79.6% and 92.5%, respectively). Triage by the ambulance dispatching centres had relatively high sensitivity (93%), but relatively low specificity (82.4%)., Conclusion: The results of the study contribute to the evidence that the NTS is a reliable and valid triage standard for paediatric patients. The urgency assessments by triagists in the GP out-of-hours practices, ambulance dispatching centres and hospital emergency departments were broadly in agreement. Results were limited by cases being on paper and triage only on anamnestic characteristics.

Background: To explore and compare safety, efficiency, and health-related quality of telephone triage in out-of-hours primary care (OOH-PC) services performed by general practitioners (GPs), nurses using a computerised decision support system (CDSS), or physicians with different medical specialities., Methods: Natural quasi-experimental cross-sectional study conducted in November and December 2016. We randomly selected 1294 audio-recorded telephone triage calls from two Danish OOH-PC services triaged by GPs (n = 423), nurses using CDSS (n = 430), or physicians with different medical specialities (n = 441). An assessment panel of 24 physicians used a validated assessment tool (Assessment of Quality in Telephone Triage - AQTT) to assess all telephone triage calls and measured health-related quality, safety, and efficiency of triage., Results: The relative risk (RR) of poor quality was significantly lower for nurses compared to GPs in four out of ten items regarding identifying and uncovering of problems. For most items, the quality tended to be lowest for physicians with different medical specialities. Compared to calls triaged by GPs (reference), the risk of clinically relevant undertriage was significantly lower for nurses, while physicians with different medical specialties had a similar risk (GP: 7.3%, nurse: 3.7%, physician: 6.1%). The risk of clinically relevant overtriage was significantly higher for nurses (9.1%) and physicians with different medical specialities (8.2%) compared to GPs (4.3%). GPs had significantly shorter calls (mean: 2 min 57 s, SD: 105 s) than nurses (mean: 4 min 44 s, SD: 168 s)., Conclusions: Our explorative study indicated that nurses using CDSS performed better than GPs in telephone triage on a large number of health-related items, had a lower level of clinically relevant undertriage, but were perceived less efficient. Calls triaged by physicians with different medical specialities were perceived less safe and less efficient compared to GPs. Differences in the organisation of telephone triage may influence the distribution of workload in primary and secondary OOH services. Future research could compare the long-term outcomes following a telephone call to OOH-PC related to safety and efficiency.

Objective: To develop a valid and reliable assessment tool able to measure quality of communication, patient safety and efficiency in out-of-hours (OOH) telephone triage conducted by both general practitioners (GP) and nurses., Design: The Dutch KERNset tool was translated into Danish and supplemented with items from other existing tools. Face validity, content validity and applicability in OOH telephone triage (OOH-TT) were secured through a two-round Delphi process involving relevant stakeholders. Forty-eight OOH patient contacts were assessed by 24 assessors in test-retest and inter-rater designs., Setting: OOH-TT services in Denmark conducted by GPs, nurses or doctors with varying medical specialisation., Patients: Audio-recorded OOH patient contacts., Main Outcome Measures: Test-retest and inter-rater reliability were analysed using ICC agreement , Fleiss' kappa and percent agreement., Results: Major adaptations during the Delphi process were made. The 24-item assessment tool (Assessment of Quality in Telephone Triage - AQTT) measured communicative quality, health-related quality and four overall quality aspects. The test-retest ICC agreement reliability was good for the overall quality of communication (0.85), health-related quality (0.83), patient safety (0.81) and efficiency (0.77) and satisfactory when assessing specific aspects. Inter-rater reliability revealed reduced reliability in ICC agreement and in Fleiss' kappa. Percent agreement revealed satisfactory agreements when differentiating between 'poor' and 'sufficient' quality)., Conclusion: The AQTT demonstrated high face, content and construct validity, satisfactory test-retest reliability, reduced inter-rater reliability, but satisfactory percent agreement when differentiating between 'poor' and 'sufficient' quality. The AQTT was found feasible and clinically relevant for assessing the quality of GP- and nurse-led OOH-TT. KEYPOINTS Comparative knowledge is sparse regarding quality of out-of-hours telephone triage conducted by general practitioners and nurses. The assessment tool (AQTT) enables assessment of quality in OOH telephone triage conducted by nurses and general practitioners AQTT is feasible and clinically relevant for assessment of communication, patient safety and efficiency. AQTT can be used to identify areas for improvement in telephone triage.

Background: Patient complaints can provide valuable insights into the quality and safety of clinical care. Studies examining the epidemiology of complaints in out-of-hours general practice internationally are limited., Aim: To characterise patient complaints in an out-of-hours general practice setting., Design and Setting: Retrospective cohort study of patient complaints to an out-of-hours service provider in Dublin, Ireland, over a 5-year period (2011-2016). This comprises nurse-led telephone triage and GP consultations for patients with urgent problems., Method: A modified version of the UK Healthcare Complaints Analysis Tool (HCAT) was utilised to code complaints, which were reviewed independently in duplicate by two academic GPs., Results: Of 445 598 telephone contacts, 303 085 resulted in face-to-face GP consultations. Of 234 patients who made 298 complaints, 185 (79%) related to GP care. The remainder related to nurse triage, other staff, and management issues. A total of 109 (46%) related to children aged ≤18 years, and 134 (58%) of complainants were female. There were 0.61 complaints per 1000 GP consultations. Most complaints ( n = 126, 42%) were in relation to clinical care problems, largely diagnosis and prescribing. Common themes included unmet management expectations and clinical examination dissatisfaction. Inter-rater reliability was 90% (κ statistic 0.84, 95% confidence interval = 0.80 to 0.88). Following internal investigation, 158 (85%) of GP-related complaints were managed effectively by the out-of-hours service., Conclusion: The majority of complaints related to clinical care problems and were successfully managed locally. Expectation management may be an important way to mitigate the risk of complaints., (© British Journal of General Practice 2018.)

Background: Telephone triage is a core but vulnerable part of the care process at out-of-hours general practitioner (GP) cooperatives. In the Netherlands, different instruments have been used for assessing the quality of telephone triage. These instruments focussed mainly on communicational aspects, and less on the medical quality of triage decisions. Our aim was to develop and test a minimum set of items to assess the quality of telephone triage., Methods: A national survey among all GP cooperatives in the Netherlands was performed to examine the most important aspects of telephone triage. Next, corresponding items from existing instruments were searched on these topics. Subsequently, an expert panel judged these items on importance, completeness and formulation. The concept KERNset consisted of 24 items about the telephone conversation: 13 medical, ten communicational and one regarding both types. It was pilot tested on measurement characteristics, reliability, validity and variation between triagists. In this pilot study, 114 anonymous calls from four GP cooperatives spread across the Netherlands were judged by three out of eight raters, both internal and external raters., Results: Cronbach's alpha was .94 for the medical items and .75 for the communicational items. Inter-rater reliability: complete agreement between the external raters was 45% and reasonable agreement 73% (difference of maximally one point on the five-point scale). Intra-rater reliability: complete agreement within raters was 55% and reasonable agreement 84%. There were hardly any differences between internal and external raters, but there were differences in strictness between individual raters. The construct validity was confirmed by the high correlation between the general impression of the call and the items of the KERNset. Of the differences within items 19% could be explained by differences between triage nurses, which means the KERNset is able to demonstrate differences between triage nurses., Conclusions: The KERNset can be used to assess the quality of telephone triage. The validity is good and differences between calls and between triage nurses can be measured. A more intensive training for raters could improve the reliability.

Background: In the UK, telephone triage in out-of-hours primary care is mostly managed by nurses, whereas GPs perform triage in Denmark., Aim: To describe telephone contacts triaged to face-to-face contacts, GP-assessed relevance, and factors associated with triage to face-to-face contact., Design and Setting: A prospective observational study in Danish out-of-hours primary care, conducted from June 2010 to May 2011., Method: Information on patients was collected from the electronic patient administration system and GPs completed electronic questionnaires about the contacts. The GPs conducting the face-to-face contacts assessed relevance of the triage to face-to-face contacts. The authors performed binomial regression analyses, calculating relative risk (RR) and 95% confidence intervals., Results: In total, 59.2% of calls ended with a telephone consultation. Factors associated with triage to a face-to-face contact were: patient age >40 years (40-64: RR = 1.13; >64: RR = 1.34), persisting problem for 12-24 hours (RR = 1.15), severe problem (RR = 2.60), potentially severe problem (RR = 5.81), and non-severe problem (RR = 2.23). Face-to-face contacts were assessed as irrelevant for 12.7% of clinic consultations and 11.7% of home visits. A statistically significantly higher risk of irrelevant face-to-face contact was found for a persisting problem of >24 hours (RR = 1.25), contact on weekday nights (RR = 1.25), and contact <2 hours before the patient's own GP's opening time (RR = 1.80)., Conclusion: Around 12% of all face-to-face consultations in the study are assessed as irrelevant by GP colleagues, suggesting that GP triage is efficient. Knowledge of the factors influencing triage can provide better education for GPs, but future studies are needed to investigate other quality aspects of GP telephone triage., (© British Journal of General Practice 2016.)

Objectives: Dutch primary out-of-hours care is provided by general practice cooperatives (GPCs). Although most GPCs use the same standardised triage system, differences between GPCs exist in the urgency assigned to patients' health problems. This cross-sectional study aims to provide insight into factors associated with the variation in assigned urgency between GPCs., Design and Methods: Data were derived from routine electronic health records of 895 253 patients who attended 17 GPCs in 2012. Patients' gender, age, travel distance to the GPC, and the use of a computer-based decision support system for triage were investigated as possibly affecting assigned urgency. Multilevel linear regression analyses were executed for the 3 most frequently presented health problems (cystitis/other urinary infection, laceration/cut and fever)., Results: Variation in urgency levels between GPCs was significant for the selected health problems (p=0.00). Assigned urgency was mainly related to patient gender and age. It was not associated with the use of a computer-based decision support system, or with travel distance to the GPC. Most variation in urgency (93.4-96.7%) could be ascribed to variation in patient characteristics., Conclusions: There is significant variation in urgency levels between GPCs, even for the same health problem. This variation is mainly associated with differences in characteristics of individuals contacting the GPCs, rather than with variables such as patients' travel distance or the use of a computer-based decision support system. Since patient characteristics are likely to affect patients' clinical need, our results are an indication of the adequate functioning of the triage system., (Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.)

We evaluated the quality of telephone triage and the appropriateness of the decisions resulting from it at a primary care out-of-hours service. Four simulated clinical cases were used in the Incognito Standardized Patient method: an adult with nosebleed, an adult with fever, a child with fever and a child with vomiting. There was a set of obligatory questions for each case, translated from those used in a previous study. Quality was assessed by the proportion of questions asked by the call-handlers during telephone triage versus those that should have been asked. A total of 22 out-of-hours doctors were involved in the study, working in two different locations in the Verona city area. Over a 4-month period each of the four simulated clinical cases was used five times in calls to the two centres involved. The proportion of obligatory questions asked compared to those expected to be asked was 27-36%. On three occasions out of the 40 simulations, all of which were considered to be manageable by telephone, the patient was advised to go to an outpatient clinic for a face-to-face evaluation. The average duration of the calls was 3 min 47 s. The quality of telephone triage in the regions studied was low and provided considerable room for improvement. This is relevant to patient safety and risk management of the service., (© The Author(s) 2015 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.)

Objective: To assess the safety and efficiency of triaging low urgent self-referred patients at the emergency department (ED) to a general practitioner (GP) based on the Manchester triage system (MTS)., Methods: All self-referred patients in the evening, night and weekends were included in this prospective observational study. Patients were triaged by an ED nurse according to the MTS and allocated to a GP or the ED according to a predefined care scheme. For patients treated by the GP, assessments were made of safety as measured by hospitalisation and return to the ED within 2 weeks, and efficiency as measured by referral to the ED., Results: In 80% of cases allocation of the self-referrals to the ED or GP was according to a predefined scheme. Of the 3129 low urgent self-referred patients triaged to the GP, 2840 (90.8%) were sent home, 202 (6.5%) were directly referred to the ED, 36 (1.2%) were hospitalised. Within a random sample of low urgent patients sent home by the GP (222 of 2840), 8 (3.6%) returned to the ED within 2 weeks. Against the agreed MTS scheme, the ED also directly treated 664 low urgent patients, mainly for extremity problems (n=512). Despite the care agreements, 227 urgent patients were treated by the GP, with a referral rate to the ED of 18.1%, a hospitalisation rate of 4.0% and a 4.5% return rate to the ED within 2 weeks., Conclusions: Low urgent self-referrals, with the exception of extremity problems, were shown to be treated efficiently and safely by a GP. A selected group of more urgent patients also seem to be handled adequately by the GP. Triage of low urgent patients with extremity problems and reasons for nurses not following a predefined triage allocation scheme need further elaboration.

Background: Triage at out-of-hours GP cooperatives (GPCs) is aimed at determining medical urgency and guiding decisions. Both medical knowledge and communication skills are required for this complex task., Objective: To explore the impact of quality of consultation and estimated urgency on the appropriateness of decisions., Methods: We performed a secondary analysis of telephone triage consultations by nurses at 29 Dutch GPCs. Consultations were taped and assessed by trained observers, using a validated instrument. Measures concerned quality of consultation, nurse-estimated urgency (four levels) and appropriateness of decisions (urgency, follow-up advice and timing). Bivariate analyses and logistic multilevel regression analyses were used to explore the impact of quality of consultation (controlling for urgency) on appropriateness of decisions., Results: The sample included 6739 telephone contacts, most of which (90%) were non-urgent. The majority of decisions were appropriate (91% for urgency, 96% for follow-up advice and 95% for timing). In bivariate analyses, appropriateness of decisions was positively related to higher quality of consultation. Estimated urgency was negatively associated with quality of consultation. Logistic multilevel analysis showed that higher quality of consultation was related to a more appropriate estimation of urgency [odds ratio (OR) = 1.82; 95% confidence interval (CI): 1.69-1.95], follow-up advice (OR = 2.69; 95% CI: 2.41-3.01) and timing of decisions (OR = 2.41; 95% CI: 2.20-2.63)., Conclusions: High quality of consultation has a positive, but small, impact on the appropriateness of decisions. Quality of consultation needs to be targeted in training and support of triage nurses, especially when it concerns highly urgent contacts.

Objective: Telephone triage in patients requesting help may compromise patient safety, particularly if urgency is underestimated and the patient is not seen by a physician. The aim was to assess the research evidence on safety of telephone triage in out-of-hours primary care., Methods: A systematic review was performed of published research on telephone triage in out-of-hours care, searching in PubMed and EMBASE up to March 2010. Studies were included if they concerned out-of-hours medical care and focused on telephone triage in patients with a first request for help. Study inclusion and data extraction were performed by two researchers independently. Post-hoc two types of studies were distinguished: observational studies in contacts with real patients (unselected and highly urgent contacts), and prospective observational studies using high-risk simulated patients (with a highly urgent health problem)., Results: Thirteen observational studies showed that on average triage was safe in 97% (95% CI 96.5-97.4%) of all patients contacting out-of-hours care and in 89% (95% CI 86.7-90.2%) of patients with high urgency. Ten studies that used high-risk simulated patients showed that on average 46% (95% CI 42.7-49.8%) were safe. Adverse events described in the studies included mortality (n = 6 studies), hospitalisations (n = 5), attendance at emergency department (n=1), and medical errors (n = 6)., Conclusions: There is room for improvement in safety of telephone triage in patients who present symptoms that are high risk. As these have a low incidence, recognition of these calls poses a challenge to health care providers in daily practice.

Background: several different models of out-of-hours primary care now exist in the UK. Important outcomes of care include users' satisfaction and enablement to manage their illness or condition, but the determinants of these outcomes in the unscheduled care domain are poorly understood. Aim. To identify predictors of user satisfaction and enablement across unscheduled care or GP out-of-hours service providers in Wales. The design of the study is a cross-sectional survey. The setting of the study is nine GP out-of-hours services, three Accident and Emergency units and an all Wales telephone advice service in Wales., Methods: postal survey using the Out-of-hours Patient Questionnaire. Logistic regression was used to fit both satisfaction and enablement models, based on demographic variables, service provider and treatment received and perceptions or ratings of the care process., Results: eight hundred and fifty-five of 3250 users responded (26% response rate, range across providers 14-41%, no evidence of non-response bias for age or gender). Treatment centre consultations were significantly associated with decreased patient satisfaction and decreased enablement compared with telephone advice. Delays in call answering or callback for triage and shorter consultations were significantly associated with lower satisfaction. Waiting more than a minute for initial call answering was associated with lower enablement., Conclusions: giving users more time to discuss their illness in consultations may enhance satisfaction and enablement but this may be resource intensive. More simple interventions to improve access by quicker response and triage, and keeping users informed of waiting times, could also serve to increase satisfaction and ultimately impact on their enablement.

Background: Several models of GP out-of-hours provision exist in the UK but there is little detail about their effectiveness to meet users' needs and expectations., Aim: To explore users' needs, expectations, and experiences of out-of-hours care, and to identify proposals for service redesign., Setting: Service providers in urban (GP cooperative), mixed (hospital based), rural (private) locations in Wales., Participants: Sixty recent service users or carers (20 in each location)., Method: Semi-structured telephone interviews; thematic analysis., Results: Users' concerns were generally consistent across the three different services. Efficiency was a major concern, with repetitive triage procedures and long time delays at various stages in the process being problematic. Access to a doctor when required was also important to users, who perceived an obstructive gatekeeping function of preliminary contacts. Expectations moderated the relationship between user concerns and satisfaction. Where expectations of outcome were unfulfilled, participants reported greater likelihood of reconsulting with the same or alternative services for the same illness episode. Accurate expectations concerning contacts with the next administrative, nursing, or medical staff professional were managed by appropriate information provision., Conclusion: Users require more streamlined and flexible triage systems. Their expectations need to be understood and incorporated into how services advise and provide services for users, and actively managed to meet the aims of both enhancing satisfaction and enabling users to cope with their condition. Better information and education about services are needed if users are to derive the greatest benefit and satisfaction. This may influence choices about using the most appropriate forms of care.

Objective: To assess the quality of communication skills of triagists, working at out-of-hours (OOH) centres, and to determine the correlation between the communication score and the duration of the telephone consultation., Methods: Telephone incognito standardised patients (TISPs) called 17 OOH centres presenting different clinical cases. The assessment of communication skills was carried out using the RICE-communication rating list. The duration of each telephone consultation was determined., Results: The mean overall score for communication skills was 35% of the maximum feasible. Triagists usually asked questions about the clinical situation correctly and little about the patients' personal situation, perception of the problem or expectation. Advice about the outcome of triage and self-care advice was usually given without checking for patients' understanding and acceptance of the advice. Calls were often handled in an unstructured way, without summarizing or clarifying the different steps within the consultation. There was a positive correlation of 0.86 (p<0.01) between the overall communication score and the duration of the telephone consultation., Conclusion: Assessment of communication skills of triagists revealed specific shortcomings and learning points to improve the quality of communication skills during telephone triage., Practice Implications: Training in telephone consultation should focus more on patient-centred communication with active listening, active advising and structuring the call. Apart from adequate communication skills, triagists need sufficient time for telephone consultation to enable high quality performance.

The establishment of the Grampians After-Hours Service has led to the development of a quality framework for nurse telephone triage. The service providers believe this framework is the basis for the service's success. While quality frameworks including critical evaluation and peer review are not new to the health industry, the development of organisational systems to improve quality in after-hours services is innovative. The framework developed is comprehensive, evidenced-based and emphasises training, protocols and documentation. It also involves a continuous and non-punitive quality review process that operates at the individual, small group, organisation and whole-system level. The framework will continue to improve and at this time provides a foundation for discussion and further application in the pursuit of quality improvement in rural after-hours health services.

Objective: To assess the quality of telephone triage by following the consecutive phases of its care process and the quality of the clinical questions asked about the patient's clinical condition, of the triage outcome, of the content of the home management advice, and of the safety net advice given at out of hours centres., Design: Cross sectional national study using telephone incognito standardised patients., Setting: The Netherlands., Participants: 17 out of hours centres., Main Outcome Measures: Percentages of clinical obligatory questions asked and items within home management and safety net advice, both in relation to pre-agreed standards, and of care advice given in relation to the required care advice., Results: The telephone incognito standardised patients presented seven clinical cases three times each over a period of 12 months, making a total of 357 calls. The mean percentage of obligatory questions asked compared with the standard was 21%. Answers to questions about the clinical condition were not always correctly evaluated from a clinical viewpoint, either by triagists or by general practitioners. The quality of information on home management and safety net advice varied, but it was consistently poor for all cases and for all out of hours centres. Triagists achieved the appropriate triage outcome in 58% of calls., Conclusion: In determining the outcome of the care process, triagists often reached a conclusion after asking a minimal number of questions. By analysing the quality of different phases within the process of telephone triage, evaluation of whether an appropriate triage outcome has been arrived at by means of good clinical reasoning or by an educated guess is possible. In terms of enhancing the overall clinical safety of telephone triage, apart from obtaining an appropriate clinical history, adequate home management and safety net advice must also be given.

Background: Most febrile children contacting a GP cooperative are seen by a GP, although the incidence of serious illness is low. The guidelines for triage might not be suitable in primary care., Aim: To investigate the determinants related to the outcome of triage in febrile children., Design of Study: Cross-sectional study., Setting: Dutch GP cooperative., Method: Receptionists filled out a triage questionnaire when parents called regarding their febrile child (aged between 3 months and 6 years) and estimated the level of concern of the parents. The outcome was either telephone advice, a consultation, or a home visit. Children were divided in subgroups based on age <18 months or > or = 18 months, and prognostic models for a consultation were constructed., Results: Of 422 children, 73% were seen by a GP. Children aged <18 months were more likely to be seen when their parents reported less drinking or shortness of breath. In children aged > or = 18 months, a duration of fever of > or = 3 days, drowsiness, or a pale, ashen, or mottled skin were predictors of consultation. Children with alarm symptoms were seen according to the guideline. In both subgroups, children without alarm symptoms were more likely to be seen when their parents were concerned., Conclusion: The available guideline was followed to a large extent at a GP cooperative. Because, surprisingly, most children were reported to have alarm symptoms, the validity of the triage questions asking parents about alarm symptoms is questionable.

Background: In recent years, there has been a growth in the use of triage nurses to decrease general practitioner (GP) workloads and increase the efficiency of telephone triage. The actual safety of decisions made by triage nurses has not yet been assessed., Objectives: To investigate whether triage nurses accurately estimate the urgency level of health complaints when using the national telephone guidelines, and to examine the relationship between the performance of triage nurses and their education and training., Method: A cross-sectional, multicentre, observational study employing five mystery (simulated) patients who telephoned triage nurses in four GP cooperatives. The mystery patients played standardised roles. Each role had one of four urgency levels as determined by experts. The triage nurses called were asked to estimate the level of urgency after the contact. This level of urgency was compared with a gold standard., Results: Triage nurses estimated the level of urgency of 69% of the 352 contacts correctly and underestimated the level of urgency of 19% of the contacts. The sensitivity and specificity of the urgency estimates provided by the triage nurses were found to be 0.76 and 0.95, respectively. The positive and negative predictive values of the urgency estimates were 0.83 and 0.93, respectively. A significant correlation was found between correct estimation of urgency and specific training on the use of the guidelines. The educational background (primary or secondary care) of the nurses had no significant relationship with the rate of underestimation., Conclusion: Telephone triage by triage nurses is efficient but possibly not safe, with potentially severe consequences for the patient. An educational programme for triage nurses is recommended. Also, a direct second safety check of all cases by a specially trained GP telephone doctor is advisable.

Objectives: To assess 1) parental opinion regarding appropriateness of triage, 2) utilization outcomes, and 3) the frequency of underreferral with subsequent hospitalization for children triaged by nurses at pediatric call centers., Design/methods: From August 19 to October 1999, after-hours calls were randomly sampled from computerized records at 4 call centers at children's hospitals. Telephone surveys were conducted 3 to 7 days after the index calls. An expert panel to assess appropriateness of disposition reviewed audio recordings of calls given a nonurgent disposition and then hospitalized within 24 hours., Results: Surveys were completed for 70.5% (N = 1561). Parental agreement with urgent or home care recommendations was >70% but with intermediary recommendations was <50%. Hospitalizations were more common among children urgently referred (4.6% vs 0.45%; P =.0003). Calls judged urgent by call center nurses and referred to a physician for secondary triage had lower rates of urgent visits (odds ratio [OR] 0.58; 95% confidence interval [CI] 0.53-0.65; P <.0001) and higher rates of never having a visit (OR 1.37; 95% CI 1.24-1.51; P <.0001) than those referred directly by nurses. The weighted rate of underreferral with hospitalization was 0.3% (95% CI 0.1-0.7%) or 1 in 481 calls (95% CI 1/152 to 1/1538)., Conclusions: Our data demonstrate an underreferral rate with subsequent hospitalization of 1 in 500 calls and a significant reduction in visits when those cases judged urgent by call center nurses undergo secondary triage by physicians.