Search

Objective: Root cause analyses of serious adverse events (SAE) in out-of-hours primary care (OHS-PC) often point to errors in telephone triage. Such analyses are, however, hampered by hindsight bias. We assessed whether experts, blinded to the outcome, recognize (un)safety of triage of patients with chest discomfort, and we quantified inter-rater reliability., Study Design and Setting: This is a case-control study with triage recordings from 2013-2017 at OHS-PC. Cases were missed acute coronary syndromes (ACSs, considered as SAE). These cases were age- and gender-matched 1:8 with the controls, sampled from the remainder of people calling for chest discomfort. Fifteen experts listened to the recordings and rated the safety of triage. We calculated sensitivity and specificity of recognizing an ACS and the intraclass correlation., Results: In total, 135 calls (15 SAE, 120 matched controls) were relistened. The experts identified ACSs with a sensitivity of 0.86 (95% CI: 0.71-0.95) and a specificity of 0.51 (95% CI: 0.43-0.58). Cases were rated significantly more often as unsafe than the controls (73.3% vs. 22.5%, P < 0.001). The inter-rater reliability for safety was poor: ICC 0.16 (95% CI: 0.00-0.32)., Conclusions: Blinded experts rated calls of missed ACSs more often as unsafe than matched control calls, but with a low level of agreement among the experts., (Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.)

Objective: To determine the inter-rater reliability and validity of the Netherlands Triage Standard (NTS) for paediatric triage., Design: A cross-sectional study using fictional cases for telephone and physical triage., Method: An expert panel established in advance the urgency of 40 cases concerning emergency help requests from non-referred children (the reference standard). These requests were presented in an online survey to triagists from three general practitioner (GP) out-of-hours practices, three ambulance dispatching centres and three hospital emergency departments. Triagists assessed all cases, using the NTS. We determined the agreement on degrees of urgency between different triagists and compared them with the reference standard. The outcome measure for inter-rater reliability was the intraclass correlation coefficient (ICC). The outcome measures for validity were the degree of agreement with the reference standard, under-triage and over-triage, and sensitivity and specificity in identifying high-urgency (U0-U2) versus low-urgency cases (U30U5)., Results: In total, 116 triagists participated in the study (response: 86%). The ICC was 0.73 among all triagists, and was highest in the out-of-hours GP cooperatives. There was 62.3% agreement with the reference standard, 17.4% under-triage and 20.2% over-triage. Of the divergent urgencies, 77% differed by only one urgency category. The sensitivity was 85.2% and the specificity 89.7%. The sensitivity and specificity of triage by the GP out-of-hours practices (82.7% and 92.7%, respectively) were almost the same as that by the hospital emergency departments (79.6% and 92.5%, respectively). Triage by the ambulance dispatching centres had relatively high sensitivity (93%), but relatively low specificity (82.4%)., Conclusion: The results of the study contribute to the evidence that the NTS is a reliable and valid triage standard for paediatric patients. The urgency assessments by triagists in the GP out-of-hours practices, ambulance dispatching centres and hospital emergency departments were broadly in agreement. Results were limited by cases being on paper and triage only on anamnestic characteristics.

Objectives: Dutch primary out-of-hours care is provided by general practice cooperatives (GPCs). Although most GPCs use the same standardised triage system, differences between GPCs exist in the urgency assigned to patients' health problems. This cross-sectional study aims to provide insight into factors associated with the variation in assigned urgency between GPCs., Design and Methods: Data were derived from routine electronic health records of 895 253 patients who attended 17 GPCs in 2012. Patients' gender, age, travel distance to the GPC, and the use of a computer-based decision support system for triage were investigated as possibly affecting assigned urgency. Multilevel linear regression analyses were executed for the 3 most frequently presented health problems (cystitis/other urinary infection, laceration/cut and fever)., Results: Variation in urgency levels between GPCs was significant for the selected health problems (p=0.00). Assigned urgency was mainly related to patient gender and age. It was not associated with the use of a computer-based decision support system, or with travel distance to the GPC. Most variation in urgency (93.4-96.7%) could be ascribed to variation in patient characteristics., Conclusions: There is significant variation in urgency levels between GPCs, even for the same health problem. This variation is mainly associated with differences in characteristics of individuals contacting the GPCs, rather than with variables such as patients' travel distance or the use of a computer-based decision support system. Since patient characteristics are likely to affect patients' clinical need, our results are an indication of the adequate functioning of the triage system., (Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.)

Background: European disease-specific antibiotic prescribing quality indicators (APQI) were proposed for seven acute indications (bronchitis, upper respiratory infection, cystitis, tonsillitis, sinusitis, otitis media and pneumonia): (a) the percentage of patients prescribed an antibiotic; (b) the percentage of patients receiving the guideline recommended antibiotic; (c) the percentage of patients receiving quinolones., Objectives: To assess the feasibility of calculating values for these 21 APQI using primary care databases; and to assess the quality of antibiotic prescribing in office hours and out-of-hours general practice., Methods: Data was extracted from a morbidity registration network ( http://www.intego.be ) and the out-of-hours service centre in Flanders. Within both databases diagnoses are labelled using the revised second edition of International Classification of Primary Care (ICPC-2-R) and antibiotic prescriptions using Anatomical Therapeutic Chemical (ATC) classification., Results: Both databases allow calculation of APQI values and results are similar. Only for cystitis was the percentage of patients prescribed an antibiotic within the proposed acceptable range. For all indications, the percentage of recommended antibiotics was below the proposed acceptable range (80-100%). The percentage of quinolones was within the proposed acceptable range (0-5%) for otitis media, upper respiratory infection and tonsillitis., Conclusion: Primary care databases can produce APQI values. These values revealed huge opportunities to improve the quality of antibiotic prescribing in office hours and out-of-hours Flemish general practice, especially the prescription of recommended antibiotics.

Background: This study aimed to perform a structural analysis of determinants of risk of critical incidents in care for women with a low risk profile at the start of pregnancy with a view on improving patient safety., Methods: We included 71 critical incidents in primary midwifery care and subsequent hospital care in case of referral after 36 weeks of pregnancy that were related to substandard care and for that reason were reported to the Health Care Inspectorate in The Netherlands in 36 months (n = 357). We performed a case-by-case analysis, using a previously validated instrument which covered five broad domains: healthcare organization, communication between healthcare providers, patient risk factors, clinical management, and clinical outcomes., Results: Determinants that were associated with risk concerned healthcare organization (n = 20 incidents), communication about treatment procedures (n = 39), referral processes (n = 19), risk assessment by telephone triage (n = 10), and clinical management in an out of hours setting (n = 19). The 71 critical incidents included three cases of maternal death, eight cases of severe maternal morbidity, 42 perinatal deaths and 12 critical incidents with severe morbidity for the child. Suboptimal prenatal risk assessment, a delay in availability of health care providers in urgent situations, miscommunication about treatment between care providers, and miscommunication with patients in situations with a language barrier were associated with safety risks., Conclusions: Systematic analysis of critical incidents improves insight in determinants of safety risk. The wide variety of determinants of risk of critical incidents implies that there is no single intervention to improve patient safety in the care for pregnant women with initially a low risk profile.

Objective: For over a decade, out-of-hours primary care in the Netherlands has been provided by general practitioner (GP) cooperatives. In the past years, quality improvements have been made and patients have become acquainted with the service. This may have increased patient satisfaction. The objective of this study was to examine changes in patient satisfaction with GP cooperatives over time., Design: Longitudinal observational study. A validated patient satisfaction questionnaire was distributed in 2003-2004 (T1) and 2007-2008 (T2). Items were rated on a scale from 0 to 10 (1 = very bad; 10 = excellent)., Setting: Eight GP cooperatives in the Netherlands., Subjects: Stratified sample of 9600 patients. Response was 55% at T1 (n = 2634) and 51% at T2 (n = 2462)., Main Outcome Measures: Expectations met; satisfaction with triage nurses, GPs, and organization., Results: For most patients the care received at the GP cooperative met their expectations (T1: 86.1% and T2: 88.4%). Patients were satisfied with the triage nurses (overall grade T1: 7.73 and T2: 7.99), GPs (T1: 8.04 and T2: 8.25), and organization (overall grade T1: 7.60 and T2: 7.78). Satisfaction with triage nurses showed the largest increase over time. The quality and effectiveness of advice or treatment were given relatively low grades. Of all organizational aspects, the lowest grades were given for waiting times and information about the cooperative., Conclusion: In general, patients were initially satisfied with GP cooperatives and satisfaction had even increased four years later. However, there is room for improvement in the content of the advice, waiting times, and information supply. More research is needed into satisfaction of specific patient groups.

Objective: To assess the safety and efficiency of triaging low urgent self-referred patients at the emergency department (ED) to a general practitioner (GP) based on the Manchester triage system (MTS)., Methods: All self-referred patients in the evening, night and weekends were included in this prospective observational study. Patients were triaged by an ED nurse according to the MTS and allocated to a GP or the ED according to a predefined care scheme. For patients treated by the GP, assessments were made of safety as measured by hospitalisation and return to the ED within 2 weeks, and efficiency as measured by referral to the ED., Results: In 80% of cases allocation of the self-referrals to the ED or GP was according to a predefined scheme. Of the 3129 low urgent self-referred patients triaged to the GP, 2840 (90.8%) were sent home, 202 (6.5%) were directly referred to the ED, 36 (1.2%) were hospitalised. Within a random sample of low urgent patients sent home by the GP (222 of 2840), 8 (3.6%) returned to the ED within 2 weeks. Against the agreed MTS scheme, the ED also directly treated 664 low urgent patients, mainly for extremity problems (n=512). Despite the care agreements, 227 urgent patients were treated by the GP, with a referral rate to the ED of 18.1%, a hospitalisation rate of 4.0% and a 4.5% return rate to the ED within 2 weeks., Conclusions: Low urgent self-referrals, with the exception of extremity problems, were shown to be treated efficiently and safely by a GP. A selected group of more urgent patients also seem to be handled adequately by the GP. Triage of low urgent patients with extremity problems and reasons for nurses not following a predefined triage allocation scheme need further elaboration.

Background: Triage at out-of-hours GP cooperatives (GPCs) is aimed at determining medical urgency and guiding decisions. Both medical knowledge and communication skills are required for this complex task., Objective: To explore the impact of quality of consultation and estimated urgency on the appropriateness of decisions., Methods: We performed a secondary analysis of telephone triage consultations by nurses at 29 Dutch GPCs. Consultations were taped and assessed by trained observers, using a validated instrument. Measures concerned quality of consultation, nurse-estimated urgency (four levels) and appropriateness of decisions (urgency, follow-up advice and timing). Bivariate analyses and logistic multilevel regression analyses were used to explore the impact of quality of consultation (controlling for urgency) on appropriateness of decisions., Results: The sample included 6739 telephone contacts, most of which (90%) were non-urgent. The majority of decisions were appropriate (91% for urgency, 96% for follow-up advice and 95% for timing). In bivariate analyses, appropriateness of decisions was positively related to higher quality of consultation. Estimated urgency was negatively associated with quality of consultation. Logistic multilevel analysis showed that higher quality of consultation was related to a more appropriate estimation of urgency [odds ratio (OR) = 1.82; 95% confidence interval (CI): 1.69-1.95], follow-up advice (OR = 2.69; 95% CI: 2.41-3.01) and timing of decisions (OR = 2.41; 95% CI: 2.20-2.63)., Conclusions: High quality of consultation has a positive, but small, impact on the appropriateness of decisions. Quality of consultation needs to be targeted in training and support of triage nurses, especially when it concerns highly urgent contacts.

Background: In the Netherlands, out-of-hours primary care has been re-organized from small on-call rota groups to large-scale GP co-operatives. However, out-of-hours palliative care is an area of concern. According to studies in the UK, the transfer of information about terminally ill patients to GP co-operatives seems to be poor, resulting in care that is often inadequate. Our aim was to investigate the experiences of GPs in the Netherlands about the quality of out-of-hours palliative care provided by GP co-operatives, and to identify elements of care that might need to be improved., Setting: General practice., Design: Qualitative study, using three focus group discussions, analysed in a qualitative descriptive approach., Results: GPs participating in the focus groups, considered the quality of out-of-hours palliative care that is provided by GP co-operatives to be meagre. The service provided by the co-operatives was designed for acute medical problems, rather than for palliative care needs. The GPs reported three major problems: ( 1 ) lack of adequate information at the GP out-of-hours service; ( 2 ) lack of anticipatory care during office hours; and ( 3 ) absence of a palliative care policy in the GP co-operatives., Conclusions: Although GP co-operatives are capable of providing continuity in palliative care, improvements could be achieved if GPs and GP co-operatives address the problems mentioned above.

Many Western countries are seeking an organizational model for after-hours primary care that is safe, efficient, and satisfactory for patients and health care professionals. Around the year 2000, Dutch primary care physicians (PCPs) reorganized their after-hours primary care and shifted from small rotation groups to large-scale PCP cooperatives. This article provides a narrative review of studies on a range of issues about after-hours primary care in the Netherlands, including experiences of health care professionals and patients, patient-safety incidents, adherence to practice guidelines, waiting times, and quality of telephone triage. Physicians expressed high satisfaction with PCP cooperatives; their workload decreased, and job satisfaction increased compared with the situation before the reorganization. In general, patients were also satisfied, but areas for improvement included telephone consultations, patient education, and distance to a pharmacy. A study identified patient-safety incidents in 2.4% of all contacts, of which most did not result in harm to patients. The average adherence to clinical guidelines by physicians was 77%, with lowest adherence scores for prescribing antibiotics and treatment in emergency cases. The average waiting time for home visits was 30 minutes. Seventy percent of patients with life-threatening problems were visited within the time target of 15 minutes. Telephone triage by nurses had positive effects on care efficiency by increasing the proportion of telephone consultations and decreasing the proportion of clinic consultations and home visits. The after-hours primary care system in the Netherlands might set an example for other countries struggling to find a good solution for the problems they encounter with after-hours primary care. Future developments in the Netherlands include integration and extensive collaboration with the accident and emergency departments of hospitals, in which PCPs take care of self-referring patients.

Objective: To assess the quality of after-hours clinical care as delivered by general practitioner (GP) cooperatives in The Netherlands., Methods: A cross-sectional analysis was undertaken of patient health records of five GP cooperatives during 1 year. We used quality indicators derived from national guidelines for the appropriate prescription of pain medication and antibiotics, clinical performance in emergency cases and referral to medical specialists. Data were collected from electronic health records., Results: We analysed 7660 patient contacts. Average adherence to the guidelines was 77%. The guidelines on referrals to medical specialists and prescription of pain medication had the highest adherence scores (92% and 90%, respectively). Prescribing antibiotics and treatment in emergency cases had the lowest scores (69% and 71%, respectively). Antibiotics were overprescribed in 42% of the cases and underprescribed in 21%., Conclusions: In general, GPs adhered well to after-hours service national guidelines. There is room for improvement in care for people with acute illnesses and in the prescription of antibiotics.

Background: Most patients receive healthcare in primary care settings, but relatively little is known about patient safety. Out-of-hours contacts are of particular importance to patient safety. Our aim was to examine the incidence, types, causes, and consequences of patient safety incidents at general practice cooperatives for out-of-hours primary care and to examine which factors were associated with the occurrence of patient safety incidents., Methods: A retrospective study of 1,145 medical records concerning patient contacts with four general practice cooperatives. Reviewers identified records with evidence of a potential patient safety incident; a physician panel determined whether a patient safety incident had indeed occurred. In addition, the panel determined the type, causes, and consequences of the incidents. Factors associated with incidents were examined in a random coefficient logistic regression analysis., Results: In 1,145 patient records, 27 patient safety incidents were identified, an incident rate of 2.4% (95% CI: 1.5% to 3.2%). The most frequent incident type was treatment (56%). All incidents had at least partly been caused by failures in clinical reasoning. The majority of incidents did not result in patient harm (70%). Eight incidents had consequences for the patient, such as additional interventions or hospitalisation. The panel assessed that most incidents were unlikely to result in patient harm in the long term (89%). Logistic regression analysis showed that age was significantly related to incident occurrence: the likelihood of an incident increased with 1.03 for each year increase in age (95% CI: 1.01 to 1.04)., Conclusion: Patient safety incidents occur in out-of-hours primary care, but most do not result in harm to patients. As clinical reasoning played an important part in these incidents, a better understanding of clinical reasoning and guideline adherence at GP cooperatives could contribute to patient safety.

Objective: To assess the quality of communication skills of triagists, working at out-of-hours (OOH) centres, and to determine the correlation between the communication score and the duration of the telephone consultation., Methods: Telephone incognito standardised patients (TISPs) called 17 OOH centres presenting different clinical cases. The assessment of communication skills was carried out using the RICE-communication rating list. The duration of each telephone consultation was determined., Results: The mean overall score for communication skills was 35% of the maximum feasible. Triagists usually asked questions about the clinical situation correctly and little about the patients' personal situation, perception of the problem or expectation. Advice about the outcome of triage and self-care advice was usually given without checking for patients' understanding and acceptance of the advice. Calls were often handled in an unstructured way, without summarizing or clarifying the different steps within the consultation. There was a positive correlation of 0.86 (p<0.01) between the overall communication score and the duration of the telephone consultation., Conclusion: Assessment of communication skills of triagists revealed specific shortcomings and learning points to improve the quality of communication skills during telephone triage., Practice Implications: Training in telephone consultation should focus more on patient-centred communication with active listening, active advising and structuring the call. Apart from adequate communication skills, triagists need sufficient time for telephone consultation to enable high quality performance.

Objective: To assess the quality of telephone triage by following the consecutive phases of its care process and the quality of the clinical questions asked about the patient's clinical condition, of the triage outcome, of the content of the home management advice, and of the safety net advice given at out of hours centres., Design: Cross sectional national study using telephone incognito standardised patients., Setting: The Netherlands., Participants: 17 out of hours centres., Main Outcome Measures: Percentages of clinical obligatory questions asked and items within home management and safety net advice, both in relation to pre-agreed standards, and of care advice given in relation to the required care advice., Results: The telephone incognito standardised patients presented seven clinical cases three times each over a period of 12 months, making a total of 357 calls. The mean percentage of obligatory questions asked compared with the standard was 21%. Answers to questions about the clinical condition were not always correctly evaluated from a clinical viewpoint, either by triagists or by general practitioners. The quality of information on home management and safety net advice varied, but it was consistently poor for all cases and for all out of hours centres. Triagists achieved the appropriate triage outcome in 58% of calls., Conclusion: In determining the outcome of the care process, triagists often reached a conclusion after asking a minimal number of questions. By analysing the quality of different phases within the process of telephone triage, evaluation of whether an appropriate triage outcome has been arrived at by means of good clinical reasoning or by an educated guess is possible. In terms of enhancing the overall clinical safety of telephone triage, apart from obtaining an appropriate clinical history, adequate home management and safety net advice must also be given.

Background: Most febrile children contacting a GP cooperative are seen by a GP, although the incidence of serious illness is low. The guidelines for triage might not be suitable in primary care., Aim: To investigate the determinants related to the outcome of triage in febrile children., Design of Study: Cross-sectional study., Setting: Dutch GP cooperative., Method: Receptionists filled out a triage questionnaire when parents called regarding their febrile child (aged between 3 months and 6 years) and estimated the level of concern of the parents. The outcome was either telephone advice, a consultation, or a home visit. Children were divided in subgroups based on age <18 months or > or = 18 months, and prognostic models for a consultation were constructed., Results: Of 422 children, 73% were seen by a GP. Children aged <18 months were more likely to be seen when their parents reported less drinking or shortness of breath. In children aged > or = 18 months, a duration of fever of > or = 3 days, drowsiness, or a pale, ashen, or mottled skin were predictors of consultation. Children with alarm symptoms were seen according to the guideline. In both subgroups, children without alarm symptoms were more likely to be seen when their parents were concerned., Conclusion: The available guideline was followed to a large extent at a GP cooperative. Because, surprisingly, most children were reported to have alarm symptoms, the validity of the triage questions asking parents about alarm symptoms is questionable.

Background: Dutch general practitioners have reorganized their out-of-hours primary health care to general practice cooperatives. Good insight into the quality of delivered medical care is important to make the accountability of health practitioners and managers transparent to society and to identify and minimize medical errors., Objective: Development of a set of quality indicators for internal quality improvement in out-of-hours primary clinical care., Method: A systematic approach combining the opinion of three different general practitioner expert panels, and an empirical test in daily practice. The indicators were based on clinical, evidence-based, national guidelines. We tested the validity, feasibility, reliability and opportunity for quality improvement., Results: Of the 80 available national clinical guidelines, 29 were approved and selected by the first general practitioner expert panel. Out of these 29 guidelines, 73 indicators concerning prescribing and referring were selected by the second panel. In an empirical test on 36 254 patient contacts, 7344 patient contacts (22.7%) were relevant for the assessment of these 73 indicators. Six indicators were excluded because they scored more than 15% missing values. In total, 38 indicators were excluded because the opportunity for quality improvement was limited (performance score > or =90%). In the final meeting, the third general practitioner expert panel excluded five indicators, leading to a final set of 24 indicators., Conclusion: This study shows the importance of subjecting indicators to an empirical test in practice. The national clinical guidelines are only partially applicable in the assessment of out-of-hours primary care. They need to be expanded with topics that are related to general practitioner care in an out-of-hours setting and acute medical problems.

Background: In recent years, there has been a growth in the use of triage nurses to decrease general practitioner (GP) workloads and increase the efficiency of telephone triage. The actual safety of decisions made by triage nurses has not yet been assessed., Objectives: To investigate whether triage nurses accurately estimate the urgency level of health complaints when using the national telephone guidelines, and to examine the relationship between the performance of triage nurses and their education and training., Method: A cross-sectional, multicentre, observational study employing five mystery (simulated) patients who telephoned triage nurses in four GP cooperatives. The mystery patients played standardised roles. Each role had one of four urgency levels as determined by experts. The triage nurses called were asked to estimate the level of urgency after the contact. This level of urgency was compared with a gold standard., Results: Triage nurses estimated the level of urgency of 69% of the 352 contacts correctly and underestimated the level of urgency of 19% of the contacts. The sensitivity and specificity of the urgency estimates provided by the triage nurses were found to be 0.76 and 0.95, respectively. The positive and negative predictive values of the urgency estimates were 0.83 and 0.93, respectively. A significant correlation was found between correct estimation of urgency and specific training on the use of the guidelines. The educational background (primary or secondary care) of the nurses had no significant relationship with the rate of underestimation., Conclusion: Telephone triage by triage nurses is efficient but possibly not safe, with potentially severe consequences for the patient. An educational programme for triage nurses is recommended. Also, a direct second safety check of all cases by a specially trained GP telephone doctor is advisable.

Background: Out-of-hours centres provide telephone support to patients with medical problems. In most of these centres specially-trained nurses handle incoming telephone calls. They assess patients' needs, the degree of urgency, and determine the level of care required. Assessment of the medical problem and the quality of 'care-by-phone' depend on the medical and communication skills of the call handlers., Aim: To develop a valid, reliable, and practical rating scale to evaluate the communication skills of call handlers working at an out-of-hours centre and to improve quality of communication., Design of Study: Qualitative study with focus groups followed by validation of the rating scale and measurement of reliability (internal consistency)., Setting: Out-of-hours centres in the Netherlands., Method: A focus group developed the rating scale. Experts with experience in training and evaluating communication skills of medical students and GPs commented on the scale to ensure content validity. The reliability of the rating scale was tested in a pilot in which ten specially-trained assessors scored six telephone calls each., Results: The scale, known as the RICE rating scale, has 17 items divided over four different phases of the telephone consultation: Reason for calling; Information gathering; Conclusion; and Evaluation (RICE). Content validity of the scale was assessed by two experts. Reliability of the scale tested in the pilot was 0.73 (Cronbach's alpha)., Conclusion: Establishing a rating scale to assess the communication skills of call handlers which meets common scientific demands, such as content validity and reliability, proved successful. This instrument can be used to give feedback to call handlers.

Objective: The shift towards large-scale organization of out-of-hours primary healthcare in different western countries has created an important role for the nurse telephone consultation. We explored the association between negative patient evaluation of nurse telephone consultations and characteristics of patients and GP cooperatives., Methods: A cross-sectional study using postal patient questionnaires sent to patients receiving a nurse telephone consultation from one of 26 GP cooperatives in the Netherlands., Results: The total response was 49.3% (2583/5239). Negative evaluations were most frequently encountered for the general information received on the GP cooperative (35%). When patients expected a centre consultation or home visit, but only received a nurse telephone consultation, they were more negative about the accessibility (OR 1.7, CI 1.4-2.1) and nurse telephone consultation (OR 4.2, CI 3.2-5.6). In the presence of a special supervising telephone doctor at the cooperative's call centre, nurse telephone consultation was evaluated significantly less negative (OR 0.4, CI 0.2-0.8)., Conclusion: Expectation of care mode was most strongly associated with a negative evaluation of nurse telephone consultation. The presence of a supervising telephone doctor may lead to a better evaluation of nurse telephone consultations., Practice Implications: More attention should be paid to the provision of patient information on the GP cooperative and discrepancies between the care expected and the care offered.

There are indications that after-hours care in some countries is of poor quality. European after-hours care is shifting away from individual and group practices with local after-hours call schedules toward large-scale after-hours care services. Experiences with primary care cooperatives in three countries show that this model can lighten physicians' workloads, reduce the number of face-to-face contacts, reduce use of emergency services and hospital admissions, and lower costs. Most patients accept these new models but are dissatisfied if they expect to see a physician. Local or regional integration of all emergency services seems to be the most promising model for after-hours care.

Background: Since the turn of the millennium, out-of-hours primary health care in The Netherlands has faced a substantial change from small locum groups towards large GP cooperatives. Improving the quality of care requires evaluation of patient satisfaction., Objective: To develop a reliable postal questionnaire for wide-scale use by patients contacting their out-of-hours GP cooperative and to present the results of a national survey., Methods: Literature review and interviews with both patients and health carers were carried out to identify issues of potential relevance, followed by two postal pilot studies and additional interviews to remove or rephrase items. Finally, postal questionnaires were sent to 14,400 people who contacted one of 24 GP cooperatives in The Netherlands., Results: Overall response was 52.2% for all types of contact. Three scales were identified prior to the field phase and confirmed by principal components analysis: telephone nurse, doctor and organization. Reliability was high, with Cronbach's alphas and intraclass correlation coefficients exceeding 0.70 for all scales. Only items in the organization scale showed clear differences among the participating cooperatives. Respondents receiving telephone advice showed lower levels of satisfaction than respondents with other types of contact (P < 0.001); centre consultation scored lower than home visit (P < 0.030 or less for all differences)., Conclusion: A reliable measure of patient satisfaction has been developed that can also be used for the comparison of GP cooperatives on an organizational level. Overall satisfaction was high, showing highest levels for home visit and lowest levels for telephone advice.

Background: In recent years out-of-hours primary care in the Netherlands has changed from practice-based to large-scale cooperatives. The purpose of this study is to determine patient satisfaction with current out-of-hours care organised in general practitioner (GP) cooperatives, and gain insight in factors associated with this satisfaction., Methods: From March to June 2003, 2805 questionnaires were sent to patients within three weeks after they had contacted the GP cooperative in their region. The study was conducted in the province of Limburg in the South of the Netherlands. One-third of these questionnaires was sent to patients who had only received telephone advice, one-third to patients who attended the GP cooperative for consultation, and one-third to patients who received a home visit. Four weeks after the first reminder, a non-respondents telephone interview was performed among a random sample of 100 patients. Analyses were performed with respect to the type of consultation., Results: The total response was 42.4% (1160/2733). Sixty-seven percent of patients who received telephone advice only reported to be satisfied with out-of-hours care. About 80% of patients who went to the GP cooperative for consultation or those receiving a home visit, reported to be satisfied. Factors that were strongly associated with overall satisfaction included, the doctor's assistant's attitude on the phone, opinion on GP's treatment, and waiting time., Conclusion: Patients seem generally satisfied with out-of-hours primary care as organised in GP cooperatives. However, patients who received telephone advice only are less satisfied compared to those who attended the GP cooperative or those who received a home visit.