NHS Direct versus general practice based triage for same day appointments in primary care: cluster randomised controlled trial
BMJ 2004; 329 doi: https://doi.org/10.1136/bmj.38226.605995.55 (Published 30 September 2004) Cite this as: BMJ 2004;329:774
- David A Richards, professor of mental health (dr17{at}york.ac.uk)1,
- Lesley Godfrey, general practitioner2,
- Jane Tawfik, nursing team leader2,
- Mike Ryan, deputy director nursing services3,
- Joan Meakins, general practitioner2,
- Evelyn Dutton, research administrator2,
- Jeremy Miles, lecturer in biostatistics1
- 1 Department of Health Sciences, University of York, Heslington, York YO10 5DD
- 2 Priory Medical Centre, Cornlands Road, Acomb, York YO24 3WX
- 3 Tees East and North Yorkshire Ambulance Service, TENYAS NHS Direct, Willerby, Hull HU10 6HD
- Correspondence to: D A Richards
- Accepted 12 August 2004
Abstract
Objective To assess the relative effects on consultation workload and costs of off-site triage by NHS Direct for patients requesting same day appointments compared with usual on-site nurse telephone triage in general practice.
Design Cluster randomised controlled trial.
Setting Three primary care sites in York, England.
Participants 4703 patients: 2452 with practice based triage, 2251 with NHS Direct triage. All consecutive patients making requests for same day appointments during study weeks were eligible for the trial.
Main outcome measures Type of consultation after request for same day appointment (telephone, appointment, or visit); time taken for consultation; service use during the month after same day contact; costs of same day, follow up, and emergency care.
Results Patients in the NHS Direct group were less likely to have their call resolved by a nurse and were more likely to have an appointment with a general practitioner. Mean total time per patient in the NHS Direct group was 7.62 minutes longer than in the practice based group. Costs were greater in the NHS Direct group—£2.88 (£0.88 to £4.87) per patient triaged—as a result of the difference between the groups in proportions of patients at each final point contact after triage.
Conclusions External management of requests for same day appointments by nurse telephone triage through NHS Direct is possible but comes at a higher cost than practice nurse delivered triage in primary care. If NHS Direct could achieve the same proportions of consultation types as practice based triage, costs would be comparable.
Introduction
Use of nurses to manage requests for same day appointments in primary care over the telephone is a popular system for managing general practitioners' workload.1 Triage has been shown to be safe in out of hours services2 and to reduce general practitioners' same day appointment workload by up to 49% in routine practice.3–6 Triage is not cheaper than standard appointment systems,6 and many general practices may be unable to employ the critical mass of nurses needed to deliver a comprehensive service. One solution may be for an external agency such as NHS Direct to provide triage services to practices.7
NHS Direct is a direct access health advice line. Nurse advisers use computerised decision support systems to advise callers. Having previously shown that telephone triage by practice nurses within general practice reduces same day appointments with general practitioners,6 we wanted to investigate the effectiveness and costs of delivering an off-site telephone triage service in order to determine if off-site triage is a feasible option for primary care. Our aim was to determine the relative effects on consultation workload and costs by conducting a randomised controlled trial of NHS Direct delivered telephone triage for patients requesting same day appointments compared with usual practice based triage.
Methods
The study took place in a general practice in York with six surgery sites, a list size of 32 000 patients, 15 general practitioners (12.5 whole time equivalents), four assistants (three whole time equivalents), and a nursing team of one full time nurse team leader and nine practice nurses (4.5 whole time equivalents). The practice population had a slightly poorer standardised mortality ratio, higher unemployment, and more pensionable residents than the regional average. Three of the practice's surgery sites participated in the study, giving a study population of 17 000. The practice operated a nurse telephone triage system as part of its usual care of patients requesting same day appointments.
Assignment
We randomised patients to practice based or NHS Direct triage by using an independently determined two week block randomisation procedure over 26 weeks, 13 weeks for each condition, to ensure that no more than two weeks of triage in one condition occurred together. We collected data on all patients requesting same day appointments between 8.30 am and 5.00 pm, Monday to Friday.
Protocol
Patients were informed about the trial when calling for a same day appointment, and reception staff sought their consent. Consent from patients randomised to NHS Direct was further confirmed by nurse advisers. Patients not consenting to be triaged by NHS Direct were triaged by practice nurses in accordance with the practice's usual clinical procedures. It was not possible to blind patients and clinical staff to group allocation, as triage was provided by different nurses in each condition.
Interventions
Usual care: practice based triage—Patients calling for same day appointments were identified on the electronic patient record by use of a predetermined code. An experienced and trained practice nurse telephoned the patient and used clinical judgment to triage the patient, supported by several clinical protocols on the patient record system. Computerised algorithms were not used. Nurses could manage patients through telephone support alone or could refer them for a telephone call from a general practitioner, same day appointment with a nurse or general practitioner, home visit, or routine appointment with a nurse or general practitioner. Individual nurses triaged patients across all three sites. Nurses did not prescribe drugs.
NHS Direct triage—NHS Direct nurse advisers had access to the practice's electronic appointment system but did not access the patients' personal or medical histories. Nurse advisers, all trained to triage, retrieved same day requests and, using NHS Direct computerised decision making algorithms, telephoned the patient and triaged them to one of the same management options as above.
We conducted a six week pilot project before the trial to test the information technology systems and data collection processes for the trial.
Participant flow and follow up
We collected demographic information from the electronic patient record on patients requesting same day appointments. Nurses and doctors involved in the same day care of each patient recorded in diaries a maximum of three presenting problems from a list of 10 (table 1). NHS Direct nurse advisers completed a standard report containing the same information printed automatically from the decision support software. Consultation time was recorded automatically by the NHS Direct system and with stopwatches by the practice based nurses and doctors. We subtracted one minute from the recorded time of the NHS Direct nurse adviser to account for additional time needed to reconfirm consent. We validated diaries and records against the electronic patient record and NHS Direct consultation printouts.
Demographic information and presenting complaints of patients requesting same day appointments, by NHS Direct or practice triage. Values are numbers (percentages) of patients unless stated otherwise
We calculated costs at the level of the patient, including the direct costs of all staff, drugs, tests, and out of hours and emergency department contacts (collected automatically from hospital returns) for one month after the index consultation. We calculated staff costs by using current salary scales multiplied by consultation time. We calculated nurse costs on mid-range salary scales operating at 1 April 2001 to reflect a 37 hour week, 42 weeks a year. NHS Direct nurse advisers are employed on UK nurse salary grade F and practice nurses on grade G. We calculated follow up costs by using average consultation times, as follow up activity was not timed. We calculated drug costs from the British National Formulary and obtained costs of tests and emergency care from the local service provider.
Analysis
We analysed data on all patients on an intention to treat basis, excluding only patients who could not be contacted by nurses after a call and for whom we had no data. As patients were randomised at the cluster level of the week rather than individually, we aggregated across weeks to create two groups containing 13 weeks each. We determined the effect of the different methods of triage by calculating the percentage of patients at each final point of contact and using repeated measures analysis of variance, incorporating group as a between subjects variable, to examine the interaction effect of group and destination. We entered week as a covariate to control for any trend in change over time. We calculated 95% confidence intervals for mean differences between the groups. We used a multilevel Poisson regression, with weeks defining the level 2 clusters, to analyse the number of additional consultations. We calculated cost data for individual patients by summating all healthcare costs on the day of the index consultation and for one month after. We then aggregated these by using the mean, to the week level. We calculated sample means and standard deviations to compare mean differences for each cost category between the groups, controlling for week number alone, and then again for the percentage of patients ending at each final point of contact in that week. If the first test is statistically significant and the second is not, this would suggest that the difference in costs between the groups is entirely mediated by the final destination.8
Results
A total of 4788 patients requested same day appointments during the trial period (fig). Seventy patients declined to participate, 68 in the NHS Direct arm and two in the usual care arm. Fifteen patients could not be contacted after their request for an appointment, leaving 4703 patients for whom we have data in the study, 2452 in the usual care group and 2251 in the NHS Direct group. The groups were equivalent in terms of age, sex, and number and type of presenting complaints, apart from more patients in the practice group with genitourinary complaints (table 1).
In the NHS Direct weeks the mean number of patients was 173.8 (SD 26.2, minimum 119, maximum 220); in the practice weeks the mean was 189.0 (SD 32.1, minimum 140, maximum 250). A repeated measures analysis of variance gave a Greenhouse-Geisser corrected F of 7.1 (df = 2.7, 62.3; P = 0.001) for the interaction effect of group and final point of contact. Patients in the NHS Direct group were less likely to have their call resolved by a telephone contact or appointment with a nurse and were more likely to have an appointment with a general practitioner (table 2).
Final point of contact for patients requesting same day appointments triaged by NHS Direct or practice. Values are numbers (percentages) unless stated otherwise
Time taken to manage same day requests
We found a significant difference in average nursing time between NHS Direct and practice triage; NHS Direct took 6.9 minutes longer to triage patients (table 3). When we controlled statistically for final destinations, the difference remained significant at 7.5 minutes. The average amount of general practitioner's time per patient was greater for NHS Direct patients (0.7 minutes), but when we controlled for final destinations the difference was no longer significant (0.2 minutes). The total time needed to manage patients' requests was dominated by nursing time, which is reflected in the average total time difference of 7.6 minutes, or 7.7 minutes when we controlled for final destination.
Mean (SD) nursing time, general practitioners' time, and total time per patient after triage by NHS Direct or practice
Follow up care one month after same day appointment
We found no differences between the groups in the number of patients receiving further practice based care, out of hours care, or emergency services within one month of the index consultation (table 4).
Results of Poisson regression of number of practice based, emergency department, and out of hours consultations within one month for patients managed by NHS Direct or practice triage
Costs
Same day costs for general practitioners and nurses were greater in the NHS Direct group, leading to an overall mean cost difference of £2.88 ($5.16; €4.23) per patient triaged (table 5). We found no differences in other practice based costs (general practitioner and nurse follow up time, drugs, and tests), out of hours costs, or emergency department costs. When we controlled for final point of contact, the difference in nurse costs remained greater for NHS Direct but the total cost (£1.50) was no longer significantly different. When we increased the unit costs of general practitioners' and nurses' salaries by including training costs as well as salary costs, the total costs remained different (mean difference £4.15, 95% confidence interval £2.00 to £6.36; P = 0.001), but this was not the case once we had controlled for final point of contact (£2.71, - £0.66 to £6.08; P = 0.108). In a final sensitivity analysis, we reduced NHS Direct nurse time by half a standard deviation, which left nurse costs still significantly different (£0.49, £0.35 to £0.63; P < 0.001) but reduced the overall cost difference to just under the 0.05 significance level (£1.86, - £0.86 to £3.87; P = 0.07). Using these reduced figures and controlling for final point of contact resulted in nurse costs remaining greater for NHS Direct (£0.61, £0.43 to £0.79; P < 0.001) but no difference in the total costs (£0.44, - £2.66 to £3.54; P = 0.77).
Difference in costs of care for NHS Direct and practice triage—costs on day plus total costs incurred one month after request for same day appointment
Discussion
This study's findings, that telephone triage by NHS Direct took longer and was more costly than the usual practice based triage procedure, are accounted for by two factors. Firstly, NHS Direct nurse advisers managed fewer calls by telephone care by nurses alone, made fewer referrals to appointments with nurses, and referred more patients to general practitioners. Secondly, nurse time was more than 2.5 times greater for the NHS Direct group, leading to a greater overall patient management time. Despite nurses being employed at a lower grade, same day costs of nursing care in the NHS Direct group were about 11% of total costs compared with 6% in the practice group. Costs were more sensitive to the proportions of patients at each final point of contact than to nursing costs.
Several possible explanations for these results exist. Unlike practice nurses, NHS Direct advisers were not able to use previous knowledge of patients to speed decision making. However, the practice nurses rotate around our sites and also may not have had knowledge of patients. Although they do have access to patients' records and reported sometimes using these to assist decision making, this is unlikely to be the sole reason for our results. Other explanations include the fact that NHS Direct uses sophisticated but lengthy algorithm based decision support software that nurse advisers must work through fully; that most nurse advisers have never worked in general practice and will be unfamiliar with practice nursing; and that practice nurses delivering triage are the same nurses who subsequently see patients face to face and will have a greater sense of their own competence in consultations.
If NHS Direct were to increase the number of patients who receive nurse only care up to the levels achieved by the practice, costs would not be different from practice based triage, despite the longer time taken by nurse advisers to work through clinical algorithms. In contrast, nurse time in NHS Direct would need to be reduced by almost 40% before costs would become barely comparable. Although the algorithm approach may be more likely to lead to safer decision making, we found no evidence that patients used more out of hours, emergency department, or practice based follow up resources in either group. Previous research has found that telephone triage by nurses is a safe system of managing requests for primary care,2 and our own work has shown low levels of potentially unsafe decision making in triage.9
Limitations
The measurement of time in the usual care group was not as robust as the electronic system used in NHS Direct and may have affected the results. Generalisability of our results is limited by the study being done in a single multisite practice that was experienced in using triage and had an interest in new methods of arranging appointments.
What is already known on this topic
Nurse telephone triage is a popular system of managing requests for same day appointments in general practice
Triage is not cheaper than standard appointment systems, and general practices may be unable to deliver a comprehensive service themselves
What this study adds
Triage by NHS Direct does not achieve equivalent outcomes to practice based triage
NHS Direct triage costs more than practice based triage
If NHS Direct could achieve the same patient disposal proportions as practice based triage, costs would be comparable
Conclusions
We have shown that external management of requests for same day appointments through NHS Direct is feasible but comes at a higher cost than practice nurse delivered triage. Outcomes for patients on the day of the request were more likely to involve an appointment with a general practitioner in the NHS Direct group. If NHS Direct could achieve the same patient disposal proportions as practice based triage, costs would be comparable. External triage of same day appointment requests is, therefore, possible, although no economies of scale are possible. Nonetheless, the flexibility of an organisation the size of NHS Direct could ensure coverage of all the triage needed. An external triage service might be feasible for smaller practices with fewer resources to organise their own systems.
Footnotes
-
We thank the patients, nurses, nurse advisers, doctors, and receptionists who took part in this study; Martin Bland, Malcolm Campbell, and Gerry Richardson, who provided advice on statistical and economic analysis; Katrina Sayer, James Irvine, and James Gallagher, who entered data; Margaret Moore, who provided information technology support; Dave Cox, David Johnson, Robin Pearson, Gary Vale, and Clare Ward from Tees East and North Yorkshire Ambulance Service NHS Direct and Jayne Barnes, Anne Cooper, Hazel Penny, and Keeley Townend from West Yorkshire Metropolitan Ambulance Service NHS Direct, all of whom provided professional, logistical, and managerial support during the research.
-
Contributors LG, JM, DAR, MR, and JT initiated the study. DAR developed the methods, and DAR, LG, JM, JT, and ED further developed the methods and data collection instruments. ED collected and managed the data. DAR and JM analysed the data. All authors helped to write the research report. DAR is the guarantor.
-
Funding The research was supported by a grant from the Department of Health's Central NHS Direct Management Team. All researchers were financed independently from the funder.
-
Competing interests None declared.
-
Ethical approval The local research ethics committee gave ethical approval.