Intended for healthcare professionals

General Practice

Randomised controlled trial comparing cost effectiveness of general practitioners and nurse practitioners in primary care

BMJ 2000; 320 doi: https://doi.org/10.1136/bmj.320.7241.1048 (Published 15 April 2000) Cite this as: BMJ 2000;320:1048
  1. P Venning, lecturer, practice nursing (pamelavenning{at}gofree.co.uk)a,
  2. A Durie, research associatea,
  3. M Roland, professor of general practiceb,
  4. C Roberts, senior lecturerc,
  5. B Leese, senior research fellowb
  1. a University of Manchester School of Primary Care, Rusholme Health Centre, Manchester M14 5NP
  2. b National Primary Care Research and Development Centre, University of Manchester, Manchester M13 9PL
  3. c Health Care Trials Unit, School of Epidemiology and Health Sciences, University of Manchester
  1. Correspondence to: P Venning, 12 Kingston Road, Didsbury, Manchester M20 2RZ
  • Accepted 11 November 1999

Abstract

Objective: To compare the cost effectiveness of general practitioners and nurse practitioners as first point of contact in primary care.

Design: Multicentre randomised controlled trial of patients requesting an appointment the same day.

Setting: 20 general practices in England and Wales.

Participants: 1716 patients were eligible for randomisation, of whom 1316 agreed to randomisation and 1303 subsequently attended the clinic. Data were available for analysis on 1292 patients (651 general practitioner consultations and 641 nurse practitioner consultations).

Main outcome measures: Consultation process (length of consultation, examinations, prescriptions, referrals), patient satisfaction, health status, return clinic visits over two weeks, and costs.

Results: Nurse practitioner consultations were significantly longer than those of the general practitioners (11.57 v 7.28 min; adjusted difference 4.20, 95% confidence interval 2.98 to 5.41), and nurses carried out more tests (8.7% v 5.6% of patients; odds ratio 1.66, 95% confidence interval 1.04 to 2.66) and asked patients to return more often (37.2% v 24.8%; 1.93, 1.36 to 2.73). There was no significant difference in patterns of prescribing or health status outcome for the two groups. Patients were more satisfied with nurse practitioner consultations (mean score 4.40 v 4.24 for general practitioners; adjusted difference 0.18, 0.092 to 0.257). This difference remained after consultation length was controlled for. There was no significant difference in health service costs (nurse practitioner £18.11 v general practitioner £20.70; adjusted difference £2.33, −£1.62 to £6.28).

Conclusions: The clinical care and health service costs of nurse practitioners and general practitioners were similar. If nurse practitioners were able to maintain the benefits while reducing their return consultation rate or shortening consultation times, they could be more cost effective than general practitioners.

Introduction

Although use of nurse practitioners is well developed in the United States, it is only in the past 10 years that they have become established in the United Kingdom. A nurse practitioner has been defined as “an advanced level clinical nurse who through extra education and training is able to practice autonomously, making clinical decisions and instigating treatment decisions based on those decisions, and is fully accountable for her own practice.”1 Models of nurse practitioner care have, however, developed in several different ways. In Britain, nurse practitioners working in general practice most commonly work as part of a team alongside general practitioners, and it is this model we have evaluated.

Nurse practitioners are increasingly used as points of first contact in primary care. The number of trained nurse practitioners is increasing as dedicated training programmes become more accessible. New government initiatives include nurses as front line providers for a national telephone advice service2 and for proposed new walk-in primary care clinics.3 Despite this, there have been few rigorous comparisons between doctors and nurses.Observational studies generally suggest that patients give positive reports of nurses in such roles.4 5 However, the only two randomised controlled trials comparing the cost effectiveness of nurses and doctors in first contact roles in primary care in the United States and Canada provide conflicting results.6 7 These studies were conducted on single sites with a small number of nurses. A recent meta-analysis commented on the limited evidence available to compare the cost effectiveness of doctors and nurses in primary care.8

The aim of this study was to compare the process, outcome, and costs of care given by general practitioners and nurse practitioners for patients requesting a same day appointment in 20 general practices. This group of patients was chosen because a high proportion would be likely to agree to randomisation as they would not have a strong preference for one practitioner who was already involved in their ongoing care.

Participants and methods

The study took place in 20 geographically dispersed practices in England and Wales. table 1 shows the location, list size, and number of general practitioner partners in the practices recruited.Ethical approval was obtained for the 20 practices from local research ethics committees. Each practice employed a nurse who had completed a one or two year nurse practitioner training programme at diploma, BSc, or MSc level. The median length of time the nurses had been qualified as nurse practitioners was 3 (range 1-5) years and the median time as registered nurses was 22 (9-35) years. Each nurse practitioner had been seeing patients as first point of contact for at least two years.

Table 1.

Location, number of partners, and practice list size of recruited practices

View this table:

Randomisation

In each practice, experimental sessions were booked when both the nurse practitioner and a general practitioner had appointments available for patients who asked to be seen on the same day. Patients were eligible for entry to the study if they requested an appointment the same day and were able to come to the experimental session. If these conditions were satisfied, the receptionist then asked patients whether they would agree to be randomised to see either a nurse practitioner or a general practitioner. A method of coded block randomisation was developed which meant that neither the receptionist nor the patient could determine the group to which a patient had been allocated at the time of booking. The coded blocks were generated from random number tables. The randomisation code was broken by one of the researchers at the start of each experimental session, at which point it became apparent which patient would see which practitioner. One of the researchers explained the study further to patients as they arrived for their appointment and informed consent was obtained. For drop-in clinics or where patients telephoned or called in after a session had started, the researchers randomised patients after they arrived in the surgery and had consented to enter the study. Randomisation continued until a minimum of 60 patients in each practice had been allocated to the clinician groups.

Patients were excluded from the study if one or more of the following criteria applied: patients who were temporarily resident or not yet registered with the practice, any patient with language or reading problems, any patient who was too ill, and unaccompanied children under 16 years of age.

Data collection

The general practitioners and nurse practitioners booked appointments at their normal intervals. For each consultation they recorded details of history, diagnosis, examination, tests carried out, prescriptions, and referrals. The time of each consultation, including interruptions, was recorded with an electronic time stamp. This included time taken by the nurse practitioners to get a prescription signed by a general practitioner. We extracted details of consultations in the following two weeks from the medical records.

Patients completed health status measures before the initial consultation and by post two weeks later (SF-369 for adults or the child health questionnaire for parents of children aged 5 to 1610). For children under 5 years, parents completed a brief health status questionnaire which had been developed for a previous study in general practice.11 After the consultation, patients completed the medical interview satisfaction scale12 or the paediatric version of this scale13 and the patient enablement instrument.14

Figure1

Flow chart tracking patients through study

We coded patients' diagnoses and prescriptions using Read codes. Data were double coded, double entered, and verified. For health status and satisfaction scales, scores were reported if 50% or more of items had been completed, and we used the method advised for the SF-36 scale to impute missing values.15 Costs of general practitioners' and nurse practitioners' time were taken from Netten et al using the actual grades on which the study nurses were employed.16 Costs of prescriptions were derived from the British National Formulary, and costs for investigations and referrals were supplied by the individual provider units associated with the practices.

Analysis

Because of potential correlation between the outcomes of patients treated by the same health professional, estimates of variation between health professionals may be over precise unless intracluster correlation is adjusted for.17 We adjusted outcome for the age and sex of the patients as these characteristics may also influence outcome. The statistical modelling used generalised estimating equations18 in which the intracluster correlation is modelled by an exchangeable correlation structure. A logistic regression model was used for binary outcomes. Analyses were carried out with STATA statistical software.19 As some of the cost data were highly skewed, estimates for costs were compared with estimates based on non-parametric clustered bootstrap to check the robustness of the analysis.20 Both estimates gave similar results and so only the direct estimates are presented.

Results

A total of 1716 patients were able to come to the experimental sessions and were informed about the study; 102 patients met one or more exclusion criteria and 298 declined to be randomised, leaving 1316 (76.7%) eligible patients who were randomised. Fifteen patients subsequently did not attend the appointment which they had booked. The figure gives further details of recruitment and response rates.

Table 2 shows the demographic characteristics of the patients and the main diagnoses. Two hundred (15.5%) patients were aged between 5 and 15, and 224 (17.3%) were children under 5. The commonest presenting problem was upper respiratory illness (36.8% of all consultations).

Table 2.

Demographic information and the five most common diagnoses. Values are numbers (percentages) of patients

View this table:

The nurse practitioners spent a mean of 11.57 minutes face to face with patients compared with 7.28 minutes by general practitioners (table 3). In addition, the nurses spent a mean of 1.33 minutes per patient in getting prescriptions signed. table 4 shows that there was no significant difference in the percentage of patients who had a physical examination (nurse practitioners 88.1% v general practitioners 85.7%). Nurse practitioners issued fewer prescriptions than general practitioners, but the difference was not significant (391 (61.0%) v 421 (64.6%); odds ratio 0.88, 95% confidence interval 0.66 to 1.17). Nurses ordered more tests and investigations than general practitioners (56 (8.7%) v 37 (5.6%); 1.66, 1.04 to 2.66). In particular, the nurse practitioners carried out more tests associated with opportunistic screening such as urine testing and cervical screening. Nurse practitioners were also significantlymore likely to ask patients to return (37.2% v 24.8%; 1.93, 1.36 to 2.73). In81 (12.6%)consultations the nurse discussed the patient with a doctor, and in 26 (4.1%) consultations the patient was seen by the doctor.

Table 3.

Differences in care given at initial consultation (values adjusted for age, sex, and intracluster correlation)

View this table:
Table 4.

Differences in actions taken during consultation with nurse and general practitioners (values adjusted for age, sex, and intracluster correlation).

View this table:

The satisfaction questionnaires (table 5) showed patients were more satisfied after consultations with nurses. Scores were significantly higher for the adult medical interview satisfaction scale scores and all its subscales and for the paediatric medical interview satisfaction scale scores in children and two of its subscales. There were no significant differences in enablement scores between the groups. The differences in satisfaction scores were still significant when the scores were additionally controlled for the length of face to face contact (mean difference 0.16, 95% confidence interval 0.08 to 0.24).

Table 5.

Differences in satisfaction after consultation (adjusted for age, sex, time, and intracluster correlation)

View this table:

In the two weeks after the initial consultation, patients who had seen a nurse practitioner were more likely to make a return visit to the clinic (mean number of returns 0.49 v 0.36). These return visits were mainly to general practitioners because there were more general practitioners than nurses in the practices and many of the nurses worked part time. There were no differences in health status at the end of two weeks.

Table 6 shows health service costs. These include the basic salary costs of each health professional plus the costs of prescriptions, tests, referrals, and the cost of return consultations in the following two weeks. Since return consultations were not timed, we estimated that they lasted an average of 7 minutes for general practitioner consultations and 11.5 minutes for nurse practitioner consultations. There was no significant difference in the cost of care given by the nurse practitioners and the general practitioners. Further details of costings are available from us on request.

Table 6.

Difference in cost of consultation with nurse and general practitioners based on salary costs. Data are adjusted for age, sex, and intracluster correlation.

View this table:

Discussion

We have evaluated care given by nurse practitioners working as part of primary care teams alongside general practitioners. Our results do not therefore relate to nurse practitioners who are working independently. It is often assumed thatwhen nurses substitute for doctors, the same service is provided.21 However, the British literature suggests that the combination of nursing and medical skills provides a more comprehensive and flexible service for patients than that provided by doctors.22 Our study provides limited support for this theory.

In many respects the behaviour of the nurses was similar to that of general practitioners, but some important differences existed. Nurse practitioners spent more time with patients and were more likely to ask patients to return. There were no differences in health outcome, although the study did not have sufficient power to detect a difference in rare serious events.

The differencesin working stylesbetween nurse practitioners and general practitioners are shown by the number and types of tests ordered and the numbers of patients who were asked to return to surgery. Nurse practitioners carried out more opportunistic screening. This was also found in a comparative study in the United States.7

In Britain only two groups of nurses (district nurses and health visitors) are able to prescribe drugs, and then from a limited list of items. During training nurse practitioners do an extensive pharmacology module with supporting modules in pathophysiology and disease management, and they argue that they are able to use the same range of drugs as doctors.23 We found that the nurse practitioners had similar prescribing behaviour to the general practitioners. As they had been qualified for some time, unlike nurse practitioners in other British studies, 4 22 24 and were experienced nurses, this finding is not unexpected. These nurses were working in teams alongside general practitioners and consistent prescribing behaviour should, in theory, be adopted by all practice staff. Indeed, some practices had developed specific prescribing protocols for both general practitioners and nurse practitioners.

Patient satisfaction is an important component of nearly all studies looking at the role of nurse practitioners, and patients generally report high levels of satisfaction with nurse practitioner care.4 5 22 24 25 Increased satisfaction has been linked with longer consultations, and nurse practitioners have been shown to spend longer with patients than general practitioners. However, the differences in satisfaction remained in our study after we had controlled for differences in consultation time.

The health service costs of consultation with nurse practitioners were 12.5% lower than those for general practitioners, but this difference was not significant. However, a larger study with greater power to detect cost differences is needed. We were unable to do power calculations for cost before the study because none of the British studies of nurse practitioners have compared cost of consultations for general practitioners and nurse practitioners.4 5 22 24 In the United States studies have shown conflicting results.25 Nurses were paid less than the general practitioners, but they took longer to see patients and more of their patients returned for further consultations. This reduced the overall difference in consultation costs. If lifetime training costs were included the general practitioner costs would be higher.

Conclusion

Our results relate to patients requesting a same day appointment in general practice and cannot necessarily be generalised to other situations. Overall, the clinical care and outcome were similar for nurse practitioners and general practitioners. Patients who requested a same day appointment were satisfied with nurse practitioner consultations. If nurse practitioners were able to work in different ways—for example, to shorten their consultation times (which our results suggest will not alter higher patient satisfaction with nurse practitioners) or reduce their return consultation rate—they could be more cost effective than general practitioners for this group of patients.

What is already known on this topic

Nurse practitioners are increasingly used as point of first contact in primary care

Observational studies suggest patients react positively to use of nurse practitioners

What this study adds

Patients were more satisfied with nurse practitioner consultations even after their longer consultation times were allowed for

There were few differences in clinical care and no difference in clinical outcome between nurse practitioners and general practitioners

Health service costs were not significantly different between nurses and general practitioners

Acknowledgments

We thank all the patients who participated in the study and the administrative, nursing, and medical staff in the 20 practices recruited for the study.

Contributors: PV had the idea for the research. PV, MR, CR, and BL obtained funding from the Wellcome Trust, PV being the principal investigator. PV and MR developed the project protocol with important input from AD and advice from CR and BL. Data collection, database development, and initial analysis were carried out by AD with help from PV and advice from MR, CR, and BL. Statistical modelling was carried out by CR. This paper was instigated by MR, and completed by PV with contributions from CR and advice from AD and BL. PV and MR are guarantors.

Footnotes

  • Funding Wellcome Trust, project number 045384.

  • Competing interests None declared.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
View Abstract