Abstract
Background Over the past decade, collaboration between general practices in England to form new provider networks and large-scale organisations has been driven largely by grassroots action among GPs. However, it is now being increasingly advocated for by national policymakers. Expectations of what scaling up general practice in England will achieve are significant.
Aim To review the evidence of the impact of new forms of large-scale general practice provider collaborations in England.
Design and setting Systematic review.
Method Embase, MEDLINE, Health Management Information Consortium, and Social Sciences Citation Index were searched for studies reporting the impact on clinical processes and outcomes, patient experience, workforce satisfaction, or costs of new forms of provider collaborations between general practices in England.
Results A total of 1782 publications were screened. Five studies met the inclusion criteria and four examined the same general practice networks, limiting generalisability. Substantial financial investment was required to establish the networks and the associated interventions that were targeted at four clinical areas. Quality improvements were achieved through standardised processes, incentives at network level, information technology-enabled performance dashboards, and local network management. The fifth study of a large-scale multisite general practice organisation showed that it may be better placed to implement safety and quality processes than conventional practices. However, unintended consequences may arise, such as perceptions of disenfranchisement among staff and reductions in continuity of care.
Conclusion Good-quality evidence of the impacts of scaling up general practice provider organisations in England is scarce. As more general practice collaborations emerge, evaluation of their impacts will be important to understand which work, in which settings, how, and why.
INTRODUCTION
New organisational forms of collaboration between general practices for the provision of care have emerged across England over the past decade.1,2 These include general practice networks, federations, super-partnerships, and multisite practice organisations. It has been argued that they are better placed than the traditional, smaller, independent business partnerships between a small number of GPs to strengthen the workforce, improve quality of care, extend services, and generate efficiencies.2–7 Although many of the earliest collaborations emerged through grassroots initiatives, building on existing local relationships, national policies are increasingly driving collaborations. This is with a view to creating much larger ‘accountable care’-type organisations, in which primary and secondary, and, in some cases, social care providers, collaborate to provide comprehensive care for defined populations, within a shared budget.6–8
Many of the expectations of what scaling up general practices will achieve appear logical, however, it is unclear what research evidence exists to support them. This article presents a systematic review of the evidence on the impact of new organisational forms of collaboration between general practices for the provision of care in England.
METHOD
This review contributed to a larger project led by the Nuffield Trust on large-scale general practice.9 The search strategy was developed with a health services research librarian to identify literature on the impact of collaboration between three or more general practices on clinical processes, clinical outcomes, patient experience, workforce satisfaction, and costs. The databases Embase, MEDLINE, Health Management Information Consortium (HMIC), and Social Sciences Citation Index (SSCI) were searched for literature in English, initially between January 1996 and March 2016. The database search was re-run in January 2017 to capture any subsequent peer-reviewed literature. Additional academic and grey texts were identified by screening the references of relevant publications, seeking recommendations from experts in the fields of primary care and health services research, and by examining relevant websites, GP media reports, and policy documents. These are methods known to increase yields of relevant results in systematic reviews.10 The protocol was not registered.
The search strategy had initially aimed to capture evidence systematically from international and UK contexts. However, as a result of heterogeneity in the terminology used, as well as in the process and context of implementation of scaling up general practice, it became evident that, despite using several search strategies, such a wide systematic review was neither feasible nor likely to provide clearly transferable evidence. Therefore, the inclusion and exclusion criteria applied aimed to identify studies with greatest relevance to current developments in England and robust research methods. These criteria are outlined in Box 1.
Box 1. Inclusion and exclusion criteria for the systematic review
Inclusion criteriaStudy evaluates the impact of new forms of collaboration between three or more GP practices working collectively to provide routine clinical care in England, for example, general practice networks, federations, super-partnerships, or multisite practice organisations.2
Study reports on the impact of one or more of the following as a result of the collaboration: quality of care processes indicators, clinical outcomes, patient experience, workforce satisfaction, or costs.
Exclusion criteriaDescriptive case studies without primary data, clear methodology, and/or with only self-reported impacts.
Studies including new forms of collaboration, but the evaluation of the collaboration’s impact is not a focus of the study and cannot therefore be identified from the rest of the initiative.
Studies of organisations only providing out-of-hours care.
All titles and abstracts identified were screened, with full publications being read by the same researcher if they appeared relevant. Publications were assessed using the inclusion and exclusion criteria. If there was uncertainty over whether a study met inclusion or exclusion criteria, it was discussed until consensus was reached. Critical Appraisal Skills Programme (CASP) checklists were used to evaluate the quality of included studies.11
How this fits in
National policy increasingly advocates the development of large-scale provider collaborations between general practices, with expectations that they will be better placed than individual practices to strengthen the workforce, improve quality of care, extend services, and generate economies of scale. A systematic review was carried out to examine the impact of new forms of provider collaborations in England to understand what evidence exists to support these expectations. Limited evidence was found that met the inclusion criteria. Five studies point to potential improvements in quality of care through scaling up. Four of these were from the same general practice networks. There is a need for realistic expectations of what scaling up may achieve in England and cautious implementation alongside evaluation to understand better what is likely to work, for whom, and in which contexts.
Data were extracted on templates by two authors, with discussion to reach consensus, and narrative synthesis was used to present the findings.12
RESULTS
After the exclusion of duplicates, 1782 texts were screened. Literature that did not meet the inclusion criteria often described the development, rather than impact, of large-scale general practice collaborations;3–5,12 was of poor methodological quality;13–17 or it was not possible to disentangle the impact of the new collaboration from wider initiatives.18–22 Evidence from initiatives with similarities to the process of formation and/or objectives of scaled-up general practice provider collaborations in England including specialist clinical networks, integrated care initiatives, GP-led commissioning, and out-of-hours cooperatives, as well as evidence from other countries, did not meet the inclusion criteria. However, it helped inform the interpretation of the findings, assessment of the implications for policy, and contributed to a wider review of the literature presented elsewhere.23 Only five studies met the inclusion criteria (Figure 1).
Figure 1. Flow diagram of systematic review process.
Four studies examined networks of general practices in the same London borough of Tower Hamlets. These evaluations focused on quantitative assessments of the impact of intervention packages delivered by new networks of practices on quality of care processes and clinical outcomes. These were tracked over the period of implementation, and between 1 and 3 years afterwards. Performance was compared against averages in London and England. The studies provided some cost data, but no cost-effectiveness analysis (Table 1). All four studies had a moderate risk of bias based on CASP checklists.24–27
Table 1. The impacts of a large-scale general practice collaboration (Tower Hamlets Managed General Practice Network) from quantitative studies
One qualitative study examined a multisite general practice organisation with central ownership of 50 nationally dispersed GP practices. It used interviews and ethnographic observations to examine quality and safety processes, and to provide staff members’ views on job satisfaction and on patient experience (Table 2). It had a low risk of bias based on the CASP checklist.28
Table 2. The impacts of a large-scale general practice collaboration (multipractice organisation in England) from a qualitative study
Quantitative studies
In 2008–2009, Tower Hamlets Primary Care Trust (PCT) (the local NHS service commissioning organisation at that time and which is now a clinical commissioning group), established eight geographically defined, managed general practice networks with a total of 36 GP practices. Each network had four or five practices and a registered population between 30 000 and 50 000. The aims of the networks at the time were to improve four clinical areas: childhood immunisations; type 2 diabetes; chronic obstructive pulmonary disease; and cardiovascular disease.
Previous local enhanced services’ funding was channelled into the development of the networks and incentives for the provision of care packages were rolled out between 2008 and 2010. The PCT distributed financial incentives at network level, rather than to individual practices, to encourage peer scrutiny and the collective management of funds to achieve the PCT’s key performance indicators. Approximately £10 million per annum was spent across all networks for this initiative.27 Funding enabled staff education, information technology-enhanced recall systems, standardised data collection, the analysis of comparative feedback on performance, as well as management and shared clinical support teams across the networks. The interventions were developed by local GP clinical leaders, public health specialists, and PCT managers, with input from a management consultancy. The clinical effectiveness group, based at the local university and led by local GPs, developed the performance-monitoring dashboards and measurable key performance indicators. It also undertook the evaluations.
Results of observational time-series studies in the four targeted clinical areas appeared promising (Table 1). They demonstrated an improvement on most key performance indicators; with the average of the networks often doing better than other PCT, average London, or national trends. This included achieving targets on childhood and flu immunisation,24,26 annual review and care planning,25–27 screening,25 and, for people with chronic obstructive pulmonary disease or cardiovascular disease, increasing the number of individuals on registers and numbers referred into community rehabilitation clinics.26,27 There were also improvements in measures of health outcomes, such as achieving targets for blood pressure, cholesterol, and average glycated haemoglobin levels for patients with type 2 diabetes.25
One study compared performance in two local PCTs, which had a similar intervention package as the networks in Tower Hamlets, including the dissemination of clinical guidelines to all staff that were reinforced at central educational meetings and by standard data entry templates.27 However, the other two PCTs did not have clinical case discussions within networks or administrative target reviews, and incentives were at practice level rather than at network level. Practices in other PCTs also did not have information technology-enabled performance dashboards with traffic light ratings, and did not have network managers. Results showed that practices in the comparator PCTs did better than the national average on all measures, but not as well as Tower Hamlets.27
Qualitative findings
The multisite GP practice organisation studied was founded and owned by a small number of GPs.28 At the time of the study (2011–2012), it operated over 50 GP practices across England with a salaried workforce. It had a hierarchical form of governance with a small executive made up of the owners (Table 2).
The owners of the organisation interviewed reported commercial, reputational, and moral factors that drove them to aim to deliver high-quality care and ensure patient satisfaction. Multiple mechanisms to ensure the safety and quality of care were reportedly used, including: standardising processes, such as for incident reporting; enhancing training and inter-staff support; reducing administrative burden on frontline clinicians; optimising learning between practices; and comparing practice performance (for example, practices that under-reported adverse incidents were investigated, because this was considered a marker of possible lack of engagement with quality and safety issues). The organisation used patient surveys and ‘mystery shoppers’ to monitor performance. Feedback and benchmarking of performance were reported among member practices to create competition between practices. Authors presented a mixed picture of the ability to share learning between practices. For example, they described rapid dissemination of changes following an adverse event being common, but not all sites were maximising opportunities to improve care processes. GPs and other staff were performance managed, and if they did not meet requirements were ‘performance-managed out of the organisation’, according to one GP director interviewed.
A central call centre was set up to take telephone requests for appointments. This was intended to allow more face-to-face time between receptionists and patients in practices, and to improve efficiency in the allocation of appointments. However, interviewees provided mixed views on its effectiveness, with receptionists stating they still often had to deal with calls from the call centre, and that some patients did not like the call centre.
Patient participation groups were reported to have been involved with varying success across practices, with challenges encountered in maintaining engagement. Some staff attributed challenges in recruiting patients to antipathy towards what patients perceived as a commercial organisation providing NHS health care. One interviewee perceived that staff felt undervalued in a large company where no one local owned the practice where they worked. The recruitment and retention of staff, in particular of GPs, was problematic in some practices. This was more notable in underperforming practices that had recently been taken over by the organisation. The authors attributed some of the GP turnover to the flexibility offered by salaried or locum work compared with the ‘buy-in’ required by the traditional GP partnership business model. Staff turnover affected the relational continuity of care, and resulted in reports of patient dissatisfaction. It also posed a risk to the consistent implementation of the quality and safety procedures of the organisation, and increased the amount of time spent on staff induction procedures.
DISCUSSION
Summary
The very small number of studies available provided limited evidence on the impact on quality of care, costs, and workforce satisfaction of scaling up general practice in England. There was no robust direct evidence of impacts on patient experience, and no evidence identified on the cost-effectiveness of scaling up general practice.
The evidence from a group of networks covering 36 general practices in Tower Hamlets indicated that such networks can enable quality improvement by clearly targeting areas for improvement, with guidelines reinforced at central educational meetings, standard data entry templates, clinical case discussions within networks, administrative target reviews, incentives at network levels, and information technology-enabled performance dashboards, alongside additional clinical and management support. This is likely to require substantial financial investment and time. In the case of Tower Hamlets, the investment was approximately £10 million per year. Evidence from one multisite general practice organisation with more than 50 GP practices in England suggested that increasing scale under a single organisation could improve safety and quality processes, but might increase staff turnover, reduce continuity of care, and reduce perceived quality of patient experience.
Strengths and limitations
The literature search was comprehensive, with an expert librarian advising on multiple versions of keyword searches, and authors identifying further literature through snowball searching and seeking guidance from experts. The search methods and strict inclusion criteria improved the rigour and relevance of the reviewed literature, but the small number of studies, mostly from a single geographic area, limits the generalisability of the findings.
The review was undertaken when scaling up general practice was starting to be advocated by national policymakers.6,7 It highlights the limited good-quality evidence to support this approach at the time. Further work has since been undertaken,9,29,30 and more research is underway, which may help fill some of the gaps identified.31–33
This review is complemented by a review of the wider academic and grey literature examining the development and impact of national and international initiatives with similarities to large-scale general practice organisations in England, such as specialist clinical networks, GP-led commissioning, out-of-hours cooperatives, and integrated care initiatives.23
Comparison with existing literature
Despite the recent focus by national policymakers in England on increasing organisational size to improve quality of care and generate efficiencies in general practice, there is no consistent association between scale, quality of care, or the generation of efficiency savings in the healthcare literature.23 A wide range of factors other than size alone influence performance, including the availability of resources, the quality of clinical leadership, and pre-existing relationships in the local health economy.34–40 The time and resources involved in health service reorganisations such as scaling up organisations have often been underestimated, and anticipated benefits have not always been delivered.20,41–43 Although patients may value increased routes of access through scaling up, new access routes may not be well received by all patients.20,22,39 For example, the importance of providing continuity of care for those who most need it has frequently been identified as desirable but may be harmed by providing general practice care through larger organisations.44
Experience from similar initiatives both in the UK and internationally highlights important trade-offs that exist in scaling up, such as between being small enough to maintain flexibility and inclusive decision-making processes and being of sufficient size to bear financial risks as well as exert power to influence the local health economy.45,46 It also highlights that giving GPs autonomy and engaging them in decision making may well increase the likelihood of large-scale general practice collaborations forming successfully; however, this may also result in duplicated efforts, inequity in participation, and complexity of organisational forms.46–49
Implications for research and practice
The pressures that GP practices are facing at present in England are significant. Although these circumstances make finding better ways to deliver care pressing, using clinicians’ time to address organisational issues represents an opportunity–cost to patient care.
There is currently little robust research to indicate with confidence that the expectations placed on larger-scale general practice provider collaborations in England will be met, or to identify with confidence the potential unintended consequences. As more GP collaborations form and mature in England, evaluation of their impacts will be fundamental to better understand which types work best, in which circumstances, for whom, how, and why. This ideally should happen before large-scale general practice is pursued as national policy across England.
Acknowledgments
Thanks to Judith Smith who led on the early research project development; Natasha Curry who provided guidance on this literature review in its initial stages; Rod Sheaff who provided comments on the literature review in the final stages; Sally Hull and John Robson who reviewed an early draft of the section on Managed General Practice Networks in Tower Hamlets and provided additional information; and Michael Kidd, Ruth Wilson, and Job Metsemakers for insights into large-scale general practice collaborations internationally.
Notes
Funding
Luisa M Pettigrew was funded by a National Institute for Health Research (NIHR) In-Practice Fellowship in the Department of Health Services Research and Policy at the London School of Hygiene and Tropical Medicine. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health. This study formed part of a larger piece of work in collaboration with the Nuffield Trust.
Provenance
Freely submitted; externally peer reviewed.
Competing interests
Rebecca Rosen is an external GP on Tower Hamlets Clinical Commissioning Group for primary care commissioning and Director of Greenwich Health GP Federation. The other authors have declared no competing interests.
Discuss this article
Contribute and read comments about this article: bjgp.org/letters
- Received March 30, 2017.
- Revision requested June 27, 2017.
- Accepted August 31, 2017.
- © British Journal of General Practice 2018
REFERENCES
- 1.↵
- 2.↵
- 3.↵
- 4.
- 5.↵
- 6.↵
- 7.↵
- 8.↵
- 9.↵
- 10.↵
- 11.↵
- 12.↵
- 13.↵
- 14.
- 15.
- 16.
- 17.↵
- 18.↵
- 19.
- 20.↵
- 21.
- 22.↵
- 23.↵
- 24.↵
- 25.↵
- 26.↵
- 27.↵
- 28.↵
- 29.↵
- 30.↵
- 31.↵
- 32.
- 33.↵
- 34.↵
- 35.
- 36.
- 37.
- 38.
- 39.↵
- 40.↵
- 41.↵
- 42.
- 43.↵
- 44.↵
- 45.↵
- 46.↵
- 47.
- 48.
- 49.↵