Article Text

Download PDFPDF

Long-term cost-effectiveness of collaborative care (vs usual care) for people with depression and comorbid diabetes or cardiovascular disease: a Markov model informed by the COINCIDE randomised controlled trial
  1. Elizabeth M Camacho1,
  2. Dionysios Ntais1,
  3. Peter Coventry2,
  4. Peter Bower3,
  5. Karina Lovell4,
  6. Carolyn Chew-Graham5,3,
  7. Clare Baguley6,
  8. Linda Gask3,
  9. Chris Dickens7,
  10. Linda M Davies1
  1. 1Manchester Centre for Health Economics, University of Manchester, Manchester, UK
  2. 2Mental Health and Addiction Research Group, University of York, York, UK
  3. 3Centre for Primary Care, University of Manchester, Manchester, UK
  4. 4The School of Nursing, Midwifery and Social Work, University of Manchester, Manchester, UK
  5. 5Primary Care & Health Sciences, University of Keele, Staffordshire, UK
  6. 6NHS Health Education North West, Manchester, UK
  7. 7Mental Health Research Group, University of Exeter, Exeter, UK
  1. Correspondence to Dr Elizabeth M Camacho; elizabeth.camacho{at}manchester.ac.uk

Abstract

Objectives To evaluate the long-term cost-effectiveness of collaborative care (vs usual care) for treating depression in patients with diabetes and/or coronary heart disease (CHD).

Setting 36 primary care general practices in North West England.

Participants 387 participants completed baseline assessment (collaborative care: 191; usual care: 196) and full or partial 4-month follow-up data were captured for 350 (collaborative care: 170; usual care: 180). 62% of participants were male, 14% were non-white. Participants were aged ≥18 years, listed on a Quality and Outcomes Framework register for CHD and/or type 1 or 2 diabetes mellitus, with persistent depressive symptoms. Patients with psychosis or type I/II bipolar disorder, actively suicidal, in receipt of services for substance misuse, or already in receipt of psychological therapy for depression were excluded.

Intervention Collaborative care consisted of evidence-based low-intensity psychological treatments, delivered over 3 months and case management by a practice nurse and a Psychological Well Being Practitioner.

Outcome measures As planned, the primary measure of cost-effectiveness was the incremental cost-effectiveness ratio (cost per quality-adjusted life year (QALY)). A Markov model was constructed to extrapolate the trial results from short-term to long-term (24 months).

Results The mean cost per participant of collaborative care was £317 (95% CI 284 to 350). Over 24 months, it was estimated that collaborative care was associated with greater healthcare usage costs (net cost £674 (95% CI −30 953 to 38 853)) and QALYs (net QALY gain 0.04 (95% CI −0.46 to 0.54)) than usual care, resulting in a cost per QALY gained of £16 123, and a likelihood of being cost-effective of 0.54 (willingness to pay threshold of £20 000).

Conclusions Collaborative care is a potentially cost-effective long-term treatment for depression in patients with comorbid physical and mental illness. The estimated cost per QALY gained was below the threshold recommended by English decision-makers. Further, long-term primary research is needed to address uncertainty associated with estimates of cost-effectiveness.

Trial registration number ISRCTN80309252; Post-results.

  • PRIMARY CARE
  • MENTAL HEALTH
  • HEALTH ECONOMICS

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • COINCIDE was a large randomised controlled trial (RCT) of a pragmatic intervention with good retention rates.

  • Bias and confounding were minimised using a variety of methods at all stages from study design and recruitment to data analysis.

  • There was a notable proportion of missing data; multiple imputation of missing values was used to minimise bias.

  • The conclusions reported about the long-term cost-effectiveness of collaborative care are extrapolated from a short-term (4-month) RCT and therefore subject to uncertainty; structural and parameter uncertainty in the economic model were explored in sensitivity analyses.

  • The economic model and sensitivity analyses demonstrated good external validity with findings from meta-analyses (clinical effectiveness) and narrative systematic reviews (cost-effectiveness) and results were not sensitive to alternative modelling assumptions.

Introduction

Major depression is a common disabling condition estimated to affect 3% of the English general population;1 the prevalence and burden in individuals with long-term physical conditions (such as diabetes or heart disease) is higher still.2–6 Factors associated with depression, such as poor self-care, can lead to complications and higher mortality from physical health conditions.7 ,8 In time-restricted and performance-managed primary care settings, detecting and diagnosing depression in people with long-term conditions can be especially problematic. Patients and healthcare professionals commonly dismiss depression as an inevitable consequence of long-term conditions and favour strategies that prioritise physical health.9–12

Global and English health policy has recognised the importance of improving mental health generally and specifically among those with physical health problems.13 ,14 In England, government policy has increasingly promoted increased access to mental healthcare through commissioning and provision of health and social care in the primary care setting. This is supported by the Improving Access to Psychological Therapies (IAPT) initiative. It is important to explore ways in which the IAPT initiative can be capitalised on to improve healthcare and health outcomes for patients. Collaborative care is a complex intervention which may provide a framework for delivering IAPT-based treatments. Collaborative care was developed in the USA and involves the use of a case manager working with primary care professionals, often supervised by a mental health specialist and supported by appropriate care management systems that can enhance interprofessional communication and facilitate proactive and scheduled follow-up of patients.15–17

A definitive Cochrane review reported that collaborative care effectively treated depression and anxiety over the short (0–6 months), medium (7–12 months) and long term (13–24 months), compared with usual care.18 The review defined usual care as one of: no additional intervention; the same additional intervention applied to both study arms (effects potentially cancelled out); or enhanced usual care (a non-collaborative intervention that the collaborative care arm did not receive). Much of the evidence is drawn from the USA, where care is organised, provided and funded differently from the UK. However, the COINCIDE and CADET trials showed that the short-term and medium-term benefits of collaborative care also translate to the English healthcare system.15 ,19 There is good evidence (from the USA) that collaborative care is also effective for treating depression in people with coexisting long-term physical health conditions.20–23

Evidence that collaborative care is cost-effective is more limited, and again mostly from the USA.24 ,25 However, an economic evaluation of CADET has recently shown that compared with usual care, collaborative care is cost-effective in the medium term (12 months), from the perspective of the English National Health Service (NHS).26 Analysis of complete-case data in that trial, estimated that collaborative care offered a mean incremental gain of 0.02 (95% CI –0.02 to 0.06) quality-adjusted life years (QALYs) over 12 months, at a mean incremental cost of £270.72 (95% CI –202.98 to 886.04). This resulted in a cost per QALY of £14 248 and a probability of 0.58 that collaborative care was cost-effective if decision-makers are willing to pay £20 000/QALY gained.

The long-term (>12 months) clinical and cost-effectiveness of collaborative care in the English healthcare system have not been evaluated previously. The long-term effectiveness of collaborative care may be particularly relevant to patients with comorbid physical illnesses if an artefact of collaborative care is an altered trajectory of mental and/or physical health needs or long-term improvements in relationships with healthcare practitioners/self-care.20 ,27 A trial of a collaborative care for managing depression in patients with cancer reported a higher cost per QALY gained over 5 years than over 20 years, suggesting it may become better value with an increasing time horizon.28

The COINCIDE trial was a robust, pragmatic randomised controlled trial (RCT) of collaborative care versus usual care, delivered in routine primary care in the English NHS to trial participants with a long-term condition (diabetes and/or coronary heart disease (CHD)) and depression.16 Owing to logistical constraints, COINCIDE participants were only followed for 4 months.17 CHD and diabetes are lifelong conditions, and depression can be a recurrent, chronic condition. Therefore, it is important to consider the effectiveness of collaborative care in this population over long-term periods. Economic models can be used to extrapolate the cost-effectiveness findings from a short-term RCT to longer time horizons and alternative settings and populations.29

This study is important because it makes a robust contribution to economic evidence about estimated costs and benefits of implementing collaborative care in the English healthcare system (NHS England). Existing evidence is limited to studies conducted in the US healthcare system which may not be relevant to the implementation of collaborative care in the NHS. Emerging evidence from a single English complete-case analysis suggests that collaborative care may be cost-effective in this context over 12 months. However, it is still unknown whether these findings are likely to translate to longer time horizons. This analysis uses an economic model to estimate the cost-effectiveness of collaborative care in the context of the NHS at 12, 24 and 36 months. This has not been done previously. Furthermore, this is the first analysis of the cost-effectiveness of collaborative care in the NHS for patients with long-term physical conditions alongside depression (multimorbidity).

Aim: To use an economic model to extrapolate trial-based cost-effectiveness estimates for collaborative care versus usual care over a long-term (24 months) time horizon. The key objectives were to:

  • Develop an economic model to represent the key health states and events observed during the COINCIDE trial of collaborative versus usual care;

  • Estimate the costs of health and social care in the collaborative care and usual care groups;

  • Assess whether there are differences in costs between collaborative care and usual care;

  • Estimate the health status and QALYs of patients in the collaborative care and usual care groups;

  • Assess whether there are differences in health status and QALYs between collaborative care and usual care;

  • Estimate the long-term cost-effectiveness of collaborative care, compared with usual care.

Methods

Randomised controlled trial

The COINCIDE trial was an integrated clinical and economic study to evaluate the effectiveness and cost-effectiveness of a collaborative care intervention in people with diabetes and/or CHD who had comorbid depression. The evaluation was a cluster RCT of 36 primary care (general) practices in the North West of England, randomised to provide either collaborative care or usual care. Randomisation was by a central service, separated from the investigators, using minimisation based on practice size and deprivation. Three hundred and eighty-seven participants were recruited; 191 at practices randomised to deliver collaborative care and 196 at practices delivering usual care. Sixty-two per cent of participants were male, 14% were of non-white ethnicity. The majority (76%) of participants were from moderately/highly deprived areas (54% from highly deprived areas) and had a mean of 6.2 (SD 3.0) medical conditions in addition to diabetes and/or CHD. Full details of the trial design are reported elsewhere.16 ,17 practices were eligible for inclusion if they held and maintained a Quality Outcomes Framework (QOF) register of patients with CHD and diabetes mellitus.30 Patients aged ≥18 years attending each practice were eligible for inclusion if they were listed on either of these QOF registers and had persistent depressive symptoms (≥10 on Patient Health Questionniare-9 (PHQ-9)).31

Participants attending practices in the collaborative care arm were offered a choice of appropriate evidence-based low-intensity psychological treatments, delivered over 3 months through IAPT services. Case management was provided jointly by the practice nurse and a Psychological Well Being Practitioner (PWP; graduate psychologists employed by IAPT to provide high-volume, low-intensity psychological interventions).

Participants attending practices allocated to usual care received standard management from their primary care team. Standard management for depression in adults with physical health conditions can vary but should include the components of the National Institute for Health and Care Excellence (NICE) stepped care model which includes support from general practitioners (GPs), referral for a range of low-intensity to high-intensity psychological interventions and/or antidepressant therapy (dependent on severity of depression, patient preference and prior experience).32 In line with the pragmatic nature of this evaluation, patients in the usual care group could receive antidepressant treatment and referral for psychological therapy, although this was not delivered by a specially trained COINCIDE PWP.

The primary clinical outcome was the difference between the collaborative and usual care groups in the mean score on the 13 depression-related items of the 90-item symptom checklist (SCL-D13)33 at the end of a 4-month follow-up period. This was collected at follow-up for 170 participants in the collaborative care group and 180 in the usual care group. Participants in the collaborative care arm had a lower mean SCL-D13 depression score (difference −0.23; 95% CI −0.41 to −0.05; adjusted standardised effect size 0.30) and also reported being better self-managers, rated their care as more patient centred and were more satisfied with their care.19

Economic evaluation

Measuring health benefit

The primary measure of health benefit for the analysis was the QALY, estimated from the EuroQol five dimension questionnaire, 5-level version (EQ -5D-5L) and associated utility tariffs.34 ,35 The EQ-5D is a validated, generic, preference-based measure of health status, widely used in national health surveys in the UK and clinical trials of mental health interventions. The EQ-5D is currently recommended for by the NICE to estimate health state utility weights for the calculation of QALYs.36 QALYs are estimated as the average time spent in a health state multiplied by the average utility weight associated with it. Despite being a global measure, a systematic review reported that the EQ-5D demonstrates good construct validity and is sensitive to changes in depression.37 In COINCIDE, there were significant relationships between baseline utility values and clinical outcome measures (SCL-90, Pearson −0.311, p≤0.001; PHQ-9, Pearson −0.307, p≤0.001; World Health Organisation-Quality of Life instrument (WHO-QOL), Pearson 0.448, p≤0.001; generalised anxiety disorder assessment, 7-item version (GAD-7), Pearson −0.231, p≤0.001; Symptom Disruption Score (SDS), Pearson −0.384, p≤0.001; burden of diseases, Pearson −0.454, p≤0.001).

Measuring costs

Data on the resources used to establish and deliver the intervention were collected from activity logs completed by the PWPs and practice nurses delivering collaborative care. In addition to the main and collaborative sessions, this also included note writing and supervisions attended by the PWPs. The costs of training were also included in the primary analysis. Data on the use of other health and social care services were collected by questionnaire completed by participants at initial (4-month) follow-up. The services included primary and community care, hospital inpatient and outpatient care, prescribed medications, and patient health-related costs and expenses (travel to healthcare appointments and private medical expenses exceeding £50, eg, reflexology). The costs of resources used were estimated as the product of the resource use and its unit cost. The unit costs of the services used were originally derived from the 2011–2012 Reference Costs database (published by the Department of Health), 2011–2012 unit costs of primary and community health and social care services (published by the Personal and Social Services Research Unit), and the 2011–2012 British National Formulary (BNF) handbook38–40 (see online supplementary table S1). All costs were inflated to 2014/2015 prices, based on the Hospital and Community Health Services (HCHS) Index.38

Participants were also asked about support from family and friends. However, a high level of missing data and inconsistency of reporting meant that it was not possible to estimate reliable costs for this resource.

Missing data

Missing data on costs and EQ-5D domains were imputed using the multiple imputation chained-equation procedure, which is robust against assumptions that data are missing not at random. The multiple imputation procedure included baseline covariates identified as predictors of costs and utilities (EQ-5D pain/discomfort, number of additional conditions, Bayliss burden of disease score, PHQ-9 score, SDS, social or family life, ethnicity, employment, GP practice) in addition to age, sex and baseline SCL-D13 score.

Economic model

Both the primary and sensitivity analyses used the framework of cost-effectiveness and cost-effectiveness acceptability analysis to evaluate the potential for collaborative care to be cost-effective in an NHS primary care setting. The perspective for the evaluation was that of the patient (health benefits) and health and social care services (costs)—an approximation of the societal perspective. The target population for the economic model analyses was people with diabetes and/or CHD with comorbid depression. Data from participants in COINCIDE were used to represent this population. Differences between model parameters estimated from COINCIDE data and results reported from other published evaluations were explored in sensitivity analyses (described below).

The time horizon for the primary analysis was 24 months. An annual discount rate of 3.5% was applied to costs and effects for the period beyond 12 months, as per NICE recommendations for economic evaluations in healthcare.36 The simulation software was TreeAge Pro plus Healthcare. The primary measure of cost-effectiveness for the model analyses was the incremental cost-effectiveness ratio (ICER), reported as cost per QALY gained from collaborative care. This was calculated as:Embedded Image

Model structure

A simple economic model that combined a decision tree and a Markov cohort model was constructed (figure 1). The initial decision tree structure was based on the care pathways and outcomes observed over 4 months in COINCIDE. Decision trees are simple and transparent, clarifying the options of interest. The distribution of participants in terms of allocation to collaborative/usual care and subsequent depression status (SCL-D13<20 not depressed; SCL-D13≥20 depressed41) at the end of the initial follow-up period were described in the model.

Figure 1

Decision tree and Markov model.

A Markov cohort model was constructed for each study arm to extrapolate the findings from COINCIDE over a long-term time horizon. Markov models handle both costs and outcomes intuitively which makes them a powerful tool in economic evaluation.42 They are particularly useful for modelling chronic conditions with fluctuating severity, such as depression, over time. The 24-month time horizon was split into five cycles of 4 months to reflect the transition between depression states observed during the trial. The health states represented in the model were based on the observed outcomes from COINCIDE: depressed, not depressed, dead. The distribution of participants across the health states at the start of the model was different between the study arms, reflecting the observed proportion of participants in each health state at the end of the initial 4-month follow-up. The health states and possible transitions between them were the same for both models.

Probability of events

The probabilities of following the different pathways through the decision tree or moving between the health states in the Markov model were derived from COINCIDE. The proportion of participants in each health state at the end of the initial follow-up was used to estimate the probability of transitioning between health states for the model. All participants recruited to COINCIDE were identified as depressed; this was based on a PHQ-9 score ≥10. There was a proportion of participants in both study arms who did not have a baseline SCL-D13 score ≥20; the estimated probability of becoming depressed was derived from the outcomes of these participants during the trial. Three participants died before outcome data had been collected at the initial 4-month follow-up, both of whom had SCL-D13 scores ≥20 (ie, classified as depressed in this model). This was applied to the primary analysis as depression-related mortality rate of 0.02 over 4 months. Cardiovascular events were not accounted for in the model as data were not available to explore whether/how the intervention was associated with their likelihood and long-term impact on health status.

Modelling resource use, costs and QALYs

The mean cost and SE of resource use (including direct costs of the collaborative care intervention) and utility weights observed in the trial were used to generate point estimates associated with the different health states in the model. Estimates were produced separately for each intervention group.

The event probability, cost and utility parameters are summarised in table 1. In the primary model, it was assumed that the impact of collaborative care on the utilities associated with each health state and the likelihood of moving between the health states was not sustained beyond the initial 4-month follow-up; utilities and event probabilities were the same in both models. This assumption was explored in one-way sensitivity analyses (described below).

Table 1

Model parameters for the decision tree and Markov model

Probabilistic sensitivity analysis

Probabilistic sensitivity analysis (PSA) was used to assess the level of parameter uncertainty (from uncertainty/variance in the data inputs). Each model parameter (event probability, cost or QALY) was assigned a primary value (mean base on data observed from COINCIDE) and a distribution of possible values (see table 1). Monte Carlo simulation was used to estimate mean expected costs and outcomes, and statistical measures of expected variance (SD) around the mean for each of 10 000 iterations drawn from the distributions defined. Each of the 10 000 net outcome estimates were revalued by a willingness to pay threshold (WTPT) of £20 000 (current NICE decision threshold).36 This was repeated for each of a range of WTPTs. A cost-effectiveness acceptability curve (CEAC) was plotted to show the proportion of bootstrapped simulations where the net benefit of collaborative care was greater than zero for each WTPT.43–46

One-way sensitivity analyses

Methodological uncertainty (from the model structure, selection of data inputs or other assumptions) was addressed by one-way sensitivity analysis. For each one-way sensitivity analysis, the parameter of interest was set to a specific value and the PSA and cost-effectiveness acceptability analyses rerun, to assess the robustness of the results to changes in that variable. Parameter values for sensitivity analyses were chosen either as systematic variations around the values in the primary model or from differences between observed data from COINCIDE and CADET and published meta-analyses (clinical effectiveness) and narrative systematic reviews (cost-effectiveness). The parameters tested by one-way sensitivity analysis included time horizon, effectiveness of collaborative care, discount rate for costs and QALYs, mortality rate, and intervention costs.

Results

Within-trial analysis

The probability of being depressed (SCL-D13≥20)41 at the end of the initial 4-month follow-up was lower for participants randomised to collaborative care (0.57, 95% CI 0.50 to 0.65) than usual care (0.72, 95% CI 0.66 to 0.78; p=0.004; imputed data). The mean cost per participant of delivering the collaborative care intervention (including training/supervision/set-up costs) was £317 (£168—when training costs were excluded). The mean (unadjusted) costs of health services used during the trial period was higher for the collaborative care group (£1896, 95% CI 1468 to 2224) than usual care (£1515, 95% CI 1205 to 1826); this included the cost of delivering the intervention and the cost of health services used. Use of health services is summarised by study arm in online supplementary table S1. The mean number of QALYs gained by participants randomised to collaborative care (0.185, 95% CI 0.064 to 0.303) was also higher than usual care (0.169, 95% CI 0.017 to 0.323). Although the mean costs and QALYs were higher for participants randomised to receive collaborative care, compared with usual care, the 95% CIs overlapped substantially, suggesting that these differences were not significant. Within the collaborative care arm, regardless of whether or not participants were depressed at follow-up, the mean QALYs were greater than for the usual care arm (depressed—mean QALYs: collaborative care (0.168); usual care (0.158); non-depressed—mean QALYs: collaborative care (0.207); usual care (0.196)). The ICER for the within-trial model was £29 132/QALY gained from collaborative care with a probability of 0.49 of being cost-effective at a WTPT of £20 000.

Economic model

Table 2 reports the mean costs and QALYs for the intervention groups which were used to calculate the ICER. The estimated cost per QALY gained from collaborative care over a 24-month time horizon (primary analysis) was £16 123. The uncertainty around this estimate is illustrated in figure 2 (represented by the spread of points on the cost-effectiveness plane) and figure 3 (CEAC). The probability that collaborative care is cost-effective (vs usual care) was 0.53 at a WTPT of £20 000 and 0.60 at a WTPT of £60 000 (figure 3). The probability that collaborative care was cost-effective fell below 0.5 at a WTPT of £7000.

Table 2

Cost-effectiveness results—primary and sensitivity analyses

Figure 2

Incremental cost-effectiveness, collaborative care versus usual care. QALY, quality-adjusted life year.

Figure 3

Cost-effectiveness acceptability curve. QALY, quality-adjusted life year.

Sensitivity analyses

Table 2 presents the results of sensitivity analyses of model assumptions. The results were not sensitive to alternative assumptions about: time horizon, training costs, the benefits of collaborative care over time, mortality rates or discount rates. The ICER changed as expected in response to these assumptions, ranging from £2103 to £22 843 per QALY/gained (over 24 months) with a probability of being cost-effective between 0.52 and 0.65.

Subgroup analyses

The model parameters used in subgroup analyses are reported in online supplementary table S2. The parameters were derived from the COINCIDE trial which was not powered for subgroup analyses. As such these parameters are more uncertain than for the whole sample and so results should be interpreted with caution. Online supplementary table S3 presents the results of subgroup analyses on the basis of age at baseline and number of physical conditions reported (in addition to diabetes/CHD). Based on the mean age of the sample (58 years), and the (former) age of retirement for women in England (60 years), two subgroups were defined: under 60 and 60+ years. There was little difference in the likelihood that collaborative care is cost-effective in participants under 60 years old (ICER £16 891; probability cost-effective (£20k/QALY) 0.49) or those older than 60 (ICER £23 358; probability cost-effective (£20k/QALY) 0.49), despite a lower ICER for the under 60 group. This reflects the additional uncertainty around these subgroup estimates. Based on the mean number of long-term conditions reported (other than diabetes or CHD), two subgroups were defined: fewer than 6 conditions and 6+ conditions. Collaborative care may be less likely to be cost-effective in participants with more than six additional conditions (ICER £33 210; probability cost-effective (£20k/QALY) 0.50), compared to those with fewer than six (ICER £9625; probability cost-effective (£20k/QALY) 0.55).

Discussion

Principal findings

The results described here suggest that over a 24-month time horizon, collaborative care, for patients with depression plus comorbid cardiovascular disease and/or diabetes, is potentially cost-effective compared with usual care in the English healthcare system.

Comparison with other studies

The relative risk of depression for usual versus collaborative care observed in COINCIDE was the same as estimated from a meta-analysis of RCTs over a range of follow-up periods up to 24 months.18 Comparison of the ICERs estimated from this model at 12, 24 and 36 months support the finding that collaborative care is better value over longer time horizons.28 Economic evaluation of the medium-term (12 month) effects of collaborative care in the English healthcare system reported from CADET was similar to the 12-month results from our model.26 The QALYs gained from collaborative care over 12 months (CADET 0.02; COINCIDE 0.03) and probability of cost-effectiveness at a WTPT of £20 000 (CADET 0.58; COINCIDE 0.53) were comparable. The estimated cost of delivering collaborative care (CADET £273; COINCIDE £317) and net cost of health service resources used were higher in COINCIDE (CADET £271; COINCIDE £560). This suggests that for COINCIDE participants, collaborative care was associated with an impact on health service usage. This may result from improved self-care/management of physical health conditions.20 ,27 This also reflects the specific impact of implementing collaborative care in patients with complex needs arising from multimorbidity and highlights the importance of examining this group as a special case. The mean QALY gain from collaborative care over 18–24 months reported in a systematic review24 was the same as when it was assumed that the benefit of collaborative care observed during COINCIDE waned by 10% every 4 months. Even when it was assumed that the beneficial effect of collaborative care increased by 25% every 4 months, the estimated QALY gain over 24 months (0.21) did not reach the level estimated by a seemingly comparable US study (0.34).25 This exemplifies the difficulty of generalising between studies and the need for health service-specific research.

Strengths and limitations

The parameters used in the decision model were derived from within-trial data and so are subject to the same strengths and limitations as the trial.19 COINCIDE was a large pragmatic trial (integrated within routine NHS settings) with good retention rates. A range of recruitment (eg, from diverse geographical/sociodemographic areas), randomisation (eg, cluster randomisation of practices) and analytic (eg, multiple imputation; adjusting for baseline characteristics) techniques were used to minimise bias and confounding and so ensure that the results of the economic evaluation are also likely to be robust and representative of routine practice.

Data regarding the usage of healthcare during the study period were self-reported by participants, collected via questionnaire at follow-up assessment. Participants may not be able to accurately recall each time they used a healthcare service, or may be unclear which category different services come under. These issues may affect people who use a large amount of healthcare services more. Verification against medical records may increase the reliability of these data; however, access to medical records was not agreed for COINCIDE participants.

There were 210 (54%) participants with complete EQ-5D (utility), healthcare usage (cost) and baseline covariate data. Multiple imputation of missing data for all COINCIDE participants reduced the potential for bias associated with missing data. However, the robustness of any imputation method declines as the level of missing data increases, reducing the validity and reliability of the analyses. For example, the high level of missing data and inconsistency of reporting for informal care received (from friends and family) meant that it was not possible to reliably impute data. The estimated cost-effectiveness may have been sensitive to the inclusion of informal care costs, but it is not possible to know the magnitude or direction of any effect. Findings reported here about the cost-effectiveness of collaborative care over 24 months (used to denote long-term follow-up in comparable trials of collaborative care18) were estimated from an extrapolation of short-term (4-month) trial data. The physical health conditions experienced by the cohort are long term and depression can also be a chronic, recurrent condition. The cost-effectiveness of collaborative care over 36 months (very long term) was explored in sensitivity analyses, but in this population, longer horizons (eg, 5–10 years) may also be important. There is already uncertainty around the ICERs estimated for 24 months. Extending the time horizon for this model would stretch the evidence from the trial too far (limiting robustness and increasing uncertainty). The economic model presented here demonstrated good external validity; results are supported by findings from other trials/reviews and the ICER changed as expected in response to the different one-way sensitivity analyses. Furthermore, the conclusion regarding cost-effectiveness and the probability that collaborative care is cost-effective did not vary greatly across sensitivity or subgroup analyses. This indicates that the model is robust. However, the probability of cost-effectiveness was conservative, even for an ICER of <£4000/QALY. This is due to differing levels of uncertainty around the estimates of costs and QALYs which can be seen by comparing the width of 95% CIs around the means (table 2 and see online supplementary table S3).

In a US study, collaborative care was associated with better self-management of diabetes and/or CHD.20 There may be an important long-term impact of improved self-management on mortality (or other long-term health outcomes), especially among patients with multimorbidities. It was not possible to ascertain the long-term effect of collaborative care on morbidity and mortality for COINCIDE participants and so this was not explored further here.

Conclusion

These findings contribute to the evidence base in support of the commissioning of collaborative care for patients with depression in England. For the first time, it has been demonstrated that collaborative care may also be cost-effective in the English health service for patient groups with depression in conjunction with long-term physical health conditions, and over a long-term time horizon. However, the long-term findings were extrapolated from 4-month trial data and so associated with some uncertainty. Collection of long-term and very long-term clinical and cost-effectiveness data from a pragmatic RCT of collaborative care for patients with multimorbidities, which can be included in an updated meta-analysis, is needed to address this uncertainty.

References

Footnotes

  • Twitter Follow Peter Coventry at @peteyc73, Peter Bower at @Bowercpcman, Elizabeth Camacho @e_camacho_UoM and Linda Davies @lmdHE1

  • Contributors PC, KL, CD, PB, CC-G, CB, and LG were responsible for drafting and revising the original trial protocol. PC was the chief investigator and had overall responsibility for management of the trial. KL, CC-G, LG and CB delivered the training to practice nurses, psychological well-being practitioners and clinical supervisors. EMC and DN wrote the economic analysis plan and cleaned and analysed the data under supervision from LMD. EMC wrote the first draft of the report and revised subsequent drafts. All authors contributed to and approved the final report.

  • Funding This trial was funded by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care for Greater Manchester (CLAHRC-GM).

  • Disclaimer The views expressed in this article are those of the authors and not necessarily those of the NIHR, NHS, or the Department of Health.

  • Competing interests All authors had financial support from NIHR for the submitted work. LG had other support from Six Degrees—social enterprise that provides step 2 IAPT services.

  • Ethics approval The study was approved by the National Research Ethics Service Committee North West-Preston (NRES/11/NW/0742); research governance approvals were granted by participating primary care trusts and informed consent was given by all patients.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.