Abstract
Background Mental health treatment rates are increasing, but the burden of disease has not reduced. Tools to support efficient resource distribution are required.
Aim To investigate whether a person-centred e-health (Target-D) platform matching depression care to symptom severity prognosis can improve depressive symptoms relative to usual care.
Design and setting Stratified individually randomised controlled trial in 14 general practices in Melbourne, Australia, from April 2016 to February 2019. In total, 1868 participants aged 18–65 years who had current depressive symptoms; internet access; no recent change to antidepressant; no current antipsychotic medication; and no current psychological therapy were randomised (1:1) via computer-generated allocation to intervention or usual care.
Method The intervention was an e-health platform accessed in the GP waiting room, comprising symptom feedback, priority-setting, and prognosis-matched management options (online self-help, online guided psychological therapy, or nurse-led collaborative care). Management options were flexible, neither participants nor staff were blinded, and there were no substantive protocol deviations. The primary outcome was depressive symptom severity (9-item Patient Health Questionnaire [PHQ-9]) at 3 months.
Results In intention to treat analysis, estimated between- arm difference in mean PHQ-9 scores at 3 months was −0.88 (95% confidence interval [CI] = −1.45 to −0.31) favouring the intervention, and −0.59 at 12 months (95% CI = −1.18 to 0.01); standardised effect sizes of −0.16 (95% CI = −0.26 to −0.05) and −0.10 (95% CI = −0.21 to 0.002), respectively. No serious adverse events were reported.
Conclusion Matching management to prognosis using a person-centred e-health platform improves depressive symptoms at 3 months compared to usual care and could feasibly be implemented at scale. Scope exists to enhance the uptake of management options.
INTRODUCTION
Despite significant investment in improving access to care,1 depression remains a leading contributor to the burden of disease and constitutes a significant public health issue.2 This in part reflects suboptimal targeting of care, with both over- and under-treatment occurring.1–3 Treatment guidelines and policy initiatives have aimed to address this mismatch by encouraging provision of the least intensive intervention that is likely to be effective for an individual (an approach known as stepped care).4,5 However, there is currently no consensus as to how the appropriate level of intervention intensity is identified. Therefore, building the evidence base to support the implementation of stepped care is key to reducing the time and resources currently required to identify an individual’s mental needs and match them to care accordingly.6–8
Such evidence is particularly important for primary care, where the majority of depression care is delivered.9,10 Currently, GPs rely mostly on clinical judgement when allocating depression care, which can be a time-consuming and inconsistent process.8 This is in contrast to other areas of medicine where a range of clinical prediction tools (CPTs) are available to streamline systematic decision making,11–15 although there is increasing recognition that such tools must be user-friendly and action-oriented in order to be successfully translated in routine practice.16 To address this gap the authors developed a CPT that uses self-reported biopsychosocial data to classify individuals into one of three prognostic groups based on the predicted severity of their depressive symptoms in 3 months’ time (minimal/mild, moderate, or severe).17 The CPT was then embedded into an e-health platform18 (henceforth referred to as the Target-D platform), which was designed using the principles of motivational interviewing19 and psychologically-driven goal modelling20 to deliver a person-centred approach to depression care.18 The Target-D platform provides patients with feedback on their responses, an opportunity to reflect on their mental health priorities and motivation to change, and a management option matched to their severity prognosis.
Depression is a leading contributor to the global burden of disease and a significant problem in primary care, where it is typically identified and managed. Stepped care approaches are recommended but difficult to implement in routine care, due in part to a lack of effective tools to guide GPs in matching intervention intensity to patient need. Therefore, a clinical prediction tool was developed, which was embedded into a person-centred e-health platform, that matches depression management options to symptom severity prognosis. This randomised controlled trial showed using this platform results in greater improvement in depressive symptoms at 3 months compared to usual care. This approach could be implemented in routine care to support more efficient and effective depression care without adding to GPs’ workload. |
In the Target-D randomised controlled trial (RCT), the primary aim was to investigate whether a complex intervention comprising the Target-D platform and matched management options for primary care patients with depressive symptoms improved depressive symptoms at 3-month follow-up, relative to usual care plus attention control (UC+). Secondary aims were to test for an intervention effect at 12 months overall, and within prognostic groups at both 3 and 12 months.
METHOD
Study design
This is a stratified individual RCT, enrolling primary care patients who screened positive for depressive symptoms (see protocol for details21). The intervention period lasted 3 months. No substantive changes to the published protocol were made.
Participants
Research assistants (RAs) recruited participants from the waiting rooms of 14 general practices in metropolitan Melbourne, Australia (Supplementary Appendix S1 describes practice characteristics). Adults aged 18–65 years were invited to complete an eligibility survey on an iPad, and were eligible if they reported: current depressive symptoms (≥2 on the 2-item version of the Patient Health Questionnaire [PHQ-2]22); no self-reported change to antidepressant medication in the past month; had access to the internet; and sufficient written English to follow an internet-based cognitive behavioural therapy (iCBT) programme. Patients reporting current use of antipsychotic medication or receipt of psychological therapy (online or face-to-face) were ineligible.
Randomisation occurred after participants provided informed consent and completed baseline measures (including items required for the CPT), all integrated with the Target-D platform on a purpose-built website accessible on any internet-enabled device.
Interventions
All participants received an automated email encouraging them to speak with their GP if they had concerns about their mental health and providing contact details for community-based services (for example, crisis support lines).
Intervention arm
Individuals received CPT feedback, set priorities, and received a management option matched to the prognostic group (see Supplementary Appendix S2). Briefly:
Minimal/mild: myCompass online programme,23 a CBT-based self-help resource where participants could choose from 15 modules (such as, ‘Tackling Unhelpful Thinking’ and ‘Communicating Clearly’).
Moderate: Worry and Sadness course of the This Way Up iCBT programme,24 which required participants to work through six lessons in sequence.
Severe: nurse-led collaborative care including up to eight contacts (over telephone or in person) with a trained research nurse to develop and implement a tailored depression management plan in conjunction with their GP.25–29
Control arm
Individuals received UC+ telephone call from an RA about trial involvement and to seek views about research participation.
Randomisation and blinding
Participants were randomly assigned to a trial arm (1:1, stratified by practice and prognostic group) using a computer- generated biased-coin algorithm with an imbalance intolerance of three embedded in the purpose-built website (see Supplementary Appendix S3).
Due to the nature of the intervention, participants could not be blinded to their allocated management option. Staff involved in intervention delivery (for example, RAs discussing management options or nurses delivering collaborative care) were also unblinded. GPs were notified only of participants allocated to collaborative care, with no emergency unblinding required. RAs responsible for contacting participants at follow-up were blinded to trial arm and prognostic group. All analyses were conducted and discussed while statisticians and study investigators remained blind to trial arm allocation.
Outcomes
Data were collected primarily via online survey at baseline and at 3- and 12-months post-randomisation. At each time-point, non-responders received phone, text, and/or email reminders and were offered alternative options for completion (such as via hard copy or phone). At trial enrolment, participants provided information on demographic (age, sex, education, and employment) and clinical characteristics relevant to trial exclusion criteria.
The primary outcome was depressive symptom scores at 3 months, assessed using the 9-item Patient Health Questionnaire (PHQ–9).30
Secondary outcomes included: depressive symptom severity at 12 months; anxiety symptom severity assessed using the 7-item Generalised Anxiety Disorder scale (GAD-7);31 mental health self-efficacy measured using the Mental Health Self- Efficacy Scale (MHSES);32 and quality of life using the Assessment of Quality of Life Instrument (AQoL-8D)33 at 3 and 12 months.
Sample size
For the primary hypothesis, 1320 participants (n = 660 per arm) provided 90% power at 5% significance two-tailed alpha to detect a standardised mean difference (SMD) of 0.2 in depressive symptoms at 3 months, assuming 20% attrition over 12 months of the follow-up period. For secondary hypotheses, the authors had 80% power to detect a between-arm SMD of 0.2 in depressive symptoms in the minimal/mild group and 0.5 within the moderate and severe groups, respectively. Calculations assumed 70% (n = 924) of participants would be in the minimal\mild group and 15% (n = 198) in each of the moderate and severe groups.
Statistical methods
All analyses were pre-defined in the statistical analysis plan34 and conducted using Stata (version 15). Main analyses employed an intention to treat (ITT) approach, where all participants were analysed in the trial arm to which they were allocated. Differences in mean outcomes between trial arms (intervention effect) were estimated with linear mixed- effects models, using restricted maximum likelihood with random intercepts for individuals. Stratification factors (practice or prognostic group) and time (baseline, 3, and 12 months) were included as fixed effects, with a two-way interaction between arm and time, except at baseline where trial-arm means were constrained to be equal. Similar mixed effects analysis was conducted for each prognostic group. Sensitivity analyses included random-effects for nurse in the severe group and assessed the robustness of the missing data assumption (see Supplementary Appendix S4). Complier average causal effect (CACE) analysis35 used a two stage-least squares instrumental regression with trial arm used as the instrumental variable for adherence to treatment.34
RESULTS
Figure 1 shows the trial profile. There were 1868 participants in total (n = 1270 female; n = 590 male; n = 8 other; mean age 35.5 [standard deviation = 12.1] years). The CPT classified 1357 (72.6%) participants to the minimal/mild group, 288 (15.4%) to the moderate group and 223 (11.9%) to the severe group. Some differential attrition was evident, with retention higher in the control arm overall (and within the minimal/mild and moderate prognostic groups). In the severe group, retention was higher in the intervention arm. Participants in the two trial arms were similar, overall and within prognostic groups (see Table 1 and Supplementary Appendix S1).
Figure 1. Participant flow through the trial. Denominators used to calculate the percentage with follow-up at 3- and 12-months are the total number of participants randomised overall and within each prognostic group. None of the withdrawals requested that their data be withdrawn prior to the statistical analysis. CPT = clinical prediction tool. ITT = intention to treat.
Table 1. Baseline characteristics of participant according to trial arm, in total and stratified by prognostic group, N = 1868
Primary outcome
The estimated difference in mean depressive scores at 3 months was −0.88, favouring the intervention arm (95% confidence interval [CI] = −1.45 to −0.31) (see Table 2 and Figure 2), equivalent to a SMD of −0.16 (95% CI = −0.26 to −0.05). Findings were robust to different missing data assumptions (see Supplementary Appendix S4).
Figure 2. Estimated mean depressive symptom severity (9-item Patient Health Questionnaire) with 95% confidence intervals for each trial arm, in total and by prognostic group and time-point.
Table 2. Depressive symptom severity (PHQ-9) score according to trial arm, in total and stratified by prognostic group
Secondary outcomes
At 12 months, weak evidence supported a smaller intervention effect on depressive symptoms at 12 months overall (see Table 2 and Figure 2), but no evidence for a difference in mean anxiety symptom severity between trial arms (see Table 3 and Supplementary Appendix S4). At 3 months mean mental health self-efficacy was 1.39 points higher in the intervention arm compared to the control arm (95% CI = 0.31 to 2.46). There was no evidence of an overall difference in mean quality of life between trial arms, although within the moderate group, mean scores were 0.05 points higher in the intervention arm (95% CI = 0.01 to 0.09) compared to control arm.
Table 3. Estimated difference in mean between trial arms for secondary outcomes, in total and stratified by prognostic group
Adherence-adjusted analyses
Five (0.7%) of 679 intervention participants in the minimal/mild group completed at least one myCompass module, and eight (5.6%) of 143 participants in the moderate group completed the Worry and Sadness course in full (see Supplementary Appendix S4). Given the few completers in these groups, no further planned analyses were conducted.
In the severe group, 64 participants (57.7%) attended at least one collaborative care appointment and 30 (27.0%) of 111 participants attended all eight (see Supplementary Appendix S4). Participants who completed all eight collaborative care appointments had a 5.2-point greater reduction in mean PHQ-9 score at 3 months (95% CI = −10.9 to 0.44) compared to their control arm counterparts, equivalent to an SMD of −1.4 (95% CI = −3.0 to 0.12) (data not shown).
DISCUSSION
Summary
To the authors’ knowledge, this is the first RCT of a person-centred e-health platform supporting prognosis-based allocation of depression management in primary care. For the primary outcome, results favoured the intervention overall, although the effect size was small. Pre-specified adherence-adjusted analysis identified greater improvements associated with completion of collaborative care in the severe group. The intervention effect on depressive symptoms had diminished by 12 months, and few differences were observed on secondary outcomes.
Strengths and limitations
Strengths include: individual randomisation and a primary outcome measure that allows comparison with international studies; successful recruitment to target with a balance of baseline characteristics between trial arms; primary outcome completion rates comparable to previous stepped depression care trials in primary care;36–41 and a pragmatic design that tested a model of care designed for scalability. However, low uptake of online management options limited the ability to complete planned analyses, and the wide availability of depression care in Australian primary care42 (see Supplementary Appendix S5) may have reduced the potential for the intervention to improve on usual care. The focus on depression may reduce generalisability to other mental health conditions and the authors did not assess symptom duration at enrolment, although a low threshold for eligibility was set and interventions were not disorder specific. Greater attrition than anticipated was observed and finally, the approach was limited to initial allocation only and intervention intensity was not adjusted according to participant response.
Comparison with existing literature
Development of revolutionary new treatments for depression is considered unlikely.43 Instead, efforts to reduce the burden of disease have focused on better tailoring of existing interventions, leading to the development and testing of a range of stepped care approaches. While overall effect size at 3 months (−0.16) was lower than that reported in a stepped care meta-analysis (−0.34),44 CIs included the clinically relevant value of −0.24 proposed by Cuijpers and colleagues.45 Importantly, effect in the present study was achieved through delivery of a minimally time- and resource-intensive intervention in a routine setting across a large number of practices. Further, the meta-analysis by Cuijpers and colleagues45 assessed the effectiveness of stepped care in people meeting diagnostic criteria for depression whereas effect in the present study was observed in a heterogenous sample reflecting real-life primary care.46
Within prognostic groups, observed effect was smaller than that reported in previous RCTs of myCompass32 and This Way Up47,48 but similar to iCBT effect sizes in primary care settings.49,50 This is further compounded by the low rates of programme completion, although even if all participants completed their recommended programme, they had limited room for symptom improvement. Within the severe group, estimated effect size was consistent with previous trials of collaborative care,25,51–54 contributing to the growing literature showing that nurse-delivered collaborative care is both effective and acceptable in the management of depression.55 Participants who completed the full course of collaborative care reported substantial improvements, the effect size comparing favourably to that associated with antidepressants.56 Analysis of the characteristics of completers and their tailored management plans is underway to refine the intervention to enhance uptake and completion (manuscript in preparation).
This novel, theory-driven approach provides not only assessment but a prompt to reflect on priorities and motivation, aiming to empower patients to take ownership of their mental health care. Patients are triaged to care according to their predicted severity of depressive symptoms in 3 months’ time, rather than severity when first assessed. This approach incorporates broader determinants of poor mental health (for example, financial and physical health difficulties), which are critical to delivering comprehensive primary care, and recognises that mild and transitory depressive symptoms are prevalent and will often resolve without formal intervention. Current policy aims to redirect the minimal/mild group away from face-to-face services and towards lower intensity (including online) interventions, in line with clinical guidelines.4,5 However, present study findings suggest simply recommending these interventions, even when designed to activate patients towards uptake,18 was insufficient to encourage their use. This experience is not unique; research and policy interest in online interventions has not yet translated into their widespread use (and the multifaceted reasons for this are discussed elsewhere).57–61 This is a rapidly evolving field and emerging health, social, and economic levers may improve acceptability of online interventions, and thus the potential for an approach like Target-D to serve as an effective conduit. For instance, public health crises such as the COVID-19 pandemic may necessitate greater engagement with online programmes62 due to overburdened health systems and a pressing need to efficiently triage people to mental health care without lengthy consultation in general practice.
Implications for research and practice
Mental health remains the predominant issue managed in primary care,63 despite substantial and sustained investment. Worldwide, health systems face the challenge of ensuring that investments are well targeted to optimise patient outcomes and experiences of care. It is likely that improvements in mental health care will be incremental and gained by ongoing optimisation of promising approaches. The Target-D person-centred, e-health platform, which can quickly and easily triage and tailor depression care to severity prognosis, is a promising component of stepped mental health care. The authors present the cost-effectiveness of this approach elsewhere.64 While the trial was not set up to test the effectiveness of the Target-D platform and matched management options in preventing disorder onset, this may be an avenue for future research. Alternatively, an option for implementation may be to offer the Target-D platform to all patients but provide matched management options only to the moderate and severe groups where the potential for improvement is greater. Findings also support further research into how to optimise uptake, particularly of low intensity services.
Acknowledgments
The authors thank all the patients, GPs, and general practices who took part in Target-D, and the many research assistants who assisted with data collection. The data used to develop the clinical prediction tool were collected as a part of the diamond project, which was funded by the NHMRC (references: 299869, 454463, 566511, 1002908). The authors acknowledge the 30 dedicated GPs, their patients, and general practice staff for making the diamond study possible. The authors also acknowledge staff and students at the School of Computing and Information Systems at the University of Melbourne for early work that informed the presentation of the e-health platform as well as the focus group participants that provided feedback on early versions of the Target-D materials. Finally, the authors thank staff at the former Melbourne Networked Society Institute, who were funded to build the Target-D website.
Notes
Funding
Target-D was funded by a grant from
the National Health and Medical Research Council (NHMRC) (reference: 1059863, 2014–2018). The funding body had no role in the design and conduct of the study; collection, management analysis, and interpretation of the data; preparation, review or approval of the manuscript; or decision to submit the manuscript for publication.
Ethical approval
Ethical approval was provided by the Human Research Ethics Committee at the University of Melbourne (reference: 1543648)
Competing interests
The authors have declared no competing interests.
Discuss this article
Contribute and read comments about this article: bjgp.org/letters
- Received August 20, 2020.
- Revision requested November 18, 2020.
- Accepted December 11, 2020.
REFERENCES
- 1.↵
- 2.↵
- 3.↵
- 4.↵
- 5.↵
- 6.↵
- 7.
- 8.↵
- 9.↵
- 10.↵
- 11.↵
- 12.
- 13.
- 14.
- 15.↵
- 16.↵
- 17.↵
- 18.↵
- 19.↵
- 20.↵
- 21.↵
- 22.↵
- 23.↵
- 24.↵
- 25.↵
- 26.
- 27.
- 28.
- 29.↵
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.
- 38.
- 39.
- 40.
- 41.↵
- 42.↵
- 43.↵
- 44.↵
- 45.↵
- 46.↵
- 47.↵
- 48.↵
- 49.↵
- 50.↵
- 51.↵
- 52.
- 53.
- 54.↵
- 55.↵
- 56.↵
- 57.↵
- 58.
- 59.
- 60.
- 61.↵
- 62.↵
- 63.↵
- 64.↵