Skip to main content

Main menu

  • HOME
  • ONLINE FIRST
  • CURRENT ISSUE
  • ALL ISSUES
  • AUTHORS & REVIEWERS
  • SUBSCRIBE
  • BJGP LIFE
  • MORE
    • About BJGP
    • Conference
    • Advertising
    • eLetters
    • Alerts
    • Video
    • Audio
    • Librarian information
    • Resilience
    • COVID-19 Clinical Solutions
  • RCGP
    • BJGP for RCGP members
    • BJGP Open
    • RCGP eLearning
    • InnovAIT Journal
    • Jobs and careers

User menu

  • Subscriptions
  • Alerts
  • Log in

Search

  • Advanced search
British Journal of General Practice
Intended for Healthcare Professionals
  • RCGP
    • BJGP for RCGP members
    • BJGP Open
    • RCGP eLearning
    • InnovAIT Journal
    • Jobs and careers
  • Subscriptions
  • Alerts
  • Log in
  • Follow bjgp on Twitter
  • Visit bjgp on Facebook
  • Blog
  • Listen to BJGP podcast
  • Subscribe BJGP on YouTube
Intended for Healthcare Professionals
British Journal of General Practice

Advanced Search

  • HOME
  • ONLINE FIRST
  • CURRENT ISSUE
  • ALL ISSUES
  • AUTHORS & REVIEWERS
  • SUBSCRIBE
  • BJGP LIFE
  • MORE
    • About BJGP
    • Conference
    • Advertising
    • eLetters
    • Alerts
    • Video
    • Audio
    • Librarian information
    • Resilience
    • COVID-19 Clinical Solutions
Research

Clinical coding of long COVID in English primary care: a federated analysis of 58 million patient records in situ using OpenSAFELY

Alex J Walker, Brian MacKenna, Peter Inglesby, Laurie Tomlinson, Christopher T Rentsch, Helen J Curtis, Caroline E Morton, Jessica Morley, Amir Mehrkar, Seb Bacon, George Hickman, Chris Bates, Richard Croker, David Evans, Tom Ward, Jonathan Cockburn, Simon Davy, Krishnan Bhaskaran, Anna Schultze, Elizabeth J Williamson, William J Hulme, Helen I McDonald, Rohini Mathur, Rosalind M Eggo, Kevin Wing, Angel YS Wong, Harriet Forbes, John Tazare, John Parry, Frank Hester, Sam Harper, Shaun O’Hanlon, Alex Eavis, Richard Jarvis, Dima Avramov, Paul Griffiths, Aaron Fowles, Nasreen Parkes, Ian J Douglas, Stephen JW Evans, Liam Smeeth, Ben Goldacre and (The OpenSAFELY Collaborative)
British Journal of General Practice 2021; 71 (712): e806-e814. DOI: https://doi.org/10.3399/BJGP.2021.0301
Alex J Walker
Roles: Epidemiologist
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brian MacKenna
Roles: Honorary clinical researcher
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter Inglesby
Roles: Consultant engineer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Laurie Tomlinson
Roles: Associate professor
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christopher T Rentsch
Roles: Assistant professor in pharmacoepidemiology
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Helen J Curtis
Roles: Postdoctoral researcher
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Caroline E Morton
Roles: Epidemiologist
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jessica Morley
Roles: Policy lead
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Amir Mehrkar
Roles: Honorary clinical researcher
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Seb Bacon
Roles: Chief technical officer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
George Hickman
Roles: Consultant programmer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chris Bates
Roles: Director of research and analytics
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard Croker
Roles: Honorary research fellow
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Evans
Roles: Software developer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tom Ward
Roles: Consultant software developer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan Cockburn
Roles: Developer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Simon Davy
Roles: Consultant programmer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Krishnan Bhaskaran
Roles: Professor of statistical epidemiology
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anna Schultze
Roles: Research fellow
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elizabeth J Williamson
Roles: Biostatistician
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William J Hulme
Roles: Statistician
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Helen I McDonald
Roles: Clinical research fellow
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rohini Mathur
Roles: Assistant professor in epidemiology
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rosalind M Eggo
Roles: Associate professor
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kevin Wing
Roles: Assistant professor in epidemiology
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Angel YS Wong
Roles: Research fellow
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Harriet Forbes
Roles: Research fellow
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John Tazare
Roles: Research fellow
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John Parry
Roles: Clinical director
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Frank Hester
Roles: Chief executive officer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sam Harper
Roles: Developer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shaun O’Hanlon
Roles: Chief medical officer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alex Eavis
Roles: Director of analytics
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard Jarvis
Roles: Chief analytics officer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dima Avramov
Roles: Director of artificial intelligence
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul Griffiths
Roles: Principal test engineer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Aaron Fowles
Roles: Senior data engineer
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nasreen Parkes
Roles: Product owner
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ian J Douglas
Roles: Professor
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stephen JW Evans
Roles: Professor of pharmacoepidemiology
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Liam Smeeth
Faculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London.
Roles: Professor of clinical epidemiology
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ben Goldacre
The DataLab, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford.
Roles: Director
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info
  • eLetters
  • PDF
Loading

Abstract

Background Long COVID describes new or persistent symptoms at least 4 weeks after onset of acute COVID-19. Clinical codes to describe this phenomenon were recently created.

Aim To describe the use of long-COVID codes, and variation of use by general practice, demographic variables, and over time.

Design and setting Population-based cohort study in English primary care.

Method Working on behalf of NHS England, OpenSAFELY data were used encompassing 96% of the English population between 1 February 2020 and 25 May 2021. The proportion of people with a recorded code for long COVID was measured overall and by demographic factors, electronic health record software system (EMIS or TPP), and week.

Results Long COVID was recorded for 23 273 people. Coding was unevenly distributed among practices, with 26.7% of practices having never used the codes. Regional variation ranged between 20.3 per 100 000 people for East of England (95% confidence interval [CI] = 19.3 to 21.4) and 55.6 per 100 000 people in London (95% CI = 54.1 to 57.1). Coding was higher among females (52.1, 95% CI = 51.3 to 52.9) than males (28.1, 95% CI = 27.5 to 28.7), and higher among practices using EMIS (53.7, 95% CI = 52.9 to 54.4) than those using TPP (20.9, 95% CI = 20.3 to 21.4).

Conclusion Current recording of long COVID in primary care is very low, and variable between practices. This may reflect patients not presenting; clinicians and patients holding different diagnostic thresholds; or challenges with the design and communication of diagnostic codes. Increased awareness of diagnostic codes is recommended to facilitate research and planning of services, and also surveys with qualitative work to better evaluate clinicians’ understanding of the diagnosis.

  • COVID-19
  • general practice
  • electronic health records
  • long COVID
  • primary health care

INTRODUCTION

Long COVID has been broadly defined as new or persistent symptoms of COVID-19 beyond the acute phase of SARS-CoV-2 infection.1 The National Institute for Health and Care Excellence (NICE) have produced guidance on managing the long-term effects of COVID-19 as these symptoms can have a significant effect on a person’s quality of life.1 NICE recognise that as long COVID is such a new condition the exact clinical definition and treatments are evolving.

A recent systematic review found a very high prevalence of persisting COVID symptoms after COVID diagnosis.2 For symptoms lasting 4–12 weeks 83% of people reported at least one persisting symptom, whereas for symptoms lasting beyond 12 weeks, the proportion was 56%. The reported associated symptoms are numerous, but include fatigue, shortness of breath, cough, smell or taste dysfunction, cognitive impairment, and muscle pain.

NICE developed their definitions and clinical guidelines using a ‘living’ approach based on early data. This means that the guidelines will be continuously reviewed and updated and it is therefore critical to continue studying the long-term effects of COVID-19 as data accrue, and refine the guidelines appropriately. To support this need, long-COVID SNOMED-CT codes (‘diagnostic codes’ listed in Box 1) were developed and released in the UK in November 2020. To support clinical care and implementation of NICE guidance, distinct SNOMED-CT codes were made available by NHS Digital, which distinguish between the length of ongoing symptoms. SNOMED-CT is an international structured clinical coding system for use in electronic health records. Symptoms between 4 and 12 weeks are defined as ‘ongoing symptomatic disease caused by severe acute respiratory syndrome coronavirus 2’, and symptoms continuing beyond 12 weeks as ‘post-COVID-19 syndrome’.3 There are also three assessment codes and 10 referral codes relating to long COVID; however, none of these codes explicitly contain the term ‘long COVID’.

Code type and codeTerm
Diagnostic codes
1325161000000102Post-COVID-19 syndrome
1325181000000106Ongoing symptomatic disease caused by severe acute respiratory syndrome coronavirus 2
Referral codes
1325021000000106Signposting to Your COVID Recovery
1325031000000108Referral to post-COVID assessment clinic
1325041000000104Referral to Your COVID Recovery rehabilitation platform
Assessment codes
1325051000000101Newcastle post-COVID syndrome Follow-up Screening Questionnaire
1325061000000103Assessment using Newcastle post-COVID syndrome Follow-up Screening Questionnaire
1325071000000105COVID-19 Yorkshire Rehabilitation Screening tool
1325081000000107Assessment using COVID-19 Yorkshire Rehabilitation Screening tool
1325091000000109Post-COVID-19 Functional Status Scale patient self-report
1325101000000101Assessment using Post-COVID-19 Functional Status Scale patient self-report
1325121000000105Post-COVID-19 Functional Status Scale patient self-report final scale grade
1325131000000107Post-COVID-19 Functional Status Scale structured interview final scale grade
1325141000000103Assessment using Post-COVID-19 Functional Status Scale structured interview
1325151000000100Post-COVID-19 Functional Status Scale structured interview
Box 1.

Long-COVID SNOMED-CT codes and terms

Early case definitions and clinical guidelines have been published to describe long COVID, and clinical codes based on these guidelines were published in late 2020. This study found wide variation in the early use of these codes, by practice, geographic region, and practice electronic health record software. Promotion of the clinical guidance and codes is important for future research and ongoing patient care.

How this fits in

Appropriate coding of long COVID is critical for ongoing patient care, research into the condition, policymaking, and public health resource planning. This study set out to describe the use of long-COVID codes in English primary care since their introduction, in a cohort covering approximately 96% of the English population — those covered by the two largest electronic health record providers, EMIS and TPP (SystmOne). A further aim was to describe the variation of use among general practices, demographic variables, and over time.

METHOD

Study design and data sources

A population-based cohort study was conducted that calculated the period prevalence of long COVID recording in electronic health record (EHR) data. Primary care records managed by the GP software providers EMIS and TPP were accessed through OpenSAFELY, an open-source data analytics platform created by the authors on behalf of NHS England to address urgent COVID-19 research questions (https://opensafely.org). OpenSAFELY provides a secure software interface allowing a federated analysis of pseudonymised primary care patient records from England in near real-time within the EMIS and TPP highly secure data environments. Nondisclosive, aggregated results are exported to GitHub (an online code repository) where further data processing and analysis takes place. This avoids the need for large volumes of potentially disclosive pseudonymised patient data to be transferred off-site. This, in addition to other technical and organisational controls, minimises any risk of re-identification.

The dataset available to the platform includes pseudonymised data such as coded diagnoses, medications, and physiological parameters. No free-text data were included. All activity on the platform is publicly logged and all analytic code and supporting clinical coding lists are automatically published. In addition, the framework provides assurance that the analysis is reproducible and reusable. Further details on the information governance and platform can be found in Supplementary Appendix S1.

Population

All people registered with a general practice on the 1 November 2020 were included.

Outcome

The outcome was any record of long COVID in the primary care record. This was defined using a list of 15 UK SNOMED-CT codes (Box 1) and categorised as diagnostic (two codes), referral (three codes), and assessment (10 codes).4 The outcome was measured between the study start date (1 February 2020) and the end date (25 April 2021). Although the start date is before the codes were created, it is possible for a GP to backdate diagnostic codes in a GP system when they are entered. Timing of outcomes was determined by the first record of a SNOMED-CT code for each person, as determined by the date recorded by the clinician.

Stratifiers

Demographic variables were extracted including age (in categories), sex, geographic region, Index of Multiple Deprivation (IMD, divided into quintiles), and ethnicity. IMD is a widely used geographical-based measure of relative deprivation based on factors such as income, employment, and education. Counts and rates of recorded events were stratified by each demographic variable. Recording of each SNOMED-CT code was assessed individually, in this case, counting every recorded code including repeated codes, rather than one per patient.

Statistical methods

Proportions of patients with long-COVID codes over the whole study period per 100 000 patients, 95% confidence intervals (CIs) of those proportions, and the distribution of codes by each stratification variable were calculated. All long-COVID-related codes, as listed in Box 1, were included.

Software and reproducibility

Data management and analysis was performed using the OpenSAFELY software libraries and Jupyter notebooks, both implemented using Python 3. More details are available in Supplementary Appendix S1. This is an analysis delivered using federated analysis through the OpenSAFELY platform. A federated analysis involves carrying out patient-level analysis in multiple secure datasets, then later combining them: codelists and code for data management and data analysis were specified once using the OpenSAFELY tools; then transmitted securely from the OpenSAFELY jobs server to the OpenSAFELY–TPP platform within TPP’s secure environment, and separately to the OpenSAFELY–EMIS platform within EMIS’s secure environment, where they were each executed separately against local patient data; summary results were then reviewed for disclosiveness, released, and combined for the final outputs. All code for the OpenSAFELY platform for data management, analysis, and secure code execution is shared for review and reuse under open licenses at GitHub. com/OpenSAFELY. All code for data management and analysis for this article is shared for scientific review and reuse under open licenses on GitHub (https://github.com/opensafely/long-covid).

RESULTS

Cohort characteristics and overall rate of recording

There were 58.0 million people in the combined cohort in total; 24.0 million in the TPP cohort and 34.0 million in the EMIS cohort. Demographics of the cohort are described in Table 1.

View this table:
  • View inline
  • View popup
Table 1.

Characteristics of the cohort

Up to 25 April 2021, there were 23 273 (0.04%) patients with a recorded code indicative of a long-COVID diagnosis (Table 2). A higher proportion of these recorded diagnoses were in EMIS, with 18 262 (0.05%), compared with 5011 (0.02%) in TPP. Taking into account the larger total number of patients in EMIS practices, the rate over the whole study period was 53.7 per 100 000 people (95% CI = 52.9 to 54.4) in EMIS and 20.9 (95% CI = 20.3 to 21.4) in TPP.

View this table:
  • View inline
  • View popup
Table 2.

Counts and rates of long-COVID coding stratified by demographic variable

Rate of coding stratified by demographics

Counts and rates of long-COVID coding stratified by demographic factors are presented in Table 2. For age, the incidence of long-COVID recording rose to a peak in the 45–54 years age group, before declining again in older age groups. Females had a higher rate of recording than males (52.1 [95% CI = 51.3 to 52.9] versus 28.1 [95% CI = 27.5 to 28.7] per 100 000 people). Counts of long-COVID recording by IMD and ethnicity are reported in Table 2. Also reported in Table 2 are counts broken down by EHR software provider. Here some similarities and differences in the rates were observed; the proportions of events for age and sex are fairly comparable whereas region, IMD, and ethnicity show some differences.

Geographic and practice distribution of coding

The rate of coding varied substantially between regions (Table 2), from a minimum proportion of 20.3 per 100 000 people in the East of England (95% CI = 19.3 to 21.4) to 55.6 in London (95% CI = 54.1 to 57.1). Given that EMIS practices overall had higher rates of recording than TPP, some of this geographic variation may be related to the EHR software provider. For example, EMIS covers a high proportion of the London population, whereas TPP covers a high proportion of the East of England (Table 1).

Over one-quarter (26.7%) of practices have not used the codes at all (data not shown). This proportion is much higher in practices using TPP (44.2%) than those using EMIS (15.1%) (Figure 1). The distribution is described more fully in Figure 1. The highest number of codes in a single practice was 150 (data not shown).

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Volume of code use in individual practices, stratified by the electronic health record provider of the practice (TPP/SystmOne or EMIS).

Rate of coding over time

The number of recorded events was relatively low until the end of January 2021, after which there was an increase in coding (Figure 2). This increase was more marked in EMIS practices, which before that time had recorded fewer long-COVID codes overall than TPP practices. It was very infrequent to find records that had been backdated to before November 2020 when the codes were created, with <0.1% of codes coded as occurring before November 2020 (data not shown).

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

Use of long-COVID codes over time, stratified by the electronic health record provider of the practice (TPP/SystmOne or EMIS). Reporting lag may affect recent dates.

Coding of individual SNOMED-CT codes

The diagnostic codes were the most commonly used codes, particularly the ‘Post-COVID-19 syndrome’ code, which accounted for 64.3% of all recorded codes (Table 3). There were differences in the distribution of codes, however, between TPP and EMIS practices. Codes relating to assessment of long COVID accounted for just 2.4% of long-COVID codes used to date.

View this table:
  • View inline
  • View popup
Table 3.

Total use of each individual long-COVID-related codea

DISCUSSION

Summary

As of late April 2021, 23 273 people had a record of at least one long-COVID code in their primary care record. Use between different general practices varied greatly, and a large proportion (26.7%) have never used any long-COVID codes. Substantially higher recording in practices that use EMIS compared with those that use TPP was found. Among those people who did have a recorded long-COVID code, rates were highest in the working-age population and were more common in females.

Strengths and limitations

The key strength of this study is its unprecedented scale; >58 million people were included, 96% of the population in England. In contrast with many studies that use EHR data, in this study it was possible to compare long-COVID diagnostic codes between practices that use different software systems. A striking disparity was found: this has important implications for understanding whether clinicians are using the codes appropriately. A key weakness of this data for estimating true prevalence of long COVID in primary care, and factors associated with the condition, is that it relies on clinicians formally entering a diagnostic or referral code into the patient’s record: this is a limitation of all EHR research for all clinical conditions and activity, however, the emergence of a new diagnosis and the recent launch of a new set of diagnostic codes may present challenges in this regard. As a result of these current limitations, this study did not aim to estimate the prevalence of long COVID, or aim to make causal inferences about the observed variation.

Comparison with existing literature

To the authors’ knowledge, there are no other studies on prevalence of long COVID using clinicians’ diagnoses or EHRs data. There are numerous studies using self-reported data from patients on the prevalence of continued symptoms following COVID-19, with estimates varying between 4.5% and 89%, largely because of highly variable case definitions;5 individual symptoms characterising long COVID have been reported as fatigue, headache, dyspnoea, and anosmia.6 The Office for National Statistics COVID Infection Survey estimates prevalence of self-diagnosed long COVID at 13.7%.7 Separately, numerous cohort studies have reported an increased risk of serious cardiovascular and metabolic outcomes following hospital admission with COVID-19,8,9 and there are various prospective studies such as the Post-hospitalisation COVID-19 study following-up patients for the year following their hospital admission.10 Other studies have examined variation in clinical coding, with some finding that ‘poor’ coding can lead to altered incidence estimates,11 whereas others implicate the design of clinical software systems in influencing variation.12–14

Implications for research and practice

The prevalence of long-COVID codes in primary care that are reported in this study is extremely low when compared with current survey data on long-COVID prevalence.15,16 This conflict may be attributable to a range of different possible causes related to information bias including: patients not yet presenting to primary care with long COVID; different clinicians and patients holding different diagnostic thresholds or criteria for long COVID; and issues around coding activity including clinicians not yet knowing about the long-COVID diagnostic codes, the design and text of the long-COVID diagnostic codes, and the design of EHR systems in which the codes can be selected for entry onto a patient record.

The large variation in the apparent rate of long COVID between different geographic regions, practices, and EHR systems strongly suggests that clinicians’ coding practice is inconsistent at present. This suggests variation in awareness of the new diagnostic codes that were only launched in November 2020, and only available in EMIS at the end of January 2021. In addition, the codes for long COVID and associated synonyms do not currently contain the term ‘long COVID’: this was an active choice by NHS Digital who manage SNOMEDCT UK codes.1 The October 2020 NICE consultation on management of the long-term effects of COVID-19 does mention the term ‘long COVID’, although the term was not incorporated into the clinical definitions that were translated into diagnostic codes by NHS Digital.1 These decisions were carefully thought through at the time they were made; however, as a result of broader contextual shifts in language over time there is now a clear mismatch between formal clinical terminology and popular parlance among clinicians and patients. The view of the authors of this study is that those managing SNOMED-CT terminology for England should either update the long-COVID codes to include the phrase ‘long COVID’, ideally in advance of the upcoming new SNOMED-CT international release; or energetically disseminate their preferred new phrasing to all frontline clinicians, to ensure more appropriate use of these codes. Similarly NICE and other authoritative bodies giving guidance on long COVID should energetically communicate to clinicians the importance of correctly coding long COVID in patient records. It is a high national priority to estimate the prevalence of long COVID, identify its causes and consequences, and plan services appropriately.

The variation in the rate of diagnostic code usage between users of different EHR software is also striking. This difference could plausibly be responsible for some of the other variation described. For example, as noted in the results, some regions have a high percentage of coverage from one software provider. After speaking with clinicians and both software vendors, the reasons for the difference remain unclear, but are likely attributable to differences in user interface, which has previously been shown to influence clinicians’ treatment choices.13,14 This should be addressed by interviewing GPs about their experiences with diagnosing and treating people with long COVID in each system.

Despite these issues around correct recording of clinicians’ diagnoses, there also remains a strong possibility that clinicians are not currently diagnosing their patients as having long COVID. This may be because patients are not presenting with long COVID to services, for a range of reasons during a pandemic; or their clinicians are not diagnosing them with long COVID when they are seen. The view of the authors is that this can only be resolved by conducting prospective surveys with clinicians themselves, evaluating how many patients they have seen with a condition they would understand to be diagnosable as long COVID, alongside qualitative research on the topic.

The issues with recording of long COVID described here also have implications for future research. It is likely that recording will improve over time, as disease definitions are improved, guidelines are iterated on, and clinicians become more aware of the condition. It is likely also worth considering additional approaches to identifying long COVID in routine medical data. This might include identifying and measuring broad groups of symptoms that are associated with long COVID.17

If it is accepted that the different rates of long COVID usage in each subgroup reflects the true comparative risk for each demographic then there are two key findings. First, the lower rate in older patients, despite their higher prevalence of severe acute COVID-19 outcomes,18 which may be affected by the competing risk of death in patients with COVID-19. Second, the higher rate of long COVID in females, despite the higher prevalence of severe acute COVID outcomes in males,18 which may be explained in part by differences in routine consultation rates between males and females.19

In conclusion, current recording of long COVID in primary care is very low, and variable between practices. This may reflect patients not presenting; clinicians and patients holding different diagnostic thresholds; or challenges with the design and communication of diagnostic codes. This analysis will be updated regularly with extended follow-up time.

Acknowledgments

The authors are very grateful for all the support received from the EMIS and TPP Technical Operations team throughout this work, and for generous assistance from the information governance and database teams at NHS England/NHSX.

Notes

Funding

This study was jointly funded by UK Research and Innovation (UKRI), National Institute for Health Research (NIHR), and Asthma UK-BLF (reference numbers: COV0076; MR/V015737/), and the Longitudinal Health and Wellbeing strand of the National Core Studies programme. EMIS and TPP provided technical expertise and infrastructure within their data environments pro bono in the context of a national emergency. The OpenSAFELY software platform is supported by a Wellcome Discretionary Award. Ben Goldacre’s work on clinical informatics is supported by the NIHR Oxford Biomedical Research Centre and the NIHR Applied Research Collaboration Oxford and Thames Valley. Funders had no role in the study design, collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication. The views expressed are those of the authors and not necessarily those of the NIHR, NHS England, Public Health England, or the Department of Health and Social Care.

Ethical approval

NHS England is the data controller; EMIS and TPP are the data processors; and the key researchers on OpenSAFELY are acting on behalf of NHS England. This study was approved by the Health Research Authority (Research Ethics Committee reference: 20/LO/0651) and by the London School of Hygiene and Tropical Medicine Ethics Board (reference: 21863).

Provenance

Freely submitted; externally peer reviewed.

Competing interests

All authors have completed the International Committee of Medical Journal Editors uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare the following: over the past 5 years Ben Goldacre has received research funding from the Laura and John Arnold Foundation, the NHS, NIHR, the NIHR School of Primary Care Research, the NIHR Oxford Biomedical Research Centre, the Mohn-Westlake Foundation, NIHR Applied Research Collaboration Oxford and Thames Valley, the Wellcome Trust, the Good Thinking Foundation, Health Data Research UK, the Health Foundation, and the World Health Organization; he also receives personal income from speaking and writing for lay audiences on the misuse of science. Krishnan Bhaskaran holds a Sir Henry Dale fellowship jointly funded by Wellcome and the Royal Society (reference: 107731/Z/15/Z). Helen I McDonald is funded by the NIHR Health Protection Research Unit in Immunisation, a partnership between Public Health England and the London School of Hygiene and Tropical Medicine. Angel YS Wong holds a fellowship from the British Heart Foundation. Elizabeth J Williamson holds grants from the Medical Research Council (MRC). Rohini Mathur holds a Sir Henry Wellcome Fellowship funded by the Wellcome Trust (reference: 201375/Z/16/Z). Harriet Forbes holds a UKRI fellowship. Ian J Douglas has received unrestricted research grants and holds shares in GlaxoSmithKline.

Contributors

Ben Goldacre/Liam Smeeth are guarantors of the OpenSAFELY project.

Discuss this article

Contribute and read comments about this article: bjgp.org/letters

Footnotes

  • Twitter: @UoS_PrimaryCare

  • Received May 7, 2021.
  • Revision requested June 15, 2021.
  • Accepted June 18, 2021.
  • © The Authors
http://creativecommons.org/licenses/by/4.0/

This article is Open Access: CC BY 4.0 licence (http://creativecommons.org/licences/by/4.0/).

REFERENCES

  1. 1.↵
    1. National Institute for Health and Care Excellence
    (2020) COVID-19 rapid guideline: managing the long-term effects of COVID-19 NG188, https://www.nice.org.uk/guidance/ng188 (accessed 19 Jul 2021).
  2. 2.↵
    1. Domingo FR,
    2. Waddell LA,
    3. Cheung AM,
    4. et al.
    (2021) Prevalence of long-term effects in individuals diagnosed with COVID-19: a living systematic review. medRxiv, DOI: http://doi.org/10.1101/2021.06.03.21258317.
  3. 3.↵
    1. National Institute for Health and Care Excellence
    (2020) COVID-19 rapid guideline: managing the long-term effects of COVID-19 1 Identifying people with ongoing symptomatic COVID-19 or post-COVID-19 syndrome NG188, https://www.nice.org.uk/guidance/ng188/chapter/1-Identifying-people-withongoing-symptomatic-COVID-19-or-post-COVID-19-syndrome (accessed 19 Jul 2021).
  4. 4.↵
    1. NHS Digital
    (2020) COVID-19 information standards: COVID-19 SNOMED CT codes by groups 20201221v1.0. https://hscic.kahootz.com/connect.ti/COVID19_info_sharing/view?objectId=67227941 (accessed 19 Jul 2021).
  5. 5.↵
    1. National Institute for Health Research
    (2021) Living with Covid19 — Second review, https://evidence.nihr.ac.uk/themedreview/living-with-covid19-secondreview (accessed 8 July 2021).
  6. 6.↵
    1. Sudre CH,
    2. Murray B,
    3. Varsavsky T,
    4. et al.
    (2021) Attributes and predictors of long COVID. Nat Med 27, 4, 626–631.
    OpenUrlPubMed
  7. 7.↵
    1. Office for National Statistics
    (2021) Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK: 1 April 2021, https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/prevalenceofongoingsymptomsfollowingcoronaviruscovid19infectionintheuk/1april2021 (accessed 19 Jul 2021).
  8. 8.↵
    1. Ayoubkhani D,
    2. Khunti K,
    3. Nafilyan V,
    4. et al.
    (2021) Post-covid syndrome in individuals admitted to hospital with covid-19: retrospective cohort study. BMJ 372, n693.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. The OpenSAFELY Collaborative,
    2. Tazare J,
    3. Walker AJ,
    4. et al.
    (2021) Rates of serious clinical outcomes in survivors of hospitalisation with COVID-19: a descriptive cohort study within the OpenSAFELY platform. medRxiv, DOI: https://doi.org/10.1101/2021.01.22.21250304.
  10. 10.↵
    1. PHOSP-COVID Collaborative Group,
    2. Evans RA,
    3. McAuley H,
    4. et al.
    (2021) Physical, cognitive and mental health impacts of COVID-19 following hospitalisation — a multi-centre prospective cohort study. bioRxiv, DOI: https://doi.org/10.1101/2021.03.22.21254057.
  11. 11.↵
    1. Tate AR,
    2. Dungey S,
    3. Glew S,
    4. et al.
    (2017) Quality of recording of diabetes in the UK: how does the GP’s method of coding clinical data affect incidence estimates? Cross-sectional study using the CPRD database. BMJ Open 7, 1, e012905.
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    1. Tai TW,
    2. Anandarajah S,
    3. Dhoul N,
    4. et al.
    (2007) Variation in clinical coding lists in UK general practice: a barrier to consistent data entry? Inform Prim Care 15, 3, 143–150.
    OpenUrlPubMed
  13. 13.↵
    1. MacKenna B,
    2. Bacon S,
    3. Walker AJ,
    4. et al.
    (2020) Impact of electronic health record interface design on unsafe prescribing of ciclosporin, tacrolimus, and diltiazem: cohort study in English national health service primary care. J Med Internet Res 22, 10, e17003.
    OpenUrl
  14. 14.↵
    1. MacKenna B,
    2. Curtis HJ,
    3. Walker AJ,
    4. et al.
    (2020) Suboptimal prescribing behaviour associated with clinical software design features: a retrospective cohort study in English NHS primary care. Br J Gen Pract, DOI: https://doi.org/10.3399/bjgp20X712313.
  15. 15.↵
    1. Sudre CH,
    2. Murray B,
    3. Varsavsky T,
    4. et al.
    (2020) Attributes and predictors of long-COVID: analysis of COVID cases and their symptoms collected by the Covid Symptoms Study App. medRxiv, DOI: https://doi.org/10.1101/2020.10.19.20214494.
  16. 16.↵
    1. Thompson EJ,
    2. Williams DM,
    3. Walker AJ,
    4. et al.
    (2021) Risk factors for long COVID: analyses of 10 longitudinal studies and electronic health records in the UK. medRxiv, DOI: https://doi.org/10.1101/2021.06.24.21259277.
  17. 17.↵
    1. Al-Aly Z,
    2. Xie Y,
    3. Bowe B
    (2021) High-dimensional characterization of post-acute sequelae of COVID-19. Nature 594, 7862, 259–264.
    OpenUrlPubMed
  18. 18.↵
    1. Williamson EJ,
    2. Walker AJ,
    3. Bhaskaran K,
    4. et al.
    (2020) OpenSAFELY: factors associated with COVID-19 death in 17 million patients. Nature 584, 7821, 430–436.
    OpenUrlCrossRefPubMed
  19. 19.↵
    1. Wang Y,
    2. Hunt K,
    3. Nazareth I,
    4. et al.
    (2013) Do men consult less than women? An analysis of routinely collected UK general practice data. BMJ Open 3, 8, e003320.
    OpenUrlAbstract/FREE Full Text
Back to top
Previous ArticleNext Article

In this issue

British Journal of General Practice: 71 (712)
British Journal of General Practice
Vol. 71, Issue 712
November 2021
  • Table of Contents
  • Index by author
Download PDF
Download PowerPoint
Article Alerts
Or,
sign in or create an account with your email address
Email Article

Thank you for recommending British Journal of General Practice.

NOTE: We only request your email address so that the person to whom you are recommending the page knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Clinical coding of long COVID in English primary care: a federated analysis of 58 million patient records in situ using OpenSAFELY
(Your Name) has forwarded a page to you from British Journal of General Practice
(Your Name) thought you would like to see this page from British Journal of General Practice.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Clinical coding of long COVID in English primary care: a federated analysis of 58 million patient records in situ using OpenSAFELY
Alex J Walker, Brian MacKenna, Peter Inglesby, Laurie Tomlinson, Christopher T Rentsch, Helen J Curtis, Caroline E Morton, Jessica Morley, Amir Mehrkar, Seb Bacon, George Hickman, Chris Bates, Richard Croker, David Evans, Tom Ward, Jonathan Cockburn, Simon Davy, Krishnan Bhaskaran, Anna Schultze, Elizabeth J Williamson, William J Hulme, Helen I McDonald, Rohini Mathur, Rosalind M Eggo, Kevin Wing, Angel YS Wong, Harriet Forbes, John Tazare, John Parry, Frank Hester, Sam Harper, Shaun O’Hanlon, Alex Eavis, Richard Jarvis, Dima Avramov, Paul Griffiths, Aaron Fowles, Nasreen Parkes, Ian J Douglas, Stephen JW Evans, Liam Smeeth, Ben Goldacre, (The OpenSAFELY Collaborative)
British Journal of General Practice 2021; 71 (712): e806-e814. DOI: 10.3399/BJGP.2021.0301

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Clinical coding of long COVID in English primary care: a federated analysis of 58 million patient records in situ using OpenSAFELY
Alex J Walker, Brian MacKenna, Peter Inglesby, Laurie Tomlinson, Christopher T Rentsch, Helen J Curtis, Caroline E Morton, Jessica Morley, Amir Mehrkar, Seb Bacon, George Hickman, Chris Bates, Richard Croker, David Evans, Tom Ward, Jonathan Cockburn, Simon Davy, Krishnan Bhaskaran, Anna Schultze, Elizabeth J Williamson, William J Hulme, Helen I McDonald, Rohini Mathur, Rosalind M Eggo, Kevin Wing, Angel YS Wong, Harriet Forbes, John Tazare, John Parry, Frank Hester, Sam Harper, Shaun O’Hanlon, Alex Eavis, Richard Jarvis, Dima Avramov, Paul Griffiths, Aaron Fowles, Nasreen Parkes, Ian J Douglas, Stephen JW Evans, Liam Smeeth, Ben Goldacre, (The OpenSAFELY Collaborative)
British Journal of General Practice 2021; 71 (712): e806-e814. DOI: 10.3399/BJGP.2021.0301
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
  • Mendeley logo Mendeley

Jump to section

  • Top
  • Article
  • Figures & Data
  • Info
  • eLetters
  • PDF

Keywords

  • COVID-19
  • general practice
  • electronic health records
  • long COVID
  • primary health care

More in this TOC Section

  • Newer long-acting insulin prescriptions for patients with type 2 diabetes: prevalence and practice variation in a retrospective cohort study
  • Developing a primary care-initiated hepatitis C treatment pathway in Scotland: a qualitative study
  • How parents and children evaluate emollients for childhood eczema: a qualitative study
Show more Research

Related Articles

Cited By...

Intended for Healthcare Professionals

BJGP Life

BJGP Open

 

@BJGPjournal's Likes on Twitter

 
 

British Journal of General Practice

NAVIGATE

  • Home
  • Current Issue
  • All Issues
  • Online First
  • Authors & reviewers

RCGP

  • BJGP for RCGP members
  • BJGP Open
  • RCGP eLearning
  • InnovAiT Journal
  • Jobs and careers

MY ACCOUNT

  • RCGP members' login
  • Subscriber login
  • Activate subscription
  • Terms and conditions

NEWS AND UPDATES

  • About BJGP
  • Alerts
  • RSS feeds
  • Facebook
  • Twitter

AUTHORS & REVIEWERS

  • Submit an article
  • Writing for BJGP: research
  • Writing for BJGP: other sections
  • BJGP editorial process & policies
  • BJGP ethical guidelines
  • Peer review for BJGP

CUSTOMER SERVICES

  • Advertising
  • Contact subscription agent
  • Copyright
  • Librarian information

CONTRIBUTE

  • BJGP Life
  • eLetters
  • Feedback

CONTACT US

BJGP Journal Office
RCGP
30 Euston Square
London NW1 2FB
Tel: +44 (0)20 3188 7400
Email: journal@rcgp.org.uk

British Journal of General Practice is an editorially-independent publication of the Royal College of General Practitioners
© 2022 British Journal of General Practice

Print ISSN: 0960-1643
Online ISSN: 1478-5242