Abstract
Background Inflammatory markers (C-reactive protein, erythrocyte sedimentation rate, and plasma viscosity) are commonly used in primary care. Though established for specific diagnostic purposes, there is uncertainty around their utility as a non-specific marker to rule out underlying disease in primary care.
Aim To identify the value of inflammatory marker testing in primary care as a rule-out test, and measure the cascade effects of testing in terms of further blood tests, GP appointments, and referrals.
Design and setting Cohort study of 160 000 patients with inflammatory marker testing in 2014, and 40 000 untested age, sex, and practice-matched controls, using UK primary care data from the Clinical Practice Research Datalink.
Method The primary outcome was incidence of relevant disease, including infections, autoimmune conditions, and cancers, among those with raised versus normal inflammatory markers and untested controls. Process outcomes included rates of GP consultations, blood tests, and referrals in the 6 months after testing.
Results The overall incidence of disease following a raised inflammatory marker was 15%: 6.3% infections, 5.6% autoimmune conditions, 3.7% cancers. Inflammatory markers had an overall sensitivity of <50% for the primary outcome, any relevant disease (defined as any infections, autoimmune conditions, or cancers). For 1000 inflammatory marker tests performed, the authors would anticipate 236 false-positives, resulting in an additional 710 GP appointments, 229 phlebotomy appointments, and 24 referrals in the following 6 months.
Conclusion Inflammatory markers have poor sensitivity and should not be used as a rule-out test. False-positive results are common and lead to increased rates of follow-on GP consultations, tests, and referrals.
INTRODUCTION
Inflammatory marker tests include C-reactive protein (CRP), plasma viscosity (PV), and erythrocyte sedimentation rate (ESR). Millions of inflammatory marker tests are done annually, and rates of testing are rising,1 with large variation in testing rates between different GP practices.2 Measurement of inflammatory markers has two functions; it contributes to diagnosis of inflammatory conditions, including infections, autoimmune conditions, and cancers, and it is used to monitor disease progression or treatment response.3 Inflammatory markers are recommended in a limited number of national guidelines, for example, as a first-line test for myeloma,4 polymyalgia,5 and pneumonia.6
A third use has crept into clinical practice; as a non-specific test to rule out serious underlying disease and provide patient and GP reassurance.7 Patients with non-specific symptoms, such as tiredness, memory problems, or gastrointestinal symptoms, may have inflammatory marker testing performed in order to exclude other diagnoses, as recommended in guidelines for chronic fatigue, dementia, and irritable bowel syndrome.8–10 There is a lack of evidence to back up this clinical practice. Unexpected results can be challenging to interpret, and false-positives may lead to increased uncertainty and anxiety for patients and GPs, and a cascade of further tests.11 False-negatives may lead to false reassurance and delayed diagnosis of underlying diseases.
The concept that abnormal test results can lead to cascade testing is not new,12,13 yet little evidence of the frequency of cascade testing exists.14 Potential overuse of pathology tests is important given the current financial constraints within the NHS.
Much of the evidence about inflammatory markers comes from secondary care, and focuses on single disease outcomes.3 This is not helpful when testing is done for non-specific symptoms, where multiple diseases are possible. The aim of this study was to identify the value of inflammatory marker testing in primary care as a rule-out test, provide evidence for GPs to interpret inflammatory markers, and to measure the cascade effects of testing in terms of follow-on blood tests, GP appointments, and referrals.
METHOD
Participants and data sources
This was a prospective cohort study using the Clinical Practice Research Datalink (CPRD), which contains anonymised routinely collected data recorded from primary care electronic health records. Participants were 160 000 patients aged >18 years with an inflammatory marker taken in 2014. The inflammatory markers considered were CRP, ESR, and PV. The index date was defined as the first date of inflammatory marker testing in 2014.
How this fits in
The utility of inflammatory markers as a general but non-specific test for possible serious underlying disease in primary care is poorly understood. In this large observational study using UK primary care electronic health records, the authors found that the most common cause of raised inflammatory marker is infection (6.3%), followed by autoimmune conditions (5.6%), and cancers (3.7%). Inflammatory markers have poor sensitivity, and should therefore not be used as a rule-out test. False-positive inflammatory marker results are common, and are associated with increased rates of follow-on GP consultations, tests, and referrals.
A comparison sample of 40 000 patients had no inflammatory marker test in 2014, though could have had testing at other dates. These were matched by age (in 5-year bands), sex, and practice to a random subset of 40 000 patients from the inflammatory marker test group. Controls were allocated the same index date as their matched case. Patients who had received a diagnosis of cancer, autoimmune conditions, or chronic infections in the 2 years before the index date were excluded, as were patients with an acute infection in the 30 days before the index date (Figure 1).
Flowchart showing exclusions. CPRD = clinical practice research datalink. CRP = C-reactive protein. ESR = erythrocyte sedimentation rate. PV = plasma viscosity.aMatched untested consists of 39 928 subjects because, of the 40 000 from the cohort who were randomly selected for matching, 72 had no suitable age, sex, and practice-matched control.
Linked data included English Cancer Registry Data and patient level index of multiple deprivation (IMD). The authors did not solely study participants with data linkage in case this introduced bias. Cancer registry data were available for 110 245 patients, IMD for 110 181.
Index tests
The authors defined a raised inflammatory marker using the mean upper limit of normal from laboratories within the study. For CRP, it was 6.8 mg/l, for simplicity rounded to 7 mg/l; for PV it was 1.72 mPa/s. For ESR, it was stratified by sex and age (further information is available from the authors on request). When the same inflammatory marker was repeated on the same day (n = 231), the authors retained the highest value. A binary variable for any raised inflammatory marker was generated to accommodate multiple testing.
Outcome variables
The primary outcome was any relevant disease, defined as cancer or autoimmune conditions coded within 1 year, or infection within 1 month of the index date. The authors considered infections beyond 1 month unlikely to relate to the initial raised inflammatory marker. Process outcomes of repeat GP consultations, additional blood tests, and referrals were identified. For consultations, the authors included face-to-face, home visit, and telephone consultations.
Code list development
To identify cancers, the authors used validated code lists used in multiple previous studies (further details are available from the authors on request), as well as Cancer Registry Data. Clinical code lists for infections and autoimmune conditions were developed using validated methods,15 are broken down into subtypes (further information is available from the authors on request), and are available on the University of Bristol Data Repository.16
The authors searched the CPRD for symptom codes in the 28 days before and including the index date, retaining the 200 most frequently occurring codes, categorised according to the International Classification of Primary Care.17 They then used methods described previously15 to generate complete code lists for each of these symptoms.
Sample size calculation
The CPRD were willing to offer a sample size of 160 000 tested patients. Power calculations with α = 0.05 and assuming that one-third of tests would be abnormal, with a baseline incidence of relevant disease of 7.5% (1% cancers, 1.5% autoimmune, 5% infections), gave 93% power to identify a change in incidence to 8%. For the least frequently occurring disease category, cancer, the authors had a 94% power to identify an increase from 1% to 1.2%. As the focus of the study was disease outcomes in tested patients, the untested group, used as a benchmark for the tested group, was deliberately kept small to ensure maximum power in the main study.
Analysis
The primary analysis measured the overall incidence of relevant disease for patients with raised versus normal inflammatory markers, as well as tested versus untested patients, equivalent to the positive predictive value (PPV) in the test-positives. The authors used logistic regression for the dose–response relationship between CRP, ESR, and PV as continuous variables, and relevant disease as a binary variable, also generating a receiver-operating characteristic (ROC) curve. Summary statistics including sensitivity, specificity, PPV, and negative predictive value (NPV) were calculated for each of the three inflammatory markers. For ease of reading, the authors present many of the results for a primary care population of 1000. The reporting of this study conforms to the STARD18 and RECORD statements.19 Analysis was performed using Stata (version 15).
RESULTS
Tests requested
After exclusions (Figure 1), the sample included 136 961 patients with one or more inflammatory marker test: 71.0% CRP, 58.0% ESR, and 10.1% PV, plus 37 539 untested. More than one inflammatory marker was performed simultaneously on the index date in 38.8%. Of the overall tested cohort, 27.8% had one or more raised inflammatory marker.
Patient demographics
Compared to the UK adult population, the tested cohort were more likely to be female (61.6% versus 51.3%), of white ethnicity (87.0% versus 85.4%), and from the most affluent socioeconomic quintile (23.0% versus 20%) (further information is available from the authors on request). Raised inflammatory markers were more common among the most deprived socioeconomic quintile (odds ratio [OR] 1.31, 95% confidence interval [CI] = 1.24 to 1.38, P<0.001), and more common among females (OR 1.19, 95% CI = 1.16 to 1.22, P<0.001). There was no difference in the frequency of abnormal results by ethnicity.
Incidence of disease
The overall incidence of disease in patients with a raised inflammatory marker (PPV) was 15.0% — 6.3% infections, 5.6% autoimmune conditions, and 3.7% cancers (Table 1).
Disease incidence according to inflammatory marker test results
Of those with one or more raised inflammatory marker (n = 38 010), incidence of disease was highest among those with persistently raised inflammatory markers on subsequent testing, lower in those with normal inflammatory markers on subsequent testing, and lowest among those without subsequent testing in the next 90 days. Cancer was the notable exception; those with a normal subsequent test had a lower disease risk (2.1%) than those without repeat testing (3.6%).
Figure 2 shows the incidence of disease according to test outcomes, simplified to a nominal population of 1000 tested patients. Of those with a positive test result, 85% had no evidence of infection, autoimmune condition, or cancer (false-positives).
Test implications flowchart. Numbers and percentages do not add up to 100% due to rounding and because a small number of people developed more than one relevant disease outcome.
Table 2 summarises the detailed performance characteristics of each of the three tests (CRP, ESR, PV) for the primary outcome of any relevant disease, as well as for each of the three disease outcomes separately. All three tests had overall sensitivities of <50% for the primary outcome, any relevant disease (defined as infections, autoimmune conditions or cancers).
Performance characteristics of inflammatory markers for relevant disease, including infections, autoimmune conditions, and cancer
Inflammatory marker levels
Incidence of disease increased with rising inflammatory marker levels in a dose–response relationship (Figures 3⇓–5). With CRP ≥100 mg/L (n = 1552), 501 (32.3%) developed one or more relevant diseases: 113 (7.2%) cancers, 99 (6.4%) autoimmune conditions, and 317 (20.4%) infections. With ESR ≥100 mm/h (n = 389), 141 (36.3%) developed ≥one relevant diseases: 59 (15.2%) cancers, 60 (15.4%) autoimmune conditions, and 36 (9.3%) infections. With PV ≥2 Pa/s (n = 276), 81 (29.3%) developed one or more relevant disease: 30 (10.9%) developed cancer, 38 (13.8%) developed autoimmune conditions, and 15 (5.4%) developed infections.
Incidence of relevant disease in relation to test result for CRP. CRP = C-reactive protein.
Incidence of relevant disease in relation to test result for ESR. ESR = erythrocyte sedimentation rate.
Incidence of relevant disease in relation to test result for PV. PV = plasma viscosity. For the small number (<0.5%) with one or more disease outcome; cancer superseded autoimmune disease, which superseded infections.
Symptoms triggering testing
Table 3 shows the most common symptoms in the 28 days before testing, ordered according to the ratio between symptom frequency in test-positive versus test-negative groups. Broadly these could be categorised into non-specific symptoms, abdominal symptoms, joint symptoms, and infective symptoms. Non-specific symptoms such as tiredness, dizziness, and low mood were relatively more common in the test-negative compared to test-positive groups, indicating that these non-specific symptoms are less likely to generate raised inflammatory markers. In comparison, infective symptoms such as cough, UTI, and chest infection were more likely to be associated with a raised inflammatory marker.
Most frequently recorded symptoms in the 28 days before inflammatory marker testing
Diagnostic activity after initial inflammatory marker test
Table 4 shows the blood tests, appointments, and referrals in the 6 months after testing for true-positive, false-positive, true-negative, or false-negative groups, plus untested controls. Follow-on blood tests, appointments, and referrals were higher in the false-positives than the true-negatives. Both groups consist of tested patients without subsequent pathology, with the main difference being the inflammatory marker result. Based on this, for 1000 inflammatory marker tests performed, the authors would expect 236 false-positives, associated with an additional 710 GP appointments, 229 phlebotomy appointments, and 24 referrals in the 6 months following testing.
Cascade effects of testing in 6-month period after testing
DISCUSSION
Summary
The authors examined the outcomes of inflammatory marker testing in UK primary care. Multiple simultaneous inflammatory markers were common, and abnormal results frequent. Testing was more common in females, in white ethnic groups, and in the most affluent. Conversely, abnormal results were more common in patients from the most socially-deprived socioeconomic groups. This is in keeping with the inverse care law,20 with potential overtesting in the affluent, and relative undertesting in more deprived groups. Higher testing rates may also in part reflect higher consultation rates in certain sociodemographic groups.
Inflammatory markers have poor sensitivity, so are not suitable as a rule-out test. False-positive results were frequent, with increased rates of GP appointments, repeat blood tests, and referrals. In patients with a raised inflammatory marker, the most common diagnoses were infection (6.3%), followed by autoimmune conditions (5.6%), and cancers (3.7%).
Strengths and limitations
The size of this study is a strength, along with the setting in primary care, where initial suspicion of disease usually arises. Examining multiple disease outcomes allowed the authors to explore the utility of testing to distinguish between healthy and unhealthy. This is relevant, as GPs describe using inflammatory markers in this way.7 The authors have also used a test consequences graphic, based on a nominal population of 1000 tested patients; this may help implementation into practice.21
The main limitation is lack of information about the reason for testing. The authors cannot determine which tests were done for specific diagnostic purposes, and which were done as a general rule-out for any relevant underlying disease. The frequency of non-specific symptoms in the cohort (tiredness, malaise, dizziness, or low mood) suggests the latter is likely to be common. The benefit of this approach is that it reflects real life clinical practice; though GPs may not have a specific diagnosis in mind when they request inflammatory markers, they need to consider a wide range of possible diagnoses if the test is positive.
All studies using electronic health records rely on the quality of data recording. Blood tests are electronically transmitted to the GP records, reducing the risk of missing or erroneous data. The authors used rigorous methods to develop disease code lists,15 but it is possible that there were some omissions. Furthermore, some diseases may be unrecorded, though this is rare for cancers and autoimmune disease.22 The authors omitted cardiovascular disease as an outcome; though CRP predicts future cardiovascular disease, it does not form part of any cardiovascular diagnostic algorithm. There is some risk of incorporation bias, particularly for infections, as these diagnoses may be more likely to be coded because of the inflammatory marker test result.
Comparison with existing literature
Most previous studies of inflammatory markers consider single diseases, and most are based in secondary care. The current findings confirm the associations between inflammatory markers and infection and autoimmune conditions; however, the PPVs are lower in a primary care population with low prevalence for these conditions, and false-positives are more frequent.3
The cascade effects of medical technology have been described,12,23 yet there is limited evidence of the size of this effect.14 The authors identified a significant difference in the rate of GP consultations, blood tests, and referrals in the false-positive test result group.
Current guidelines for chronic fatigue, irritable bowel disease, and suspected dementia recommend inflammatory marker testing in order to exclude other diagnoses.8–10 The current research is discordant with these guidelines, showing that, with an overall sensitivity of <50% inflammatory markers are not a useful test of exclusion.
Implications for research and practice
Previous qualitative work has shown that doctors perceive inflammatory markers as a useful rule-out test.7 However, the sensitivity of inflammatory markers is poor, so they are not suitable for that purpose. Instead they are classic Bayesian tests, with a positive test somewhat increasing the chance of disease, though not definitively, and a negative test reducing the chance of disease, but not to zero. The authors therefore suggest that inflammatory marker tests should not be used as a non-specific test to rule out disease, or for patient reassurance.
In patients with a raised inflammatory marker, the range of differential diagnoses is wide, explaining the additional consultations, tests, and referrals. With significantly raised inflammatory markers, the risk of disease is higher. In patients with unexplained raised inflammatory markers, risk of cancer must also be considered. Interpretation should take into account the reason for testing and the pre-test likelihood of disease; a negative test in the context of low-risk symptoms reduces disease likelihood further, but with the potential for harm from false-positive tests. False-negative tests may also lead to false reassurance, as patients with normal inflammatory markers are at significantly higher disease risk than untested controls. GPs should not be excessively reassured by a repeat negative inflammatory marker; the authors found higher disease incidence in those with normal repeat tests (18.6%) compared to those who did not have repeat tests performed (12.5%). Presumably this reflects the fact that the GP’s decision to repeat the test meant they were suspicious that the patient was ill.
Though the unit cost of inflammatory marker tests is relatively low, the total costs, including follow-on consultations, investigations, and referrals, are likely to be substantial. As well as financial costs, patient anxiety and GP workload may be generated. Further studies including health economic evaluations may be useful to inform clinical guidelines and recommendations for GPs about when (and when not) to use inflammatory marker tests. They should also consider whether specific inflammatory markers are superior in certain diagnostic scenarios.
Acknowledgments
This study is based on data from the Clinical Practice Research Datalink obtained under licence from the UK Medicines and Healthcare products Regulatory Agency. The authors would like to thank Dr Hayley Jones for assistance with data analysis.
Notes
Funding
This report is independent research arising from Jessica Watson’s Doctoral Research Fellowship (DRF-2016-09-034) supported by the National Institute for Health Research (NIHR). This research is linked to the CanTest Collaborative, which is funded by Cancer Research UK (C8640/A23385), of which Willie Hamilton is co-lead. Jonathan Banks, Penny Whiting, Chris Salisbury and Jessica Watson were supported by the NIHR Collaboration for Leadership in Applied Health Research and Care West (CLAHRC West) at University Hospital Bristol NHS Foundation Trust. The views expressed in this article are those of the authors and not necessarily those of the NHS, the NIHR, Health Education England or the Department of Health and Social Care.
Ethical approval
This study was approved by the Independent Scientific Application Committee for MHRA database research (ISAC) protocol number 17_003.
Provenance
Freely submitted; externally peer reviewed.
Competing interests
The authors have declared no competing interests
Discuss this article
Contribute and read comments about this article: bjgp.org/letters
- Received October 29, 2018.
- Revision requested November 27, 2018.
- Accepted December 20, 2018.
- © British Journal of General Practice 2019
This article is Open Access: CC BY 4.0 license (http://creativecommons.org/licenses/by/4.0/).
REFERENCES
In this issue
Jump to section
More in this TOC Section
Related Articles
Cited By...
