A systematic review to evaluate the accuracy of electronic adverse drug event detection

J Am Med Inform Assoc. 2012 Jan-Feb;19(1):31-8. doi: 10.1136/amiajnl-2011-000454.

Abstract

Objective: Adverse drug events (ADEs), defined as adverse patient outcomes caused by medications, are common and difficult to detect. Electronic detection of ADEs is a promising method to identify ADEs. We performed this systematic review to characterize established electronic detection systems and their accuracy.

Methods: We identified studies evaluating electronic ADE detection from the MEDLINE and EMBASE databases. We included studies if they contained original data and involved detection of electronic triggers using information systems. We abstracted data regarding rule characteristics including type, accuracy, and rationale.

Results: Forty-eight studies met our inclusion criteria. Twenty-four (50%) studies reported rule accuracy but only 9 (18.8%) utilized a proper gold standard (chart review in all patients). Rule accuracy was variable and often poor (range of sensitivity: 40%-94%; specificity: 1.4%-89.8%; positive predictive value: 0.9%-64%). 5 (10.4%) studies derived or used detection rules that were defined by clinical need or the underlying ADE prevalence. Detection rules in 8 (16.7%) studies detected specific types of ADEs.

Conclusion: Several factors led to inaccurate ADE detection algorithms, including immature underlying information systems, non-standard event definitions, and variable methods for detection rule validation. Few ADE detection algorithms considered clinical priorities. To enhance the utility of electronic detection systems, there is a need to systematically address these factors.

Publication types

  • Review
  • Systematic Review

MeSH terms

  • Algorithms*
  • Clinical Laboratory Information Systems
  • Drug Monitoring / methods*
  • Drug-Related Side Effects and Adverse Reactions / diagnosis*
  • Drug-Related Side Effects and Adverse Reactions / epidemiology
  • Evaluation Studies as Topic
  • Humans
  • Information Systems*
  • Medication Systems
  • Pharmacovigilance