Journal:Implementing a novel quality improvement-based approach to data quality monitoring and enhancement in a multipurpose clinical registry

Full article title	Implementing a novel quality improvement-based approach to data quality monitoring and enhancement in a multipurpose clinical registry
Journal	The Journal for Electronic Health Data and Methods
Author(s)	Pratt, J.; Jeffers, D.; King, E.C.; Kappelman, M.D.; Collins, J.; Margolis, P.; Bron, H.; Bass, J.A.; Bassett, M.D.; Beasley, G.L.; Benkov, K.J.; Bornstein, J.A.; Cabrera, J.M.; Crandall, W.; Dancel, L.D.; Garin-Laflam, M.P.; Grunow, J.E.; Hirsch, B.Z.; Hoffenberg, E.; Israel, E.; Jester, T.W.; Kiparissi, F.; Lakhole, A.; Lapsia, S.P.; Minar, P.; Navarro, F.A.; Neef, H.; Park, K.T.; Pashankar, D.S.; Patel, A.S.; Pineiro, V.M.; Samson, C.M.; Sandberg, K.C.; Steiner, S.J.; Strople, J.A.; Sudel, B.; Sullivan, J.S.; Suskind, D.L.; Uppal, V.; Wali, P.D.
Author affiliation(s)	Various (see the original for all affiliations)
Primary contact	Email: eileen dot king at cchmc dot org
Year published	2019
Volume and issue	7(1)
Page(s)	51
DOI	[1]
ISSN	2327-9214
Distribution license	Creative Commons Attribution 4.0 International
Website	https://egems.academyhealth.org/articles/10.5334/egems.262/
Download	https://egems.academyhealth.org/articles/10.5334/egems.262/galley/434/download/ (PDF)

Abstract

Objective: To implement a quality improvement-based system to measure and improve data quality in an observational clinical registry to support a learning healthcare system.

Data source: ImproveCareNow Network registry, which as of September 2019 contained data from 314,250 visits of 43,305 pediatric inflammatory bowel disease (IBD) patients at 109 participating care centers.

Study design: The impact of data quality improvement support to care centers was evaluated using statistical process control methodology. Data quality measures were defined, performance feedback of those measures using statistical process control charts was implemented, and reports that identified data items not following data quality checks were developed to enable centers to monitor and improve the quality of their data.

Principal findings: There was a pattern of improvement across measures of data quality. The proportion of visits with complete critical data increased from 72 percent to 82 percent. The percent of registered patients improved from 59 percent to 83 percent. Of three additional measures of data consistency and timeliness, one improved performance from 42 percent to 63 percent. Performance declined on one measure due to changes in network documentation practices and maturation. There was variation among care centers in data quality.

Conclusions: A quality improvement based approach to data quality monitoring and improvement is feasible and effective.

Keywords: quality improvement, data quality, registry

Introduction

There is growing interest in the potential for clinical registries that can simultaneously support clinical care, quality improvement (QI), and research. This multi-purpose model is consistent with the Institute of Medicine’s (IOM’s) vision of a learning health system which “draws research closer to clinical practice by building knowledge development and application into each stage of the health care delivery process.” Gliklich et al. define a registry as “an organized system that uses observational study methods to collect uniform data (clinical and other) to evaluate specified outcomes for a population defined by a particular disease, condition, or exposure, and that serves one or more predetermined scientific, clinical, or policy purposes.” Most pediatric chronic illnesses meet the National Institutes of Health's (NIH) definition for rare disease, and as such, multi-center registries are especially important to study and improve care for children with chronic diseases. Some multi-center networks are beginning to adopt principles of open science, or network-based production, to foster collaborative improvement, research, data sharing, and innovation. In this setting, the registry functions not only to provide access to condition-specific information in a uniform way to support clinical care but also to support QI and research to improve patient outcomes.

The challenges and opportunities in managing data from multi-purpose clinical registries that are used for care, QI, and research are distinct from those that arise in the management of data collected specifically for study purposes, particularly clinical trials. This is largely due to the differences in the purpose of and resources available for data collection. In clinical trials, data collection involves a limited and pre-specified number of participants (based on a sample size determination). Data collection occurs at pre-specified time intervals (i.e., study visits) for a defined period of time. In addition, the trial data collection system is closed at the end of the study. In contrast, registries are designed to support real time care, quality improvement, and knowledge development. They involve data collection as part of routine care and must embed the process of data collection into the clinical workflow. The data reflect actual practice and patient care. Challenges in this setting may include data collection at every patient visit over an extended period of time, unstandardized visit schedules, and large numbers of data elements needed to support chronic care activities such as population management and pre-visit planning for an entire patient population.

In addition, care centers participating in multi-purpose registries participate voluntarily. Many members of the clinical care team are involved, and resources for data capture and cleaning, such as clinical auditing and source document verification, are substantially less compared with clinical trials. The same staff responsible for transcribing data from the medical record and entering into the electronic case report forms may also be responsible for completing source document verification, in addition to other administrative and/or clinical responsibilities.

Such systems cannot support the data cleaning efforts typical of clinical trials that involve large numbers of queries sent to care centers for response. A key challenge to using data from registries for research is that the quality may not match that of data collected using other, more rigorous and expensive, study support. To date, studies of data quality in registries have focused on retrospective assessments of the “fit for use” model which indicates that the data quality is appropriate for the intended use.

Multi-center registries have used quality improvement methodology to improve patient care and outcomes. These same methods may be extended to interventions that enable teams to improve data quality. As such, we chose to evaluate the impact of a data quality improvement project based on good clinical data management practices within a multi-center registry for clinical care, QI, and research.

Notes

This presentation is faithful to the original, with only a few minor changes to presentation. Grammar was cleaned up for smoother reading. In some cases important information was missing from the references, and that information was added.