Using Modern Data Science Methods and Advanced Analytics to Improve the Efficiency, Reliability, and Timeliness of Cardiac Surgical Quality Data

NIH RePORTER · NIH · R01 · $719,204 · view on reporter.nih.gov ↗

Abstract

Within existing national surgical quality improvement (QI) programs, there are numerous opportunities to improve the efficiency of data flow from the point of collection to the time at which performance-based feedback is provided to stakeholders. Current limitations of the QI data cycle include: (a) reliance on hand abstraction for data collection; (b) a retrospective and episodic (e.g.: quarterly, bi-annually, etc.) approach to analysis and feedback which creates a time lag from when the hospital’s performance is declining and when it is made aware; (c) small clusters of clinically meaningful poor performance may go of undetected using current episodic analytic structures. To address the first limitation, modern data science methods (MDSMs) could be used to automate the collection of some, or all, of the variables within surgical QI registries. Full or partial automation of data collection could allow the substantial resources currently committed to manual data abstraction to be repurposed to support more continuous, proactive engagement in local QI activities. To address the limitations associated with episodic performance evaluation, alternative approaches for analyzing data in more real-time could be applied to provide an early warning of declining performance. The Veterans Affairs (VA) Surgical Quality Improvement Program (VASQIP) is one of the most successful and longest- standing national clinical registries used for surgical QI and has been the template for a number of similar programs in the private sector. As such, VASQIP represents an excellent model for evaluating alternative approaches to data collection and analysis that could allow for more efficient data flow through the quality improvement cycle and enhance national surgical QI efforts. The overall goal of this proposal is to evaluate alternative, potentially more efficient strategies that can be readily implemented within the existing infrastructure of contemporary surgical QI programs and aid in the more efficient flow of data. The specific aims are to: (1) develop and validate MDSMs to use structured and unstructured electronic health record data to automate cardiac VASQIP data collection; (2) compare the risk-adjusted CUSUM (a statistical process control methodology borrowed from industry) to quarterly observed-to-expected ratios (i.e.: VASQIP’s current approach to assessing performance) for evaluating VA hospital cardiac surgical performance; (3) conduct semi- structured interviews with diverse stakeholder groups to set a national research agenda for expansion and improvement of surgical QI programs. This mixed-methods proposal will involve observational studies using VASQIP and VA Corporate Data Warehouse data for patients who underwent cardiac surgery at a VA hospital between 2016 and 2020 as well as qualitative interviews with stakeholders who can help to inform future changes that can improve the data available within VASQIP. This project is important and novel because i...

Key facts

NIH application ID
10364433
Project number
1R01HL157323-01A1
Recipient
EMORY UNIVERSITY
Principal Investigator
Nader Nabile Massarweh
Activity code
R01
Funding institute
NIH
Fiscal year
2022
Award amount
$719,204
Award type
1
Project period
2022-01-01 → 2025-12-31