July 14, 2022: Solving Unexpected Challenges in Pragmatic Trial Data Collection

Headshot of Dr. Keith MarsoloDuring the NIH Pragmatic Trials Collaboratory Steering Committee meeting and 10th anniversary celebration, Dr. Keith Marsolo, Co-chair of the Electronic Health Records Core, moderated a panel on “Barriers and Challenges: Data Collection and Merging Datasets.” Four panelists shared their experiences collecting and aggregating data from diverse data sets and how they solved unexpected challenges.

The panelists included Drs. Ted Melnick (EMBED), Holt Oliver (ICD-Pieces), Margaret Kuklinski (GGC4H), and Andrea Cheville (NOHARM).

During the discussion, panelists shared lessons learned from collecting electronic health record (EHR) data during large pragmatic clinical trials across multiple health systems. Common challenges included:

  • Privacy concerns and not having the ability to collect deidentified patient or clinician demographic information
  • Working across health systems that use different EHR platforms and collecting data consistently across sites
  • Turnover of IT staff at participating sites and changes in site data agencies during the study period
  • Updates to the EHR that affect study algorithms and other issues with algorithms not identifying data as expected
  • Overcoming technical barriers with practice workflows and integrating with IT systems

The panelists shared solutions and possible best practices for future studies, including the need for planning, coordinating, and testing before study launch, the importance of being able to pivot and change directions as problems arise, being open to alternative data collection methods such as surveys to augment findings, and having the right team at the right time to be responsive to problems, which for one study meant having informaticists and expert EHR builders embedded in the trial team.

Panelists identified two key policy and infrastructure changes that would help trials be successful in the future. These changes include development of a national unique patient identifier across health systems and incentivizing EHR vendors to find common ground to better support research.

The Electronic Health Records Core continues to learn from experiences of the program’s NIH Collaboratory Trials and shares emerging information, resources, and EHR-related recommendations to improve future pragmatic research.

View slides from the discussion panel.

Learn more

View video collection that highlights advances in Electronic Health Records for pragmatic research.

Watch the August 2021 Interview with Electronic Health Record Core leaders Drs. Rachel Richesson and Keith Marsolo