Comparing the CFIR-ERIC matching tool recommendations to real-world strategy effectiveness data: a mixed-methods study in the Veterans Health Administration

BackgroundPractical and feasible methods for matching implementation strategies to diagnosed barriers of evidence-based interventions in real-world contexts are lacking. This evaluation compared actual implementation strategies applied with those recommended by an expert opinion-based tool to improve guideline-concordant cirrhosis care in a Veterans Health Administration national learning collaborative effort.MethodsThis convergent parallel mixed-methods study aimed to (1) identify pre-implementation Consolidated Framework for Implementation Research (CFIR) barriers to cirrhosis care through focus groups with frontline providers, (2) generate 20 recommended strategies using focus group identified barriers entered into the CFIR-Expert Recommendations for Implementing Change (ERIC) Implementation Strategy Matching Tool, (3) survey providers over two consecutive years on the actual use of 73 ERIC strategies and determine strategy effectiveness, (4) compare actual versus recommended strategy use, and (5) compare actual versus expected barriers by reverse applying the CFIR-ERIC Matching Tool.ResultsEighteen semi-structured focus groups were conducted with 197 providers representing 95 VA sites to identify barriers to quality improvement, including cirrhosis care complexity, clarity of national goals, and local leadership support. The CFIR-ERIC Matching Tool recommended strategies such as assessing for readiness and needs, promoting adaptability, building local groups, preparing champions, and working with opinion leaders and early adopters. Subsequent strategy surveys found that sites used the top 20 "recommended" strategies no more frequently than other strategies. However, 14 (70%) of the top recommended strategies were significantly positively associated with cirrhosis care compared to 48% of actual strategies. Reverse CFIR-ERIC matching found that the strategies most used in the first year corresponded to the following barriers: opinion leaders, access to knowledge and information, and resources. The strategies most frequently employed in the second year addressed barriers such as champions, cosmopolitanism, readiness for implementation, relative priority, and patient needs and resources. Strategies used in both years were those that addressed adaptability, trialability, and compatibility.ConclusionsThis study is among the first to empirically evaluate the relationship between CFIR-ERIC Matching Tool recommended strategies and actual strategy selection and effectiveness in the real world. We found closer connections between recommended strategies and strategy effectiveness compared to strategy frequency, suggesting validity of barrier identification, and application of the expert-informed tool.