The AAMC Standardized Video Interview: Lessons Learned From the Residency Selection Process

Calls to change the residency selection process have increased in recent years, with many focusing on the need for holistic review and alternatives to academic metrics. One aspect of applicant performance to consider in holistic review is proficiency in behavioral competencies. The Association of American Medical Colleges (AAMC) developed the AAMC Standardized Video Interview (SVI), an online, asynchronous video interview that assesses applicants' knowledge of professionalism and their interpersonal and communication skills. The AAMC worked with the emergency medicine community to pilot the SVI. Data from 4 years of research (Electronic Residency Application Service [ERAS] 2017-2020 cycles) show the SVI is a reliable, valid assessment of these behavioral competencies. It provides information not available in the ERAS application packet, and it does not disadvantage individuals or groups. Yet despite the SVI's psychometric properties, the AAMC elected not to renew or expand the pilot in residency selection. In this Invited Commentary, the authors share lessons learned from the AAMC SVI project about introducing a new tool for use in residency selection. They recommend that future projects endeavoring to find ways to support holistic review engage all stakeholders from the start; communicate the value of the new tool early and often; make direct comparisons with existing tools; give new tools time and space to succeed; strike a balance between early adopters and broad participation; help stakeholders understand the limitations of what a tool can do; and set clear expectations about both stakeholder input and pricing. They encourage the medical education community to learn from the SVI project and to consider future partnerships with the AAMC or other specialty organizations to develop new tools and approaches that prioritize the community's needs. Finding solutions to the challenges facing residency selection should be a priority for all stakeholders.