Integrating Incident Data from Five Reporting Systems to Assess Patient Safety: Making Sense of the Elephant

Background: A study was conducted to examine and compare information gleaned from five different reporting systems within one institution: incident reporting, patient complaints, risk management, medical malpractice claims, and executive walk rounds. These data sources vary in the timing of the reporting (retrospective or prospective), severity of the events, and profession of the reporters. Methods: A common methodology was developed for classifying incidents. Data specific to each incident were abstracted from each system and then categorized using the same framework into one of 23 categories. Results: Overall, there was little overlap, although each reporting system identified important safety issues. Communication problems were common among patient complaints and malpractice claims; malpractice claims' leading category was clinical judgement. Walk rounds identified issues with equipment and supplies. Adverse event reporting systems highlighted identification issues, especially mislabelled specimens. The frequency of contributions of reports by provider group varied substantially by system. Physicians accounted for 50% of risk management reports, but in adverse event reporting, where nurses were the main reporters, physicians accounted for only 2.5% of reports. Complaints and malpractice claims come primarily from patients. Conclusions: The five reporting systems each identified different yet complementary patient safety issues. To obtain a comprehensive picture of their patient safety problems and to develop priorities for improving safety, hospitals should use a broad portfolio of approaches and then synthesize the messages from all individual approaches into a collated and cohesive whole.