When Faster Triage Slowed Critical Care: A Regional Hospital’s Rush to Adopt an AI Triage Tool
A real-world example of Pro-innovation bias in action
Context
A six-hospital regional system wanted to reduce emergency department (ED) crowding and speed patient flow. Leadership selected a commercial AI triage tool promoted to prioritize incoming ED patients and route lower-risk cases to telemedicine or fast-track clinics.
Situation
The vendor promised a 30% reduction in average triage time and spoke of strong performance in trials. Under pressure to demonstrate quick wins, the health system deployed the tool across three hospitals within two months with limited local validation and minimal clinician training.
The bias in action
Decision-makers favored the new technology’s promised benefits and downplayed warnings about differences between the vendor’s training data and the hospital’s patient population. Clinicians were told to trust the AI’s risk scores and to use the new pathways; feedback loops were weak. Early anomalies — atypical presentations flagged as low-risk — were treated as edge cases rather than signals the model wasn’t calibrated locally. Leadership interpreted delays in rollout of additional safeguards as friction rather than necessary caution.
Outcome
Initially the system reported faster documented triage times and fewer patients routed to ED beds. However, within three months clinicians began seeing missed high-acuity presentations (for example, elderly sepsis cases routed to fast-track). The hospital experienced measurable clinical and operational setbacks and paused the system after six months.