Automation bias

Automation bias is a form of cognitive bias occurring when humans overvalue information produced by an automated, usually computerized, system. Users of automated systems can fail to understand or ignore illogical or incorrect information produced by computer systems.

Computer programs may create erroneous information due to any number of problems ranging from hardware design to algorithmic bias. In fact in several cases, arguably the most famous of which are those of Therac-25 and therapy planning software from Multidata Systems International , faulty software led to patient deaths.

In diagnostic radiology, automation bias has been recognized as a problem, and some academic research has been designed to quantify it as well as explore potentially mitigating factors. Automation bias is an increasing concern in radiology as the automation of much work in the field, especially that including creation of differential diagnoses through AI, evolves.