Research & Papers

Navigating Algorithmic Opacity: Folk Theories and User Agency in Semi-Autonomous Vehicles

Drivers invent stories to explain confusing AI decisions in their cars.

Deep Dive

A study of 16 semi-autonomous vehicle drivers found they create 'folk theories' to explain AI decisions, using human-like terms such as the car 'hesitating' or being 'overwhelmed.' However, they lack the information to verify their guesses, especially in complex situations like bad weather. The research argues current designs treat drivers as passive, creating safety and trust issues, and calls for systems that give drivers transparency and a voice in improvements.

Why It Matters

Understanding driver confusion is key to building safer, more trustworthy autonomous vehicles.