New AI Browser Tool Describes Web Pages Out Loud for Blind Users
Blind web users waste hours double-checking screens. This tool could give them that time back.
The authors of a new paper — Ritesh Kanchi, Jianna So, and Krzysztof Z. Gajos — interviewed eleven blind and low vision (BLV) screen reader users about UI understanding, then derived design objectives that informed Coral, a context-aware browser extension. Coral synthesizes interface and user context to generate screen reader-narrated gists, holistically notifying users of interface states and changes relevant to their likely goals and ongoing interaction. In a comparative evaluation with eight BLV screen reader users, participants used Coral to form initial expectations and interpret interface changes, and reported spending less time and effort manually verifying interaction outcomes. The findings offer deeper insight into how BLV screen reader users navigate gaps in their UI understanding, and how intelligent support combining interface and user context can bridge those gaps.
- Coral is a browser extension that gives blind users short spoken summaries of what a page is doing, instead of making them listen to everything link by link.
- It combines what's on the screen with what the user seems to be trying to do, so updates like a completed purchase or a new message actually get announced.
- In a small study of eight screen reader users, people said they spent less time and effort checking whether their actions worked — the paper is a research prototype, not a released product.
Why It Matters
It points toward AI that gives blind users back hours of tedious screen-checking — and nudges every website to work better for them.