AI Safety

Why We Prioritize Avoiding Panic Over Averting Real Threats — LessWrong Analysis

An essay reveals our odd fear of causing fear, even when real danger looms.

Deep Dive

KatjaGrace's LessWrong essay explores a peculiar social phenomenon: when discussing serious threats, people often express more concern about causing fear in others than about the threat itself. She recalls an Uber ride just before the COVID-19 lockdowns, where a friend insisted they talk discreetly so as not to scare the driver—despite both believing a deadly virus was imminent. The same dynamic appears in AI risk debates. Geoffrey Hinton states a 10-20% chance of human extinction from AI, and some critics focus not on his reasoning but on whether the media properly caveats his estimate to avoid public panic.

The author argues this 'fear of causing fear' is a misplaced priority. While irrational panic is undesirable, it is far worse for people to remain unaware of real, actionable risks. The essay challenges the assumption that the public cannot handle distressing information responsibly. It compares demanding cautious disclaimers on AI risk to asking someone who sees smoke and flames to say 'I subjectively guess there might be a fire' instead of shouting 'Fire!'. The piece concludes that by prioritizing emotional comfort over clear warning, society may inadvertently enable inaction against existential threats like pandemics or AI catastrophe.

Key Points
  • During COVID-19, a friend silenced discussion of the pandemic in an Uber to avoid scaring the driver, despite both believing the threat was real.
  • Geoffrey Hinton's 10-20% AI extinction claim draws concern about public fear levels, not the validity of the risk.
  • The essay argues that prioritizing emotional comfort over informed action is a dangerous bias when facing existential threats.

Why It Matters

Professionals must recognize the bias of fear-of-fear to communicate urgent risks without hesitation.