Research & Papers

AI Conversational Interviewing Scales Deep Interviews to 571 Respondents — And That Changes Everything About Public Opinion Research

New study shows AI interviews outperform surveys at uncovering hidden public opinions.

Deep Dive

A team of researchers from LMU Munich and the University of Mannheim has published a paper on arXiv introducing AI Conversational Interviewing, a method that leverages large language models to conduct semi-structured, in-depth interviews at scale. The study, which involved 571 respondents recruited via Prolific and a Payback Panel, compared three interview modes: voice-based, chat-based, and a free-choice option. Each participant experienced an AI-led conversation about migration policy, followed by a standardized survey. The AI system used a predefined interview guide but adapted its probing based on respondent answers, mimicking human interviewers.

The findings demonstrate that AI conversational interviews surface considerations and reasoning that even comprehensive closed-ended surveys miss—such as distinctly different mental models of migration among subgroups with similar surface-level attitudes. For example, respondents with comparable policy preferences revealed contrasting underlying logics about economic impacts or cultural integration. Crucially, evaluations of the AI interview were at or above those of the standardized survey across all modes, though completion rates were highest in the chat mode. The authors release open data and open-source pipeline materials, arguing this method can help researchers scale qualitative depth without sacrificing the richness of human conversation. This work contributes to a growing field using AI to augment traditional social science methodologies, offering a practical tool for opinion measurement, market research, and user experience studies.

Key Points
  • AI Conversational Interviewing uncovers nuanced mental models that standardized surveys miss, even among people with similar surface attitudes.
  • 571 respondents tested three modes (voice, chat, free-choice); chat mode had highest completion rates.
  • Participants rated the AI interview experience at or above traditional survey quality in all modes.

Why It Matters

This method lets researchers scale qualitative depth from dozens to thousands, transforming public opinion and market research.

📬 Get the top 10 AI stories daily