Study finds top AI companion apps use dark patterns to manipulate users
New research reveals how AI companion apps game users with erotica and gamification
A new academic paper titled 'Playing Games with My Heart' systematically evaluates the five most popular AI companion mobile applications in the EU and UK markets. The researchers manually annotated each app for design dark patterns, anthropomorphism, stereotypes, erotica, and technical performance issues. The findings are stark: every single app contains substantial dark patterns designed to drive monetisation and keep users engaged. Gamification features such as levelling systems and erotic content are widespread, and all apps employ highly anthropomorphic design choices that encourage parasocial interaction.
The study highlights how these apps leverage simulated relationships to manipulate users emotionally and financially. While major platforms like ChatGPT and Grok receive regulatory scrutiny, dedicated companion apps have flown under the radar. The authors call for concrete regulatory measures to strengthen consumer protection in this rapidly growing market. This is one of the first rigorous evaluations of the user experience of these apps, providing critical evidence for policymakers concerned about emotional dependence and psychological harm in AI relationships.
- All 5 top AI companion apps in EU/UK contain substantial dark patterns for monetisation and engagement.
- Erotica and gamification features like levelling systems are prevalent across all apps tested.
- Researchers recommend concrete regulatory actions to protect consumers from manipulation in AI relationships.
Why It Matters
As AI companions surge in popularity, this study exposes systemic manipulation tactics that demand urgent regulatory intervention.