Hidden Signals in Language: Inferring Sensitive Attributes from Reddit Comments Using Machine Learning

A new research paper titled "Hidden Signals in Language: Inferring Sensitive Attributes from Reddit Comments Using Machine Learning" reveals a significant privacy vulnerability in AI systems. Authored by Anay Agarwalla and Simeon Sayer, the study demonstrates that even relatively simple machine learning models—like logistic regression and decision trees—can successfully predict legally protected characteristics such as gender, age, and personality traits (like MBTI) from casual online text. The researchers converted Reddit comments into numerical embeddings and trained classifiers, finding that demographic traits like gender and age were more readily predictable than subtle personality indicators.

The research shows that predictive performance varies significantly across different Reddit communities (subreddits), with some consistently revealing user attributes while others show high variability. This indicates that the context and subject matter of discussion heavily influence how much personal information is inadvertently leaked through language. Most alarmingly, the study suggests that if these lightweight models can detect such signals, then the large language models (LLMs) powering today's AI applications—which are orders of magnitude more complex—likely have an inherent, far greater capacity to infer sensitive attributes, even when explicitly trained not to do so.

This discovery has profound implications for AI ethics, privacy, and bias mitigation. It challenges the assumption that users can maintain anonymity or control over sensitive personal information in text-based interactions with AI systems. The authors call for increased transparency from AI developers, stronger technical safeguards within LLMs, and careful policy consideration to prevent the potential misuse of inferred personal data, which could lead to discrimination or manipulation.