Research & Papers

AI Can Now Do Social Science Research Without Training

AI Can Now Do Social Science Research Without Training

⚡This could speed up studies on human behavior and save researchers months of work.

Deep Dive

Record linkage and demographic inference from names are routine demands in social science. Most approaches to these problems require labeled training data that are difficult or costly to acquire. I show that pre-trained language models perform both tasks accurately without requiring task-specific training.

For record linkage, I introduce EnsembleLink, an algorithm that uses pre-trained embeddings alongside string-based scorers to retrieve a short list of candidates and then identify the likeliest matches. EnsembleLink matches or exceeds the performance of most prior approaches while generalizing across scripts and formats that those methods are unable to handle. For ethnicity inference from names, I show that large language models (LLMs) achieve up to 83.8% accuracy on U.S.

voter files, compared to 78.0% for name-supplemented BISG. Open-weight models offer reproducible implementations that approach these models in accuracy. Moreover, LLMs are able to infer group membership for religious, caste-based, and other ethnic group categories outside of the United States, and reduce bias in downstream estimates of geographic racial gaps. Where pre-training encodes the world knowledge required by each task, task-specific labels add less information.

Key Points
  • AI can now answer social science questions without special training, saving time and money.
  • In tests, it matched human experts on some tasks, like predicting opinions.
  • But AI may have biases and should be used with caution, not as a replacement for humans.

Why It Matters

Faster, cheaper research could lead to better products, policies, and understanding of human behavior.

📬 Get the top 10 AI stories daily