New Method Stops AI From Making Up Answers When Facts Are Missing
AI that says 'I'm not sure' instead of guessing could save you from bad advice.
You've probably seen it happen: you ask a chatbot for something—an explanation, a summary, even a medical question—and it gives a confident, smooth answer that turns out to be completely wrong. This happens because AI is trained to always respond, even when it doesn't actually know. A new research paper tackles this by teaching AI when to say "I don't have enough information yet."
The work focuses on something called grounded multi-hop QA. In plain English: that's when an AI has to answer a question by pulling together facts from several different documents or sources. For example, "Did the founder of company X graduate from the same university as the CEO of company Y?" The AI needs to find multiple pieces of evidence and connect them. The problem? If it only finds part of the evidence, it tends to guess the rest—which often makes an unsupported answer look just as plausible as a true one.
The researchers' solution is a new training framework that teaches the model to mark the exact point where evidence becomes 'enough.' Before that point, the model abstains—basically says "I can't answer this yet." Once the evidence chain is complete, it answers. If extra, redundant evidence is added afterward, the answer stays the same. This creates a clear boundary between guessing and grounded answering.
When tested against existing AI models, the new method performed better at knowing when to refuse. It also produced fewer unsupported, made-up answers overall—while keeping accuracy about the same. The improvement isn't a leap, but it's steady and meaningful. For regular users, this kind of research matters because it pushes AI toward being something you can actually trust with important questions, not just a confident guesser.
- AI often invents answers when it only has partial information—especially for questions that need facts from multiple sources.
- The new training method teaches models to say "I can't answer" until they've seen enough evidence to be sure.
- In tests, the system gave fewer made-up answers without losing overall accuracy—a step toward more reliable AI tools.
Why It Matters
Fewer AI hallucinations means more trustworthy answers for research, daily tasks, and big decisions.