New Tool Spots Contradictory Rules Hiding in Your Company's Paperwork
Outdated policies quietly contradict new ones — this tool catches that before it costs you.
Every large organization sits on a growing pile of documents: HR handbooks, safety manuals, compliance policies, technical standards. These get updated constantly. A rule gets rewritten, re-uploaded under a new filename, refined slightly, or replaced entirely — and the old version usually sticks around. The result is that two documents in the same company can say opposite things, and nobody notices until an auditor asks a hard question or an employee follows the wrong instruction.
The problem, according to a new research paper, is that existing software treats these jobs separately. One tool finds duplicates. Another finds contradictions. Nobody links them together or keeps a clear record of which document replaced which. The researchers' framework, called GVD, does all of it in one pass. It groups incoming documents into 'version families' — essentially, all the drafts and revisions of the same underlying rule. Then it compares each new rule against everything the family already knows, sorting each one into a category: duplicate, contradiction, a small refinement, or genuinely new knowledge. Policy settings then automatically silence the duplicates and flag only the changes that actually matter to a human reviewer.
The team tested it on 120 enterprise documents fed in as 140 separate uploads, spread across 59 version families. It hit roughly 97% accuracy at grouping documents into the correct families and about 94% accuracy at judging whether rules were consistent. A technique they call Counterfactual Span Probing — essentially a second-pass double-check for pairs the system couldn't confidently classify — pushed that consistency number up from 90% to 94%.
One detail stands out for anyone worried about privacy: the whole pipeline runs locally, with no large language model involved. That means sensitive internal policies never leave the company's own machines. It's an academic paper, not a product you can buy today, but it points toward something practical — a compliance filter that quietly keeps your company's rulebook from arguing with itself.
- Most companies have outdated and current versions of the same policy sitting side by side — this tool automatically links them into 'families' so you can see what replaced what.
- Tested on 120 company documents split into 59 version families, it was roughly 94-97% accurate at spotting duplicates, contradictions and small refinements.
- It runs entirely on a company's own computers with no AI model and nothing sent to the cloud, so private policies stay private.
Why It Matters
Fewer contradictory policies means fewer compliance mistakes, less time spent auditing documents, and safer decisions by staff.