Europe's AI Law Gets a Free Tool to Catch Rights Violations
If an algorithm has ever screened your job or benefits application, this matters.
Europe's AI Act says that before a government body or company switches on a high-risk AI system — think software that sorts job applicants or decides who qualifies for public benefits — it must first run a "Fundamental Rights Impact Assessment." In plain terms: a rights checkup. The problem is that the evidence you'd need for a credible checkup is scattered across incident reports, risk glossaries, and legal texts that don't talk to each other. So researchers built a framework that pulls it all into one place.
Their tool is essentially a connected, searchable database — what engineers call a knowledge graph — holding 1,351 linked facts built from a hand-curated set of 150 records. They focused on two areas the law flags as high-risk: employment and worker management, and access to essential public services. Running five demonstration scenarios, the system surfaced 103 relevant records, about 69% of what was available. Crucially, everything is released openly and free, aimed at regulators, national authorities, and small businesses that can't afford armies of compliance lawyers.
The most striking finding is a warning. When the team used a large language model (an AI like ChatGPT) to automatically sort fairness-related evidence in the employment domain, its agreement with human experts was essentially zero. The statistical measure they used, 0.045, means the AI was roughly guessing. That's a big deal: it suggests you cannot hand the judgment call — "does this system discriminate?" — to an AI and walk away. A human still has to read the evidence and decide.
So what does this mean for you? If you've ever been screened out by hiring software or had a benefits claim reviewed by an algorithm, this is the machinery designed to catch harm before it happens. It's still early and imperfect — 150 records is a small sample, and coverage is incomplete — but for the first time there's a shared, free playbook. The lesson: automation can gather the paperwork, but people still have to make the call.
- Europe's AI Act requires a 'rights checkup' before high-risk AI is used in hiring or public services, but the supporting evidence was scattered across dozens of incompatible sources.
- Researchers compiled 150 records into one free, searchable database and tested it on five scenarios, surfacing 103 relevant cases — about 69% coverage.
- When AI was asked to sort fairness evidence automatically, it matched human experts almost never (a score of 0.045, essentially random), suggesting humans must stay in the loop.
Why It Matters
If an algorithm screens your job application or benefits claim, this is the paperwork meant to protect you.