Research & Papers

Forensic Knowledge Graphs authenticate images, beat VLMs and detectors

Structured forensic graph framework detects forgeries with 50,000-sample dataset and interpretable explanations.

Deep Dive

As generative AI produces increasingly realistic image forgeries, trustworthy authentication systems are critical. Existing forensic detectors target specific forgery types but lack interpretability, while vision-language models (VLMs) offer explanations but fail to reliably exploit forensic traces. To bridge this gap, Nguyen and Stamm propose Forensic Knowledge Graphs (FKGs), a unified framework that integrates forensic evidence extraction, structured reasoning, and human-interpretable explanation. FKGs encode traces, causal dependencies, and links to scene content, enabling both detection and justification of tampering.

The authors introduce a novel forensic authentication network to generate accurate FKGs, paired with an Iterative Context Refinement strategy that steers VLMs toward faithful, grounded explanations. They also release FKG-50K, a dataset of 50,000 realistic forgeries with ground-truth FKGs. In experiments, FKG outperforms both forensic detectors and VLMs across multiple metrics: detection accuracy, forgery identification, localization precision, and forensic justification quality. The work, accepted at ECCV 2026, marks a step toward explainable and reliable image forensics.

Key Points
  • FKGs integrate forensic traces, causal dependencies, and scene context into a structured, interpretable graph representation.
  • FKG-50K dataset includes 50,000 realistic forgeries with ground-truth FKGs for training and evaluation.
  • System surpasses both forensic detectors and VLMs in detection, localization, and justification tasks.

Why It Matters

Enables explainable, reliable deepfake detection for media forensics, social platforms, and legal evidence verification.

📬 Get the top 10 AI stories daily