AI Safety

DMILS scale offers new yardstick to measure misinformation resilience

New 34-item test measures digital literacy across US and Singapore with strong validity

Deep Dive

Amid growing concerns about information quality online, researchers Sijia Qian, Cuihua Shen, Huiyi Wang, and Hichang Cho have developed the Digital Media and Information Literacy Scale (DMILS), a psychometrically sound instrument designed to measure the competencies that build resilience to misinformation. The scale was created and validated through two empirical studies involving three nationally matched samples in the United States and Singapore, totaling 1,498 participants. The researchers aimed to fill a gap for a concise yet comprehensive tool that tracks both subjective self-assessment and objective knowledge. DMILS is multidimensional: it distinguishes between domain (digital/media and information/news) and competency type (knowledge vs. skill), offering a nuanced yardstick for researchers and educators.

The final DMILS battery comprises 18 self-report items and 16 objective knowledge questions, with a validated short form of 8 self-report and 8 objective items. The scale demonstrated strong structural, convergent, and predictive validity across diverse populations. By providing a standardized, multidimensional metric, DMILS enables rigorous evaluation of media literacy interventions and supports cross-national comparative research. This tool is crucial for understanding and improving how individuals navigate digital information ecosystems, ultimately helping to build societal resilience against mis- and disinformation.

Key Points
  • DMILS includes 34 items (18 self-report, 16 objective) plus a short form of 16 items for quick assessment
  • Validated with 1,498 participants across the US and Singapore, showing strong structural, convergent, and predictive validity
  • Distinguishes between digital vs. information/news domains and knowledge vs. skill competencies for a nuanced literacy profile

Why It Matters

Standardized metric to evaluate media literacy interventions globally, crucial for combating misinformation at scale.

📬 Get the top 10 AI stories daily