DDL: A Dataset for Interpretable Deepfake Detection and Localization in Real-World Scenarios

Authors: Changtao Miao, Yi Zhang, Weize Gao, Man Luo, Weiwei Feng, Zhiya Tan, Jianshu Li, Ajian Liu, Yunfeng Diao, Qi Chu, Tao Gong, Zhe Li, Weibin Yao, Joey Tianyi Zhou

Published: 2025-06-29 15:29:03+00:00

AI Summary

This paper introduces DDL, a large-scale dataset for interpretable deepfake detection and localization. DDL contains over 1.8 million forged samples using 75 different deepfake methods and provides fine-grained forgery annotations for improved interpretability in deepfake detection.

Abstract

Recent advances in AIGC have exacerbated the misuse of malicious deepfake content, making the development of reliable deepfake detection methods an essential means to address this challenge. Although existing deepfake detection models demonstrate outstanding performance in detection metrics, most methods only provide simple binary classification results, lacking interpretability. In critical domains such as law, interpretability is crucial for enhancing the credibility and authority of decisions. Recent studies attempt to improve the interpretability of classification results by providing spatial manipulation masks or temporal forgery segments. However, the practical effectiveness of these methods remains suboptimal due to limitations of the forgery data. Most current deepfake datasets predominantly offer binary labels, only a few datasets with localization annotations. However, they suffer from restricted forgery scenarios, limited diversity in deepfake types, and insufficient data scale, making them inadequate for complex real-world scenarios. To address this predicament, we construct a novel large-scale deepfake detection and localization ($textbf{DDL}$) dataset containing over $textbf{1.8M}$ forged samples and encompassing up to $textbf{75}$ distinct deepfake methods. The DDL design incorporates four key innovations: (1) $textbf{Diverse Forgery Scenarios}$, (2) $textbf{Comprehensive Deepfake Methods}$, (3) $textbf{Varied Manipulation Modes}$, and (4) $textbf{Fine-grained Forgery Annotations}$. Through these improvements, our DDL not only provides a more challenging benchmark for complex real-world forgeries, but also offers crucial support for building next-generation deepfake detection, localization, and interpretability methods. The DDL dataset project page is on https://deepfake-workshop-ijcai2025.github.io/main/index.html.


Key findings
The DDL dataset significantly surpasses existing datasets in scale and diversity of deepfake methods, providing a more challenging benchmark for deepfake detection and localization. The fine-grained annotations enable the development of more interpretable deepfake detection models, addressing a critical limitation of existing approaches.
Approach
The authors created a new dataset, DDL, with over 1.8 million forged samples encompassing 75 distinct deepfake methods. The dataset includes fine-grained annotations (spatial masks for images and temporal segments for videos) to facilitate the development of interpretable deepfake detection and localization models.
Datasets
DDL (Deepfake Detection and Localization) dataset, comprising DDL-I (image unimodal subset) and DDL-AV (audio-visual multimodal subset). The dataset uses several existing real facial datasets (FFHQ, CelebA, CelebV-HQ, VFHQ, VoxCeleb2, WiderFace, FDDB, Open Image, VisualNews, FFIW, Manual-Fake, FF++, DFDC, Celeb-DF) as source data.
Model(s)
UNKNOWN (The paper focuses on the dataset creation; no specific models for deepfake detection are trained or evaluated.)
Author countries
China