RoGA: Towards Generalizable Deepfake Detection through Robust Gradient Alignment

Authors: Lingyu Qiu, Ke Jiang, Xiaoyang Tan

Published: 2025-05-27 03:02:21+00:00

AI Summary

This paper introduces RoGA, a novel learning objective for deepfake detection that aligns generalization gradient updates with empirical risk minimization (ERM) gradient updates. By applying perturbations to model parameters and aligning ascending points across domains, RoGA enhances the robustness of deepfake detection models to domain shifts without introducing additional regularization, outperforming state-of-the-art methods.

Abstract

Recent advancements in domain generalization for deepfake detection have attracted significant attention, with previous methods often incorporating additional modules to prevent overfitting to domain-specific patterns. However, such regularization can hinder the optimization of the empirical risk minimization (ERM) objective, ultimately degrading model performance. In this paper, we propose a novel learning objective that aligns generalization gradient updates with ERM gradient updates. The key innovation is the application of perturbations to model parameters, aligning the ascending points across domains, which specifically enhances the robustness of deepfake detection models to domain shifts. This approach effectively preserves domain-invariant features while managing domain-specific characteristics, without introducing additional regularization. Experimental results on multiple challenging deepfake detection datasets demonstrate that our gradient alignment strategy outperforms state-of-the-art domain generalization techniques, confirming the efficacy of our method. The code is available at https://github.com/Lynn0925/RoGA.


Key findings
RoGA consistently outperforms state-of-the-art domain generalization techniques on multiple deepfake detection datasets. Ablation studies confirm the effectiveness of both the robustness gradient optimization and domain-aware gradient alignment components. Interpretability analysis using Grad-CAM and t-SNE reveals that RoGA learns more robust and domain-invariant features compared to baseline methods.
Approach
RoGA addresses the problem of deepfake detection generalization by aligning gradient updates across different domains. It does this by applying perturbations to model parameters, aligning the ascending points across domains to find a flatter minimum, thus improving robustness to domain shifts. This approach avoids the need for additional regularization modules.
Datasets
FaceForensics++ (FF++), Deepfake Detection Challenge (DFDC), CelebDF (v1, v2), DFDCP, and UADFV
Model(s)
ResNet34, Xception, EfficientNetB4 (used in comparisons, not the main contribution)
Author countries
China