SFE-Net: Harnessing Biological Principles of Differential Gene Expression for Improved Feature Selection in Deep Learning Networks

View on arXiv ← Back to list

Authors: Yuqi Li, Yuanzhong Zheng, Yaoxuan Wang, Jianjun Yin, Haojun Fei

Published: 2024-12-30 08:46:50+00:00

AI Summary

SFE-Net, a novel deepfake detection framework, dynamically adjusts feature priorities based on the deepfake generation technique, inspired by biological differential gene expression. This improves detection accuracy and generalizability across diverse datasets, surpassing static models.

Abstract

In the realm of DeepFake detection, the challenge of adapting to various synthesis methodologies such as Faceswap, Deepfakes, Face2Face, and NeuralTextures significantly impacts the performance of traditional machine learning models. These models often suffer from static feature representation, which struggles to perform consistently across diversely generated deepfake datasets. Inspired by the biological concept of differential gene expression, where gene activation is dynamically regulated in response to environmental stimuli, we introduce the Selective Feature Expression Network (SFE-Net). This innovative framework integrates selective feature activation principles into deep learning architectures, allowing the model to dynamically adjust feature priorities in response to varying deepfake generation techniques. SFE-Net employs a novel mechanism that selectively enhances critical features essential for accurately detecting forgeries, while reducing the impact of irrelevant or misleading cues akin to adaptive evolutionary processes in nature. Through rigorous testing on a range of deepfake datasets, SFE-Net not only surpasses existing static models in detecting sophisticated forgeries but also shows enhanced generalization capabilities in cross-dataset scenarios. Our approach significantly mitigates overfitting by maintaining a dynamic balance between feature exploration and exploitation, thus producing more robust and effective deepfake detection models. This bio-inspired strategy paves the way for developing adaptive deep learning systems that are finely tuned to address the nuanced challenges posed by the varied nature of digital forgeries in modern digital forensics.

Key findings

SFE-Net outperforms existing static models in deepfake detection across multiple datasets. It demonstrates enhanced generalization capabilities in cross-dataset scenarios. While achieving high AUC scores, performance on complex datasets like DFDC shows room for improvement.

Approach

SFE-Net uses a bio-inspired approach, dynamically adjusting feature selection based on input characteristics. It extracts multiple features (lighting consistency, high-frequency components, morphological features, etc.) and uses LSTMs and a softmax layer for classification.

Datasets

FaceForensics++, Celeb-DF-v1, Celeb-DF-v2, DFDCP, DFDC, DeepFakeDetection

Model(s)

SFE-Net (a custom model incorporating LSTMs and a softmax layer)

Author countries

China

← Previous