MCS-GAN: A Different Understanding for Generalization of Deep Forgery Detection

作者：Shuai Xiao, Guipeng Lan, Jiachen Yang, Wen Lu, Qinggang Meng, Xinbo Gao · 发表于：IEEE Transactions on Multimedia · 年份：2023 · DOI：10.1109/tmm.2023.3279993 · 被引用次数：47 · 研究领域：Digital Media Forensic Detection、Generative Adversarial Networks and Image Synthesis、Anomaly Detection Techniques and Applications

After several years of development, deep synthesis technology has made significant progress in image and video synthesis. Deep forgery represented by Deepfakes has become a research hotspot, which is used as a tool for disinformation attacks. The current strongly discriminative models can have good performance on specific datasets, even close to 100% accuracy. Unfortunately, since a specific discriminative method only fits a specific data distribution, and different forgery methods or datasets have different data distributions. These methods fail to achieve high performance in cross-dataset detection. In response to this problem and focusing on the actual situation, we adjust the strong generalization detection across the dataset to the generalization detection of unseen fake video. We propose Multi-Crise-Cross Attention and StyleGANv2 Generative Adversarial Network (MCS-GAN). Firstly, we built a Generative Adversarial Network (GAN) framework to learn the distribution of real face data and generate corresponding face images. Secondly, to break the high stitch between the fake region and the background, the model needs to have strong enough feature analysis and pixel restoration capabilities. Therefore, we propose a generator consisting of a Multi-Crise-Cross-Attention (MC) encoder and a StyleGANv2 (SG2) decoder. Finally, to avoid the situation where as long as a face is normal or different faces are abnormal, we set a latent space encoding discriminator and increase the ratio...