论文标题
研究预处理和预测聚合对深泡检测任务的影响
Investigating the Impact of Pre-processing and Prediction Aggregation on the DeepFake Detection Task
论文作者
论文摘要
内容产生技术(广泛称为深击)的最新进展以及操纵媒体内容的在线扩散使对这种操纵的检测成为越来越重要的任务。即使有许多深泡检测方法,也只关注数据集预处理的影响以及框架级别到视频级别对模型性能的预测的汇总。在本文中,我们提出了一个预处理步骤,以提高培训数据质量并研究其对DeepFake检测性能的影响。我们还建议和评估视频级预测聚合方法的效果。实验结果表明,所提出的预处理方法可导致检测模型的性能有了显着改善,而拟议的预测聚合方案进一步提高了视频中有多个面孔的情况下的检测效率。
Recent advances in content generation technologies (widely known as DeepFakes) along with the online proliferation of manipulated media content render the detection of such manipulations a task of increasing importance. Even though there are many DeepFake detection methods, only a few focus on the impact of dataset preprocessing and the aggregation of frame-level to video-level prediction on model performance. In this paper, we propose a pre-processing step to improve the training data quality and examine its effect on the performance of DeepFake detection. We also propose and evaluate the effect of video-level prediction aggregation approaches. Experimental results show that the proposed pre-processing approach leads to considerable improvements in the performance of detection models, and the proposed prediction aggregation scheme further boosts the detection efficiency in cases where there are multiple faces in a video.