TFD-Video: Threshold-Aware Federated Deepfake Detection for Video Forensics

  • Maryam Al-Fehani*
  • , Abdullatif Al-Baseer
  • , Saif Al-Kuwari
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Deepfakes and other AI-based manipulated and synthesized videos pose a rising threat, yet training robust detectors under federated settings is challenging, where data is siloed and communication is limited. Existing compression strategies for Federated Learning (FL) can reduce detection accuracy for forensics, and standard federated averaging (FedAvg) may weaken client-specific adaptations that are important in practice. To this end, we propose Threshold-Aware Federated Deepfake Detection (TFD), a framework that combines communication-efficient structured sparsification with client-side optimization. Each client augments a shared video backbone with learnable per-filter thresholds that gate computations and induce structured sparsity. During training, clients update local weights and thresholds but transmit only compact threshold vectors. The server aggregates these vectors to establish a common sparsity pattern, while dense model parameters and data remain local. This efficient threshold-sharing scheme dramatically reduces communication overhead by several orders of magnitude while enabling each client to maintain a model tailored to its local data. We evaluate TFD on deepfake video benchmarks (FaceForensics++ and Celeb-DF), reporting detection metrics (accuracy, AUROC/AUPRC) and efficiency indicators (per-round payload size and costs). The results indicate that TFD can significantly reduce costs and latency while maintaining competitive detection performance relative to state-of-the-art approaches.

Original languageEnglish
Pages (from-to)23264-23278
Number of pages15
JournalIEEE Access
Volume14
DOIs
Publication statusPublished - 2026

Keywords

  • Accuracy
  • Communication-efficient training
  • Data models
  • Deepfake detection
  • Deepfakes
  • Feature extraction
  • Federated learning
  • Filters
  • Forensics
  • Forgery
  • Servers
  • Structured sparsity
  • Threshold sharing
  • Training
  • Video forensics

Fingerprint

Dive into the research topics of 'TFD-Video: Threshold-Aware Federated Deepfake Detection for Video Forensics'. Together they form a unique fingerprint.

Cite this