Hybrid Deep Learning–Based Framework for Detection and Analysis of Manipulated Video Content
Main Article Content
Abstract
Quick developments in generative artificial intelligence (GenAI) have ushered in an era where highly realistic manipulated videos are now being produced at an unprecedented pace, which has thrown a big challenge to the authenticity of digital media, cybersecurity, public trust, and information integrity online. Most of the prior works on deepfake detection have been dedicated to either spatial feature extraction or temporal sequence modeling, and fall short in addressing the increasingly powerful deep learning-based deepfake samples. To overcome such drawbacks, this paper introduces an Attention-Enhanced Hybrid Deep Learning Framework for Robust Deepfake Video Detection and Analysis, which combines EfficientNetB2 to extract discriminative spatial features and a Bidirectional Gated Recurrent Unit (Bi-GRU) with the inclusion of an Attention Mechanism to learn temporal features adaptively. The proposed framework is able to effectively account for visual artifacts at a frame level and long-range temporal inconsistencies within manipulated videos. In addition, three universal architectures, namely Hybrid Transformer, Temporal Pooling, and CNN3D, are used as baseline models for comparison. Here, experiments are performed on a balanced set of 2,952 authentic and manipulated videos, using a uniform frame sampling, a uniform image normalization, and a uniform preprocessing. Class-weighted loss with the AdamW optimizer is used to train the models and evaluate the models with accuracy, precision, recall, F1-score, and Area Under the Receiver Operating Characteristic Curve (AUC). The results of the experiments presented in this paper demonstrate that the proposed Hybrid_GRU_Attention model can attain the highest detection performance with high accuracy of 95.75% and high AUC of 0.9771, which are better than the existing baseline models with high computational efficiency. The suggested solution gives a trustworthy and scalable choice in multimedia forensics, digital content validation, and future deepfake detection applications.
Downloads
Article Details

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
[1] Passos, L. A.; Jodas, D.; Costa, K. A. P.; Souza Júnior, L. A.; Rodrigues, D.; Del Ser, J.; Camacho, D.; Papa, J. P. A Review of Deep Learning-Based Approaches for Deepfake Content Detection. Expert Syst. 2024, 41(8), e13570. https://doi.org/10.1111/exsy.13570
[2] Malik, A.; Kuribayashi, M.; Abdullahi, S. M.; Khan, A. N. DeepFake Detection for Human Face Images and Videos: A Survey. IEEE Access 2022, 10, 18757–18775. https://doi.org/10.1109/ACCESS.2022.3151186
[3] Khan, I.; Khan, K.; Ahmad, A. A Comprehensive Survey of DeepFake Generation and Detection Techniques in Audio-Visual Media. ICCK J. Image Anal. Process. 2025, 1(2), 73–95. https://doi.org/10.62762/JIAP.2025.431672
[4] Rani, G.; Kothekar, A.; Philip, S. G.; Dhaka, V. S.; Zumpano, E.; Vocaturo, E. Lightweight and Hybrid Transformer-Based Solution for Quick and Reliable Deepfake Detection. Front. Big Data 2025, 8, 1521653. https://doi.org/10.3389/fdata.2025.1521653
[5] Xi, A. J.; Chen, E. Classifying Deepfakes Using Swin Transformers. arXiv 2025, arXiv:2501.15656. https://doi.org/10.48550/arXiv.2501.15656
[6] Raza, A.; Basit, A.; Amin, A.; Arfeen, Z. A.; Masud, M. I.; Fayyaz, U.; Jumani, T. A. A Comprehensive Review of Deepfake Detection Techniques: From Traditional Machine Learning to Advanced Deep Learning Architectures. AI 2026, 7(2), 68. https://doi.org/10.3390/ai7020068
[7] Wang, J.; Wu, Z.; Ouyang, W.; Han, X.; Chen, J.; Jiang, Y.-G.; Li, S.-N. M2TR: Multi-Modal Multi-Scale Transformers for Deepfake Detection. In Proceedings of the 2022 International Conference on Multimedia Retrieval; Association for Computing Machinery: New York, 2022; pp 615–623. https://doi.org/10.1145/3512527.3531415
[8] Petmezas, G.; Tefas, A.; Pitas, I. Cross-Dataset Video Deepfake Detection Using Transformer and CNN Architectures. Mach. Vis. Appl. 2026, 37, 52. https://doi.org/10.1007/s00138-026-01809-w
[9] Bhat, N. A.; Giri, K. J. DeepFake Detection in Images and Videos: A Survey on Models, Datasets, and Evaluation Metrics. Multimed. Tools Appl. 2026, 85, 233. https://doi.org/10.1007/s11042-026-21365-9
[10] Nie, F.; Ni, J.; Zhang, J.; Zhang, B.; Zhang, W. DIP: Diffusion Learning of Inconsistency Pattern for General DeepFake Detection. IEEE Trans. Multimedia 2025, 27, 2155–2167. https://doi.org/10.1109/TMM.2024.3521766
[11] Han, Y.-H.; Huang, T.-M.; Hua, K.-L.; Chen, J.-C. Towards More General Video-Based Deepfake Detection through Facial Component Guided Adaptation for Foundation Model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2025; pp 22995–23005. https://doi.org/10.1109/CVPR52734.2025.02141