Giter VIP home page Giter VIP logo

awesome-deepfakes-detection's Introduction

Awesome Deepfakes DetectionAwesome

A list of Deepfakes Detection datasets, tools, papers and code. If this list help you in your research, a star is my pleasure.

If you want to contribute to this list, welcome to send me a pull request or contact me :) .

This repo only collect papers related to Deepfake Detection. If you are also interested in Deepfakes, please refer to: Awesome Deepfakes.

Contents

Datasets

Video Datasets

  • UADFV: Exposing Deep Fakes Using Inconsistent Head Poses. Paper
  • EBV: In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking. Paper Download
  • Deepfake-TIMIT: DeepFakes: a New Threat to Face Recognition? Assessment and Detection. Paper Download
  • DFFD: On the Detection of Digital Face Manipulation. Paper Download
  • DeepfakeDetection: Download
  • Celeb-DF (v1): Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics. Paper Download
  • Celeb-DF (v2): Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics. Paper Download
  • DFDC: The DeepFake Detection Challenge (DFDC) Dataset. Paper Download
  • FaceForensic++: FaceForensics++: Learning to Detect Manipulated Facial Images. Paper Download
  • FFIW-10K: Face Forensics in the Wild. Paper Download
  • Deeper Forensic-1.0: DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection. Paper Download
  • Wild Deepfake: WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection. Paper Download
  • ForgeryNet: ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis. Paper Download
  • WLDR: Protecting World Leaders Against Deep Fakes. Paper
Real Videos Fake Videos Year Note
UADFV 49 49 2018 focus on head pose
EBV - 49 2018 focus on eye blinking
Deepfake-TIMIT 320 640 2018 GAN-Based methods
DFFD 1,000 3000 2019 mutiple SOTA methods
DeepfakeDetection 363 3,068 2019 collect from actors with publicly available generation methods
Celeb-DF (v2) 590 5639 2019 high quality
DFDC 23,564 104,500 2019 DFDC competition on Kaggle
FaceForensic++ 1,000 5,000 2019 five different generation methods
FFIW-10K 10,000 10,000 2019 mutiple faces in one frame
WLDR - - 2019 person of interest video from Youtube
DeeperForensics-1.0 50,000 10,000 2020 add real-world perturbations
Wild-Deepfake 3,805 3,509 2021 collect from Internet
ForgeryNet 99,630 121,617 2021 8 video-level generation methods, add perturbations

Image Datasets

  • DFFD: On the Detection of Digital Face Manipulation. Paper Download
  • iFakeFaceDB: GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detection. Paper Download
  • 100k Faces Generated by AI (Online): Download
  • DFGC: DFGC 2021: A DeepFake Game Competition. Paper Dowload
  • ForgeryNet: ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis. Paper Download
Real Images Fake Images Year Note
DFFD 58,703 240,336 2019 mutiple SOTA methods
iFakeFaceDB - 87,000 (StyleGAN) 2020 generated by StyleGAN
100k Faces - 100,000 (StyleGAN) 2021 generated by StyleGAN
DFGC 1,000 N*1,000 2021 DFGC 2021 competition, fake images generated by users
ForgeryNet 1,438,201 1,457,861 2021 7 image-level generation methods, add perturbations

Competitions

Name Link Year Note
Deepfake Detection Challenge Website 2019 1. video-level detection.
2. use DFDC datasets.
3. the first worldwide competition.
4. more than 2,000 teams participated.
DeepForensics Challenge Website 2020 1. video-level detection.
2. use DeeperForensics-1.0 datasets.
3. simulates real-world scenarios.
Deepfake Game Competition Website 2021 1. both image-level generation and video-level detection track.
2. use Celeb-DF(v2) datasets.
Face Forgery Analysis Challenge Website 2021 1. both image-level and video-level detection track.
2. addtional temporal localization track.
3. use ForgeryNet dataset.

Tools

Recent Conference Papers

CVPR

  • Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization, CVPR 2023: Paper Github
  • Implicit Identity Driven Deepfake Face Swapping Detection, CVPR 2023: Paper
  • AltFreezing for More General Face Forgery Detection, CVPR 2023: Paper
  • AUNet: Learning Relations Between Action Units for Face Forgery Detection, CVPR 2023: Paper
  • Dynamic Graph Learning with Content-guided Spatial-Frequency Relation Reasoning for Deepfake Detection, CVPR 2023: Paper
  • TruFor: Leveraging all-round clues for trustworthy image forgery detection and localization, CVPR 2023: Paper Github
  • Learning on Gradients: Generalized Artifacts Representation for GAN-Generated Images Detection, CVPR 2023: Paper Github
  • Towards Universal Fake Image Detectors That Generalize Across Generative Models, CVPR 2023: Paper Github
  • DF-Platter: Multi-Face Heterogeneous Deepfake Dataset, CVPR 2023: Paper
  • Self-Supervised Video Forensics by Audio-Visual Anomaly Detection, CVPR 2023: Paper Github
  • Fake it till you make it: Learning transferable representations from synthetic ImageNet clones, CVPR 2023: Paper Pretrained
  • Evading DeepFake Detectors via Adversarial Statistical Consistency, CVPR 2023: Paper
  • Evading Forensic Classifiers with Attribute-Conditioned Adversarial Faces, CVPR 2023: Paper Github
  • Detecting and Grounding Multi-Modal Media Manipulation, CVPR 2023: Paper Github
  • Hierarchical Fine-Grained Image Forgery Detection and Localization, CVPR 2023: Paper Github
  • Instance-Aware Domain Generalization for Face Anti-Spoofing, CVPR 2023: Paper Github
  • Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignment, CVPR 2023: Paper Github
  • Learning Second Order Local Anomaly for General Face Forgery Detection, CVPR 2022: Paper
  • DeepFake Disrupter: The Detector of DeepFake Is My Friend, CVPR 2022: Paper
  • Protecting Celebrities from DeepFake with Identity Consistency Transformer, CVPR 2022: Paper Github
  • Detecting Deepfakes with Self-Blended Images, CVPR 2022: Paper Github
  • Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection, CVPR 2022: Paper Github
  • End-to-End Reconstruction-Classification Learning for Face Forgery Detection, CVPR 2022: Paper
  • Robust Image Forgery Detection Against Transmission Over Online Social Networks, CVPR 2022: Paper Github
  • Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection, CVPR 2022: Paper
  • Exploring Frequency Adversarial Attacks for Face Forgery Detection, CVPR 2022: Paper
  • ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis, CVPR 2021: Paper Github
  • Representative Forgery Mining for Fake Face Detection, CVPR 2021: Paper Github
  • MagDR: Mask-Guided Detection and Reconstruction for Defending Deepfakes, CVPR 2021: Paper
  • Improving the Efficiency and Robustness of Deepfakes Detection Through Precise Geometric Features, CVPR 2021: Paper Github
  • Multi-Attentional Deepfake Detection, CVPR 2021: Paper Github
  • Lips Don't Lie: A Generalisable and Robust Approach To Face Forgery Detection, CVPR 2021: Paper
  • Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain, CVPR 2021: Paper
  • Frequency-Aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection, CVPR 2021: Paper
  • Generalizing Face Forgery Detection With High-Frequency Features, CVPR 2021: Paper
  • Face Forgery Detection by 3D Decomposition, CVPR 2021: Paper
  • Global Texture Enhancement for Fake Face Detection in the Wild, CVPR 2020: Paper
  • On the Detection of Digital Face Manipulation, CVPR 2020: Paper Github
  • Face X-Ray for More General Face Forgery Detection, CVPR 2020: Paper
  • CNN-generated images are surprisingly easy to spot... for now, CVPR 2020: Paper Github
  • CORE: Consistent Representation Learning for Face Forgery Detection, CVPR Workshop 2022: Paper Github
  • FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning, CVPR Workshop 2021: Paper
  • Towards Untrusted Social Video Verification to Combat Deepfakes via Face Geometry Consistency, CVPR Workshop 2020: Paper
  • OC-FakeDect: Classifying Deepfakes Using One-class Variational Autoencoder, CVPR Workshop 2020: Paper
  • Exposing DeepFake Videos By Detecting Face Warping Artifacts, CVPR Workshop 2019: Paper
  • Recurrent Convolutional Strategies for Face Manipulation Detection in Videos, CVPR Workshop 2019: Paper
  • Two-Stream Neural Networks for Tampered Face Detection, CVPR Workshop 2017: Paper

ICCV

  • ID-Reveal: Identity-aware DeepFake Video Detection, ICCV 2021: Paper Github
  • Learning Self-Consistency for Deepfake Detection, ICCV 2021: Paper
  • Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data, ICCV 2021: Paper Github
  • KoDF: A Large-scale Korean DeepFake Detection Dataset, ICCV 2021: Paper
  • Exploring Temporal Coherence for More General Video Face Forgery Detection, ICCV 2021: Paper Github
  • Joint Audio-Visual Deepfake Detection, ICCV 2021: Paper
  • OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wild, ICCV 2021: Paper
  • Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints, ICCV 2019: Paper Github
  • DeepFake MNIST+: A DeepFake Facial Animation Dataset, ICCV Workshop 2021: Paper

ECCV

  • Detecting and Recovering Sequential DeepFake Manipulation, ECCV 2022: Paper Github
  • Hierarchical Contrastive Inconsistency Learning for Deepfake Video Detection, ECCV 2022: Paper
  • Explaining Deepfake Detection by Analysing Image Matching, ECCV 2022: Paper
  • FingerprintNet: Synthesized Fingerprints for Generated Image Detection, ECCV 2022: Paper
  • UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detection, ECCV 2022: Paper Github
  • Adaptive Face Forgery Detection in Cross Domain, ECCV 2022: Paper
  • An Information Theoretic Approach for Attention-Driven Face Forgery Detection, ECCV 2022: Paper
  • Exploring Disentangled Content Information for Face Forgery Detection, ECCV 2022: Paper
  • Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues, ECCV 2020: Paper
  • Two-branch Recurrent Network for Isolating Deepfakes in Videos, ECCV 2020: Paper

NIPS

  • Delving into Sequential Patches for Deepfake Detection, NIPS 2022: Paper

  • OST: Improving Generalization of DeepFake Detection via One-Shot Test-Time Training, NIPS 2022: Paper Github

  • WaveFake: A Data Set to Facilitate Audio Deepfake Detection, NIPS 2021: Paper Github

  • AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection, NIPS 2020: Paper

ICLR

  • Responsible Disclosure of Generative Models Using Scalable Fingerprinting, ICLR 2022: Paper Github

ICML

  • Leveraging Frequency Analysis for Deep Fake Image Recognition, ICML 2020: Paper Github

IJCAI

  • Region-Aware Temporal Inconsistency Learning for DeepFake Video Detection, IJCAI 2022: Paper
  • Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbations, IJCAI 2022: Paper Github
  • Detecting Deepfake Videos with Temporal Dropout 3DCNN, IJCAI 2021: Paper
  • Dynamic Inconsistency-aware DeepFake Video Detection, IJCAI 2021: Paper
  • An Examination of Fairness of AI Models for Deepfake Detection, IJCAI 2021: Paper
  • Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis, IJCAI 2021: Paper Github
  • FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces, IJCAI 2020: Paper

AAAI

  • Deepfake Video Detection via Facial Action Dependencies Estimation, AAAI 2023: Paper
  • Noise Based Deepfake Detection via Multi-Head Relative-Interaction, AAAI 2023: Paper
  • Practical Disruption of Image Translation Deepfake Networks, AAAI 2023: Paper
  • Delving into the Local: Dynamic Inconsistency Learning for DeepFake Video Detection, AAAI 2022: Paper
  • Deepfake Network Architecture Attribution, AAAI 2022: Paper Github
  • Dual Contrastive Learning for General Face Forgery Detection, AAAI 2022: Paper
  • CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes, AAAI 2022: Paper Github
  • ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images, AAAI 2022: Paper
  • Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learning, AAAI 2022: Paper
  • FInfer: Frame Inference-based Deepfake Detection for High-Visual-Quality Videos, AAAI 2022: Paper
  • FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbations, AAAI 2022: Paper
  • Domain General Face Forgery Detection by Learning to Weight, AAAI 2021: Paper Github
  • Local Relation Learning for Face Forgery Detection, AAAI 2021: Paper

MM

  • Wavelet-enhanced Weakly Supervised Local Feature Learning for Face Forgery Detection, ACM MM 2022: Paper

  • Defeating DeepFakes via Adversarial Visual Reconstruction, ACM MM 2022: Paper

  • Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectors, ACM MM 2021: Paper

  • Spatiotemporal Inconsistency Learning for DeepFake Video Detection, ACM MM 2021: Paper

  • Video Transformer for Deepfake Detection with Incremental Learning, ACM MM 2021: Paper

  • Metric Learning for Anti-Compression Facial Forgery Detection, ACM MM 2021: Paper

  • CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation, ACM MM 2021: Paper

  • FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Tracking, ACM MM 2021: Paper

  • FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset, ACM MM 2021 Workshop: Paper Github

  • Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization, ACM MM 2020: Paper Github

  • Sharp Multiple Instance Learning for DeepFake Video Detection, ACM MM 2020: Paper

  • DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms, ACM MM 2020: Paper

  • Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues, ACM MM 2020: Paper

Survey

  • Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review, arXiv 2022: Paper
  • Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward, Applied Intelligence 2022: Paper
  • DeepFake Detection for Human Face Images and Videos: A Survey, IEEE Access 2022: Paper
  • Deepfake Detection: A Systematic Literature Review, IEEE Access 2022: Paper
  • A Survey on Deepfake Video Detection, Iet Biometrics 2021: Paper

Spatiotemporal Based

  • Hierarchical Contrastive Inconsistency Learning for Deepfake Video Detection, ECCV 2022: Paper
  • Region-Aware Temporal Inconsistency Learning for DeepFake Video Detection, IJCAI 2022: Paper
  • FInfer: Frame Inference-based Deepfake Detection for High-Visual-Quality Videos, AAAI 2022: Paper
  • Delving into the Local: Dynamic Inconsistency Learning for DeepFake Video Detection, AAAI 2022: Paper
  • Deepfake video detection with spatiotemporal dropout transformer, ACM MM 2022: Paper
  • Exploring Complementarity of Global and Local Spatiotemporal Information for Fake Face Video Detection, ICASSP 2022: Paper
  • Face Forgery Detection Based on Facial Region Displacement Trajectory Series, arXiv 2022: Paper
  • Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization, arXiv 2022: Paper
  • Exploring Temporal Coherence for More General Video Face Forgery Detection, ICCV 2021: Paper
  • Detecting Deepfake Videos with Temporal Dropout 3DCNN, IJCAI 2021: Paper
  • Video Transformer for Deepfake Detection with Incremental Learning, ACM MM 2021: Paper
  • FSSPOTTER: Spotting Face-Swapped Video by Spatial and Temporal Clues, ICME 2020: Paper
  • Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning, AIPR 2020: Paper

Frequency Based

  • FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbations, AAAI 2022: Paper
  • Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learning, AAAI 2022: Paper
  • Wavelet-enhanced Weakly Supervised Local Feature Learning for Face Forgery Detection, ACM MM 2022: Paper
  • Wavelet-Packets for Deepfake Image Analysis and Detection, Machine Learning 2022: Paper Github
  • Generalizing Face Forgery Detection with High-frequency Features, CVPR 2021: Paper
  • ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images, AAAI 2021: Paper
  • Local Relation Learning for Face Forgery Detection, AAAI 2021: Paper
  • Fighting Deepfakes by Detecting GAN DCT Anomalies, Journal of Imaging 2021: Paper
  • MD-CSDNetwork: Multi-Domain Cross Stitched Network for Deepfake Detection, FG 2021: Paper
  • Using Grayscale Frequency Statistic to Detect Manipulated Faces in Wavelet-Domain, SMC 2021: Paper Github
  • Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning, AIPR 2020: Paper
  • Effective and Fast DeepFake Detection Method Based on Haar Wavelet Transform, CSASE 2020: Paper

Generalization

  • Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignment, CVPR 2023: Paper Github
  • Generalized Facial Manipulation Detection with Edge Region Feature Extraction, WACV 2022: Paper
  • Supervised Contrastive Learning for Generalizable and Explainable DeepFakes Detection, WACV 2022: Paper Github
  • Towards Generalizable Detection of Face Forgery via Self-Guided Model-Agnostic Learning, PRL 2022: Paper
  • Learning to mask: Towards generalized face forgery detection, arXiv 2022: Paper
  • FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning, CVPR 2021: Paper
  • Detection of Fake and Fraudulent Faces via Neural Memory Networks, TIFS 2021: Paper
  • One detector to rule them all: Towards a general deepfake attack detection framework, Proceedings of the Web Conference 2021: Paper Github
  • Supervised Contrastive Learning for Generalizable and Explainable DeepFakes Detection, WACV 2021: Paper Github
  • Improving Generalization of Deepfake Detection with Domain Adaptive Batch Normalization, Proceedings of the 1st International Workshop on Adversarial Learning for Multimedia 2021: Paper
  • FeatureTransfer: Unsupervised Domain Adaptation for Cross-Domain Deepfake Detection, Security and Communication Networks 2021: Paper
  • Training Strategies and Data Augmentations in CNN-based DeepFake Video Detection, WIFS 2020: Paper
  • Improved Generalizability of Deep-Fakes Detection Using Transfer Learning Based CNN Framework, ICICT 2020: Paper
  • ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection, arXiv 2018: Paper

Interpretability

  • Explaining Deepfake Detection by Analysing Image Matching, ECCV 2022: Paper
  • Detecting and Recovering Sequential DeepFake Manipulation, ECCV 2022: Paper Github
  • Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors, arXiv 2022: Paper
  • Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes, WACV 2021: Paper
  • Supervised Contrastive Learning for Generalizable and Explainable DeepFakes Detection, WACV 2021: Paper Github
  • Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes, WACV 2021: Paper
  • What’s wrong with this video? Comparing Explainers for Deepfake Detection, arXiv 2021: Paper
  • PRRNet: Pixel-Region relation network for face forgery detection, Pattern Recognition 2021: Paper
  • What makes fake images detectable? Understanding properties that generalize, arXiv 2020: Paper Github

Human-Decision

  • Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis, WACV 2023: Paper
  • Understanding Users’ Deepfake Video Verification Strategies, International Conference on Human-Computer Interaction 2022: Paper
  • Crowd–powered Face Manipulation Detection: Fusing Human Examiner Decisions, arXiv 2022: Paper
  • Deepfake Caricatures: Amplifying attention to artifacts increases deepfake detection by humans and machines, arXiv 2022: Paper

Localization

  • Hierarchical Fine-Grained Image Forgery Detection and Localization, CVPR 2023: Paper Github
  • Region-Aware Temporal Inconsistency Learning for DeepFake Video Detection, IJCAI 2022: Paper
  • Exposing Face Forgery Clues via Retinex-based Image Enhancement, ACCV 2022: Paper
  • Exploring Spatial-Temporal Features for Deepfake Detection and Localization, arXiv 2022: Paper Github
  • DeepFake Detection Based on Discrepancies Between Faces and their Context, TPAMI 2021: Paper
  • Dlfmnet: End-to-end detection and localization of face manipulation using multi-domain features, ICME 2021: Paper
  • Face X-ray for More General Face Forgery Detection, CVPR 2020: Paper
  • Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos, BATS 2019: Paper

Multi-modal Based

  • AVoiD-DF: Audio-Visual Joint Learning for Detecting Deepfake, TIFS 2023: Paper
  • M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection, ICMR 2022: Paper
  • Voice-Face Homogeneity Tells Deepfake, arXiv 2022: Paper
  • Audio-Visual Person-of-Interest DeepFake Detection, arXiv 2022: Paper Github
  • Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization, arXiv 2022: Paper
  • Lip Sync Matters: A Novel Multimodal Forgery Detector, APSIPA 2022: Paper
  • Multimodal Forgery Detection Using Ensemble Learning, APSIPA 2022: Paper
  • Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning, AIPR 2020: Paper

Biological Signal

  • Local attention and long-distance interaction of rPPG for deepfake detection, The Visual Computer 2023: Paper
  • Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues, arXiv 2022: Paper
  • Visual Representations of Physiological Signals for Fake Video Detection, arXiv 2022: Paper
  • Study of detecting behavioral signatures within DeepFake videos, arXiv 2022: Paper
  • Detecting Deep-Fake Videos from Aural and Oral Dynamics, CVPR Workshop 2021: Paper
  • Countering Spoof: Towards Detecting Deepfake with Multidimensional Biological Signals, Security and Communication Networks 2021: Paper
  • A Study on Effective Use of BPM Information in Deepfake Detection, ICTC 2021: Paper
  • Exposing Deepfake with Pixel-wise Autoregressive and PPG Correlation from Faint Signals, arXiv 2021: Paper
  • FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals, TPAMI 2020: Paper
  • How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signals, IJCB 2020: Paper
  • DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimation, arXiv 2020: Paper Github
  • Predicting Heart Rate Variations of Deepfake Videos using Neural ODE, ICCV Workshop 2019: Paper

Fairness

  • GBDF: Gender Balanced DeepFake Dataset Towards Fair DeepFake Detection, ICPR 2022: Paper Github
  • A Comprehensive Analysis of AI Biases in DeepFake Detection With Massively Annotated Databases, arXiv 2022: Paper Github
  • An Examination of Fairness of AI Models for Deepfake Detection, IJCAI 2021: Paper

Fingerprint and Watermark

  • Responsible Disclosure of Generative Models Using Scalable Fingerprinting, ICLR 2022: Paper Github
  • DeepFake Disrupter: The Detector of DeepFake Is My Friend, CVPR 2022: Paper
  • FingerprintNet: Synthesized Fingerprints for Generated Image Detection, ECCV 2022: Paper
  • CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes, AAAI 2022: Paper Github
  • Defeating DeepFakes via Adversarial Visual Reconstruction, ACM MM 2022: Paper
  • DeepFakes for Privacy: Investigating the Effectiveness of State-of-the-Art Privacy-Enhancing Face Obfuscation Methods, Proceedings of the 2022 International Conference on Advanced Visual Interfaces 2022: Paper
  • Metamorphic Testing-based Adversarial Attack to Fool Deepfake Detectors, ICPR 2022: Paper
  • FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes, arXiv 2022: Paper Github
  • Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbations, arXiv 2022: Paper Github
  • System Fingerprints Detection for DeepFake Audio: An Initial Dataset and Investigation, arXiv 2022: Paper
  • Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data, ICCV 2021: Paper Github
  • FaceGuard: Proactive Deepfake Detection, CoRR 2021: Paper

Identity-Related

  • TI2Net: Temporal Identity Inconsistency Network for Deepfake Detection, WACV 2023: Paper
  • Protecting Celebrities from DeepFake with Identity Consistency Transformer, CVPR 2022: Paper Github
  • Protecting World Leader Using Facial Speaking Pattern Against Deepfakes, IEEE Signal Processing Letters 2022: Paper
  • Protecting world leaders against deep fakes using facial, gestural, and vocal mannerisms, Proceedings of the National Academy of Sciences 2022: Paper
  • Study of detecting behavioral signatures within DeepFake videos, arXiv 2022: Paper
  • Voice-Face Homogeneity Tells Deepfake, arXiv 2022: Paper
  • Audio-Visual Person-of-Interest DeepFake Detection, arXiv 2022: Paper Github
  • Detecting Deep-Fake Videos from Aural and Oral Dynamics, CVPR Workshop 2021: Paper
  • ID-Reveal: Identity-aware DeepFake Video Detection, ICCV 2021: Paper Github
  • This Face Does Not Exist... But It Might Be Yours! Identity Leakage in Generative Models, WACV 2021: Paper
  • An Experimental Evaluation on Deepfake Detection using Deep Face Recognition, ICCST 2021: Paper
  • Detecting Deep-Fake Videos from Appearance and Behavior, WIFS 2020: Paper
  • Identity-Driven DeepFake Detection, arXiv 2020: Paper
  • Protecting World Leaders Against Deep Fakes, CVPR Workshop 2019: Paper

Adversarial Attack

  • Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection, CVPR 2022: Paper Github
  • Exploring Frequency Adversarial Attacks for Face Forgery Detection, CVPR 2022: Paper
  • TAFIM: Targeted Adversarial Attacks against Facial Image Manipulations, ECCV 2022: Paper Github
  • Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbations, IJCAI 2022: Paper Github
  • Investigate Evolutionary Strategies for Black-box Attacks to Deepfake Forensic Systems, SoICT 2022: Paper
  • Evaluating Robustness of Sequence-based Deepfake Detector Models by Adversarial Perturbation, WDC 2022: Paper
  • Restricted Black-box Adversarial Attack Against DeepFake Face Swapping, CoRR 2022: Paper

Real Scenario

  • A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentials, WACV 2023: Paper
  • Robust Image Forgery Detection Against Transmission Over Online Social Networks, TIFS 2022: Paper Github
  • Am I a Real or Fake Celebrity? Evaluating Face Recognition and Verification APIs under Deepfake Impersonation Attack, Proceedings of the ACM Web Conference 2022: Paper Github
  • DeSI: Deepfake Source Identifier for Social Media, CVPR Workshop 2022: Paper
  • Investigate Evolutionary Strategies for Black-box Attacks to Deepfake Forensic Systems, SoICT 2022: Paper
  • Seeing is Living? Rethinking the Security of Facial Liveness Verification in the Deepfake Era, CoRR 2022: Paper
  • DeFakePro: Decentralized DeepFake Attacks Detection using ENF Authentication, arXiv 2022: Paper
  • DF-Captcha: A Deepfake Captcha for Preventing Fake Calls, arXiv 2022: Paper
  • Practical Deepfake Detection: Vulnerabilities in Global Contexts, arXiv 2022: Paper
  • My Face My Choice: Privacy Enhancing Deepfakes for Social Media Anonymization, arXiv 2022: Paper
  • Preventing DeepFake Attacks on Speaker Authentication by Dynamic Lip Movement Analysis, TIFS 2021: Paper Github
  • Real, Forged or Deep Fake? Enabling the Ground Truth on the Internet, IEEE Access 2021: Paper
  • DeepFake-o-meter: An Open Platform for DeepFake Detection, SP Workshop 2021: Paper
  • Towards Untrusted Social Video Verification to Combat Deepfakes via Face Geometry Consistency, CVPR Workshop 2020: Paper

Anomaly Detection

  • Self-Supervised Video Forensics by Audio-Visual Anomaly Detection, arXiv 2023: Paper Github
  • Learning Second Order Local Anomaly for General Face Forgery Detection, CVPR 2022: Paper
  • SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakes, arXiv 2022: Paper
  • Differential Anomaly Detection for Facial Images, WIFS 2021: Paper
  • Fighting Deepfakes by Detecting GAN DCT Anomalies, Journal of Imaging 2021: Paper

Self-Supervised Learning

  • Self-Supervised Video Forensics by Audio-Visual Anomaly Detection, arXiv 2023: Paper Github
  • End-to-End Reconstruction-Classification Learning for Face Forgery Detection, CVPR 2022: Paper
  • Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection, CVPR 2022: Paper
  • UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detection, ECCV 2022: Paper
  • Dual Contrastive Learning for General Face Forgery Detection, AAAI 2022: Paper
  • Self-supervised Transformer for Deepfake Detection, arXiv 2022: Paper
  • MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakes, CVPR 2021: Paper
  • DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning, IJCNN 2021: Paper
  • Deepfake videos detection using self-supervised decoupling network, ICME 2021: Paper
  • Detecting Deep-Fake Videos from Appearance and Behavior, WIFS 2020: Paper

Source Model Attribution

  • Deepfake Network Architecture Attribution, AAAI 2022: Paper Github
  • Model Attribution of Face-swap Deepfake Videos, ICIP 2022: Paper
  • On the Exploitation of Deepfake Model Recognition, CVPR Workshop 2022: Paper
  • Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data, ICCV 2021: Paper Github
  • Towards Discovery and Attribution of Open-world GAN Generated Images, ICCV 2021: Paper
  • Improving Generalization of Deepfake Detection by Training for Attribution, MMSP 2021: Paper
  • How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signals, IJCB 2020: Paper
  • Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints, ICCV 2019: Paper
  • On Attribution of Deepfakes, arXiv 2020: Paper
  • Scalable Fine-grained Generated Image Classification Based on Deep Metric Learning, CoRR 2019: Paper

Multiclass Classification

  • Three-classification Face Manipulation Detection Using Attention-based Feature Decomposition, Computers & Security 2022: Paper
  • Forgery-Domain-Supervised Deepfake Detection with Non-Negative Constraint, IEEE Signal Processing Letters 2022: Paper

Federated Learning

  • FedForgery: Generalized Face Forgery Detection with Residual Federated Learning, arXiv 2022: Paper Github

Knowledge Distillation

  • Confidence-Calibrated Face Image Forgery Detection with Contrastive Representation Distillation, ACCV 2022: Paper Github

Meta-Learning

  • Domain General Face Forgery Detection by Learning to Weight, AAAI 2021: Paper Github

Depth Based

  • DepthFake: a depth-based strategy for detecting Deepfake videos, arXiv 2022: Paper
  • Exploring Depth Information for Face Manipulation Detection, arXiv 2022: Paper

awesome-deepfakes-detection's People

Contributors

daisy-zhang avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

awesome-deepfakes-detection's Issues

Paper mentioned twice

Thanks for such a comprehensive list.

I noticed "Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data", ICCV 2021" was mentioned twice in the ICCV paper list. I think one can be removed.

Thanks.

Q

Thanks for your work. May I ask why the comparison content about the benchmark of all the SOTA methods was cancelled in the update after September?

关于FF++数据集的下载

很抱歉再次打扰您,我最近尝试下载FF++ raw格式的数据集,但是遇到了如下图的问题。我更换了不同计算机也调整了一些设置但是都没有效果。请问还有别的方法可以下载FF++ raw格式的数据集吗
0O J6Z~`3TX16% 1Y7_U299

Request for listing best results.

Could you please list some of the papers and open source projects that currently have the best results in deepfake detection in this project? This will be of great help to my study.

关于FF++数据处理

你好,关于FF++的数据集预处理我有些疑惑,我注意到官方提供了划分json 文件,里面是些数字。但是造假视频一般有两个数字表示源视频或者目标视频,那到底是按照源视频的编号他是否属于训练集还是有别的什么方法,以及是否有讨论群之类的啊?

graph convolutional network

Thank you very much. Do you know that there are some papers on fake face detection with graph convolutional neural network?

关于数据集的问题

大佬你好,我想请问一下如何将这些数据集划分成训练集与测试集。将一段视频的前80%作为训练集,后20%作为测试集这种划分方式可行吗?(感觉不太好,这样就好像把训练集的数据拿到测试集中了)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.