• Paper List for Misinformation Video Detection
  • Contents
  • Introduction
    • Keywords Convention
  • Papers
    • Related Survey
    • Analysis
    • Detection at Signal Level
    • Detection at Semantic and Intent Level
    • Related Areas
    • Future Directions
  • Resources
    • Datasets
    • Tools
  • Citation

This is a paper list (working in progress) about Misinformation Video Detection

section in our survey

main feature

1. Multi-modal Misinformation Detection: Approaches, Challenges and Opportunities.

   Sara Abdali. arXiv preprint arXiv:2203.13883 (2022). [pdf]

2. A Survey on Multimodal Disinformation Detection.

   Firoj Alam, Stefano Cresci, Tanmoy Chakraborty, Fabrizio Silvestri, Dimitar Dimitrov, Giovanni Da San Martino, Shaden Shaar, Hamed Firooz, Preslav Nakov. arXiv preprint arXiv:2103.12541 (2021) [pdf]

3. Exploring the role of visual content in fake news detection.

   Juan Cao, Peng Qi, Qiang Sheng, Tianyun Yang, Junbo Guo, Jintao Li. Disinformation, Misinformation, and Fake News in Social Media: Emerging Research Challenges and Opportunities (2020): 141-161. [pdf]

4. A Survey on Video-Based Fake News Detection Techniques.

   Ronak Agrawal, Dilip Kumar Sharma. 2021 8th International Conference on Computing for Sustainable Global Development (INDIACom). IEEE, 2021. [pdf]

5. A Survey of Fake News: Fundamental Theories, Detection Methods, and Opportunities.

   Xinyi Zhou, Reza Zafarani. ACM Computing Surveys (CSUR) 53.5 (2020): 1-40. [pdf]

6. Fake news detection on social media: A data mining perspective.

   Kai Shu,Amy Sliva,Suhang Wang,Jiliang Tang,Huan Liu. ACM SIGKDD Explorations Newsletter,Volume 19,Issue 1,June 2017, pp 22–36. [pdf]

This section contains the pilot works that analyze misinformation video on online platform, including the impact of video modality and the propagation feature on recommendation-dominated plaforms.

1. [PACMHCI-2020] Measuring Misinformation in Video Search Platforms: An Audit Study on YouTube.

   Eslam Hussein, Prerna Juneja, Tanushree Mitra. [pdf]

   • This audit experiments investigate whether personalization (based on age, gender, geolocation, or watch history) contributes to amplifying misinformation.

2. [PNAS-2021] The (minimal) persuasive advantage of political video over text.

   Chloe Wittenberg, Ben M. Tappin, Adam J. Berinsky, David G. Rand. [pdf]

   • This paper tests the assumption that video is more compelling than text.

3. [JCMC-2021] Seeing is believing: Is video modality more powerful in spreading fake news via online messaging apps?

   S. Shyam Sundar, Maria D. Molina , Eugene Cho. [pdf]

   • This works finds that video is processed more superficially, and therefore users believe in it more readily and share it with others.

4. [TORS-2022] Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubbles.

   Ivan Srba, Robert Moro, Matus Tomlein, Branislav Pecher, Jakub Simko, Elena Stefancova, Michal Kompan, Andrea Hrckova, Juraj Podrouzek, Adrian Gavornik, Maria Bielikova. [pdf]

   • This paper presents results of an auditing study performed over YouTube aimed at investigating how fast a user can get into a misinformation filter bubble, but also what it takes to “burst the bubble”.

5. [IJCAI-2022] Black-box Audit of YouTube's Video Recommendation: Investigation of Misinformation Filter Bubble Dynamics (Extended Abstract).

   Matus Tomlein, Branislav Pecher, Jakub Simko, Ivan Srba, Robert Moro, Elena Stefancova, Michal Kompan, Andrea Hrckova, Juraj Podrouzek, Maria Bielikova. [pdf]

   • This paper describes a black-box sockpuppeting audit which was carried out to investigate the creation and bursting dynamics of misinformation flter bubbles on YouTube.

This section contains the pilot works that detect misinformation video at signal level, i.e., detect with the clues of editing traces or generating traces.

1. [MS-2023] Fake COVID-19 videos detector based on frames and audio watermarking.

   Nesrine Tarhouni ,Salma Masmoudi, Maha Charfeddine, Chokri Ben Amar. [pdf]

   • This paper presents a fake video detector based on combining audio and frames watermarking which makes possible the detection of modifications in the two video channels and assures a fast detection of fake video.

2. [arXiv-2022] VideoFACT: Detecting Video Forgeries Using Attention, Scene Context, and Forensic Traces.

   Tai D. Nguyen, Shengbang Fang, Matthew C. Stamm. [pdf]

   • This paper designs VideoFACT to exploit forensic traces’ contextual dependencies upon scene content as well as spatial dependencies and proposes datasets that are composed not only of standard video manipulations but also advanced AI-based content manipilation techniques.

3. [TIFS-2016] ESPRIT-Hilbert-based audio tampering detection with SVM classifier for forensic analysis via electrical network frequency .

   Reis, Paulo Max Gil Innocencio , da Costa, Joao Paulo Carvalho Lustosa , Miranda, Ricardo Kehrle , Del Galdo, Giovanni. [pdf]

   • In this paper, a new technique to detect adulterations in audio recordings is proposed by exploiting abnormal variations in the electrical network frequency (ENF) signal eventually embedded in a questioned audio recording.

4. [CSUR-2021] The creation and detection of deepfakes: A survey.

   Yisroel Mirsky, Wenke Lee. [pdf]

5. [FCST-2023] Overview of Facial Deepfake Video Detection Methods.

   Zhang lu, Lu Tianliang, Du Yanhui. [pdf]

6. [DDAM-2022] Lessons Learned from ASVSpoof and Remaining Challenges.

   Junichi Yamagishi. [pdf]

7. [ICASSP-2022] Fake audio detection based on unsupervised pretraining models.

   Zhiqiang Lv, Shanshan Zhang,Kai Tang, Pengfei Hu. [pdf]

   • This work presents the authors' systems for the ADD2022 challenge, which is the first audio deep synthesis detection challenge. They explored using unsupervised pretraining models to build fake audio detection systems.

8. [ICCV-2021] Joint audio-visual deepfake detection.

   Yipin Zhou, Ser-Nam Lim. [pdf]

   • This work proposes a novel visual / auditory deepfake joint detection task and show that exploiting the intrinsic synchronization between the visual and auditory modalities could benefit deepfake detection.

9. [TCSVT-2021] Detecting compressed deepfake videos in social networks using frame-temporality two-stream convolutional network.

   Juan Hu ,XinLiao ,WeiWang, ZhengQin. [pdf]

   • The work propose a two-stream method by analyzing the frame-level and temporality-level of compressed Deepfake videos. The frame-level stream can prune the redundant connections to prevent the invalid connections from affecting the final prediction. The temporality-level stream is utilized to capture temporal features to detect the temporal consistency.

10. [arXiv-2023] Anti-Compression Contrastive Facial Forgery Detection.

    Jiajun Huang, Xinqi Zhu, Chengbin Du, Siqi Ma, Surya Nepal, Chang Xu. [pdf]

    • The authors propose a novel anti-compression forgery detection framework by maintaining closer relations within data under different compression levels.

This section contains the pilot works that utilize multimodal features to detect misinformation video at Semantic/Intent Level.

1. [MFSec-2017] Web Video Verification using Contextual Cues.

   Olga Papadopoulou, Markos Zampoglou, Symeon Papadopoulos, Yiannis Kompatsiaris. [pdf]

   • Propose an annotated dataset of real and fake videos(FVC)
   • Use video comment credibility and video metadata features for fake video detection.

2. [ICMI-2019] Towards Automatic Detection of Misinformation in Online Medical Videos.

   Rui Hou, Verónica Pérez-Rosas, Stacy Loeb, Rada Mihalcea. [pdf]

   • Explore the use of linguistic, acoustic, and user engagement features to identify misinformation.

3. [ECIR-2019] Misleading Metadata Detection on YouTube.

   Priyank Palod, Ayush Patwari, Sudhanshu Bahety, Saurabh Bagchi, Pawan Goyal. [pdf]

   • The work presents VAVD, a new dataset for research on fake videos.
   • Propose UCNet , a deep learning based approach using comments and simple features extracted from title and social context to identify fake videos.

4. [ACL Workshop-2020] NLP-based Feature Extraction for the Detection of COVID-19 Misinformation Videos on YouTube.

   Juan Carlos Medina Serrano, Orestis Papakyriakopoulos, Simon Hegelich. [pdf]

   • Create a multi-label classifier based on transfer-learning that can categorize conspiratorial content; use the percentage of conspiracy comments and the first hundred comments as tf-idf features in the classifier.

5. [arXiv-2021] Misinformation Detection on YouTube Using Video Captions.

   Raj Jagtap, Abhinav Kumar, Rahul Goel, Shakshi Sharma, Rajesh Sharma, Clint P. George. [pdf]

   • This work exploited the YouTube captions to understand the content of the videos using multiple pre-trained word embeddings.

6. [Scientific Reports-2022] A CNN-based Misleading Video Detection Model.

   Xiaojun Li, Xvhao Xiao, Jia Li, Changhua Hu, JunpingYao , Shaochen Li. [pdf]

   • In this paper, three categories of features (content features, uploader features and environment features) are proposed to construct a convolutional neural network (CNN) for misleading video detection.

7. [CIKM-2021] Using Topic Modeling and Adversarial Neural Networks for Fake News Video Detection.

   Hyewon Choi, Youngjoong Ko. [pdf]

   • The work proposes a topic agnostic fake news video detection model based on adversarial learning and topic modeling. The stance difference estimation (using Gibbs sampling-based LDA) between title/description and comments on topic modeling was used to dynamically adjust the encoding ratio of the comments.

8. [PRL-2022] Effective fake news video detection using domain knowledge and multimodal data fusion on youtube.

   Hyewon Choi, Youngjoong Ko. [pdf]

   • The framework is Similar to 6-[CIKM-2021], but remove the adversarial learning and topic modeling.This paper use domain knowledge to perform learning by reflecting the potential meaning of comments and use the linear combination to adjust the encoding rate for each characteristic of the video.

9. [BigData-2021] A Multimodal Misinformation Detector for COVID-19 Short Videos on TikTok.

   Lanyu Shang, Ziyi Kou, Yang Zhang, Dong Wang. [pdf]

   • The work develops TikTec, a multimodal misinformation detection framework that explicitly exploits the captions extracted from the audio track and the visual frame to accurately capture the key information from the distractive video content, and effectively learns the composed misinformation that is jointly conveyed by the visual and audio content.

10. [MMM-2022] Multi-modal semantic inconsistency detection in social media news posts.

    Scott McCrae, Kehan Wang, Avideh Zakhor. [pdf]

    • The work develops a multi-modal fusion framework to identify mismatches between videos and captions in social media posts by leveraging an ensemble method based on textual analysis of the caption, automatic audio transcription, semantic video analysis, object detection, named entity consistency, and facial verification.

11. [arXiv-2022] Misinformation Detection in Social Media Video Posts.

    Kehan Wang, David Chan, Seth Z. Zhao, John Canny, Avideh Zakhor. [pdf]

    • This work proposes two new methods for detecting semantic inconsistencies within short-form social media video posts, based on contrastive learning and masked language modeling.

12. [MMSP Workshop-2022] Multimodal Semantic Mismatch Detection in Social Media Posts.

    Kehan Wang, Seth Z. Zhao, David Chan, Avideh Zakhor, John Canny. [pdf]

    • This work uses language, video and audio models to extract dense features from each modality, and explore transformer architecture together with contrastive learning methods.

13. [AAAI-2023] FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platforms

    Peng Qi, Yuyan Bu, Juan Cao, Wei Ji, Ruihao Shui,Junbin Xiao, Danding Wang, Tat-Seng Chua. [pdf]

    • This paper proposes the largest Chinese short video dataset about fake news named FakeSV and provides a new multimodal baseline method SV-FEND.

14. [arXiv-2023] COVID-VTS: Fact Extraction and Verification on Short Video Platforms.

    Fuxiao Liu, Yaser Yacoob, Abhinav Shrivastava. [pdf]

    • This work introduces a new benchmark, COVIDs-VTS, for fact-checking multi-modal information, as well as proposes TwtrDetective, an effective model incorporating cross-media consistency checking to detect token-level malicious tampering in different modalities, and generate explanations.

15. [SSRN-2022]A Novel Method for Detecting Misinformation in Videos, Utilizing Reverse Image Search, Semantic Analysis, and Sentiment Comparison of Metadata.

    Dhanvi Ganti. [pdf]

    • This paper proposes a three-step method to detect video-based misinformation. First, this method detects deepfakes first and then applies semantic analysis to detect shifts in the meaning and intent of the associated metadata of both videos. The last step entails a sentiment comparison to detect shifts in emotion.

This section contains the pilot works that discuss areas related to misinformation video detection.

1. [Soft Computing-2022] Intelligent techniques for deception detection: a survey and critical study.

   Haya Alaskar, Zohra Sbaï, Wasiq Khan, Abir Hussain, Arwa Alrawais. [pdf]

2. [CICLing-2018] A deep learning approach for multimodal deception detection.

   Gangeshwar Krishnamurthy, Navonil Majumder, Soujanya Poria, Erik Cambria. [pdf]

3. [AAAI-2018] Deception Detection in Videos.

   Zhe Wu, Bharat Singh, Larry Davis, V. Subrahmanian. [PDF]

4. [Applied Intelligence-2021] A unified approach for detection of Clickbait videos on YouTube using cognitive evidences.

   Deepika Varshney, Dinesh Kumar Vishwakarma. [pdf]

5. [ICPR-2022] VidHarm: A Clip Based Dataset for Harmful Content Detection.

   Johan Edstedt, Amanda Berg, Michael Felsberg, Johan Karlsson, Francisca Benavente, Anette Novak, Gustav Grund Pihlgren. [pdf]

This section contains the pilot works that related to critical open issues and future directions for misinformation video detection.

1. [ICWSM-2022] Cross-Platform Multimodal Misinformation: Taxonomy, Characteristics and Detection for Textual Posts and Videos.

   Nicholas Micallef, Marcelo Sandoval-Castañeda, Adi Cohen, Mustaque Ahamad, Srijan Kumar, Nasir Memon. [pdf]

2. [SIGIR-2022] Generalizing to the future: Mitigating entity bias in fake news detection.

   Yongchun Zhu, Qiang Sheng, Juan Cao, Shuokai Li, Danding Wang, Fuzhen Zhuang. [pdf]

3. [AAAI-2021] Embracing domain differences in fake news: Cross-domain fake news detection using multi-modal data.

   Amila Silva, Ling Luo, Shanika Karunasekera, Christopher Leckie. [PDF]

4. [CIKM-2021] MDFEND: Multidomain fake news detection.

   Qiong Nan, Juan Cao, Yongchun Zhu, Yanyan Wang,Jintao Li. [pdf]

5. [TKDE-2022] Memory-guided multi-view multi-domain fake news detection.

   Yongchun Zhu, Qiang Sheng, Juan Cao, Qiong Nan, Kai Shu, Minghui Wu, Jindong Wang, Fuzhen Zhuang. [pdf]

6. [IP&M-2022] Characterizing multi-domain false news and underlying user effects on Chinese Weibo.

   Qiang Sheng, Juan Cao, H. Russell Bernard, Kai Shu, Jintao Li, Huan Liu. [pdf]

7. [NAACL-2018] Fever: a large-scale dataset for fact extraction and verification .

   James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Arpit Mittal [pdf]

8. [CVPR-2022] Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resources.

   Sahar Abdelnabi, Rakibul Hasan, Mario Fritz. [pdf]

9. [CVPR-2020] Multi-modal graph neural network for joint reasoning on vision and scene text.

   Difei Gao, Ke Li, Ruiping Wang, Shiguang Shan, Xilin Chen. [pdf]

10. [NIPS-2022] Chain-of-Thought Prompting Elicits Reasoning in Large Language Models.

    Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, Denny Zhou [pdf]

11. [WWW-2022]Veracity-aware and Event-driven Personalized News Recommendation for Fake News Mitigation.

    Shoujin Wang, Xiaofei Xu, Xiuzhen Zhang, Yan Wang, Wenzhuo Song. [pdf]

12. [AAAI-2020] Weak Supervision for Fake News Detection via Reinforcement Learning.

    Yaqing Wang, Weifeng Yang, Fenglong Ma, Jin Xu, Bin Zhong, Qiang Deng, Jing Gao. [pdf]

DeepFake Detector : WeVerify Project ; Sensity

Reverse Image Search : Google ; Baidu ; Bing ; Yandex

Video Verification Plugin : InVID Verification Plugin

This curated list of works on misinformation video detection is based on our survey. If you find it helpful, please cite as follows:

@article{mvdsurvey,
  title={Online Misinformation Video Detection: A Survey},
  author={Bu, Yuyan and Sheng, Qiang and Cao, Juan and Qi, Peng and Wang, Danding and Li, Jintao},
  journal={arXiv preprint arXiv:2302.03242},
  year={2023}
}