We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.

DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos / Boccignone, Giuseppe; Bursic, Sathya; Cuculo, Vittorio; D’Amelio, Alessandro; Grossi, Giuliano; Lanzarotti, Raffaella; Patania, Sabrina. - 13232:(2022), pp. 186-195. (Intervento presentato al convegno 21st International Conference on Image Analysis and Processing, ICIAP 2022 tenutosi a Lecce nel 2022) [10.1007/978-3-031-06430-2_16].

DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos

Vittorio Cuculo;
2022

Abstract

We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.
2022
21st International Conference on Image Analysis and Processing, ICIAP 2022
Lecce
2022
13232
186
195
Boccignone, Giuseppe; Bursic, Sathya; Cuculo, Vittorio; D’Amelio, Alessandro; Grossi, Giuliano; Lanzarotti, Raffaella; Patania, Sabrina
DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos / Boccignone, Giuseppe; Bursic, Sathya; Cuculo, Vittorio; D’Amelio, Alessandro; Grossi, Giuliano; Lanzarotti, Raffaella; Patania, Sabrina. - 13232:(2022), pp. 186-195. (Intervento presentato al convegno 21st International Conference on Image Analysis and Processing, ICIAP 2022 tenutosi a Lecce nel 2022) [10.1007/978-3-031-06430-2_16].
File in questo prodotto:
File Dimensione Formato  
Boccignone2022_Chapter_DeepFakesHaveNoHeartASimpleRPP.pdf

Accesso riservato

Dimensione 681.68 kB
Formato Adobe PDF
681.68 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1300654
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? 5
social impact