Event cameras, neuromorphic devices that naturally respond to brightness changes, have multiple advantages with respect to traditional cameras. However, the difficulty of applying traditional computer vision algorithms on event data limits their usability. Therefore, in this paper we investigate the use of a deep learning-based architecture that combines an initial grayscale frame and a series of event data to estimate the following intensity frames. In particular, a fully-convolutional encoder-decoder network is employed and evaluated for the frame synthesis task on an automotive event-based dataset. Performance obtained with pixel-wise metrics confirms the quality of the images synthesized by the proposed architecture.

Video synthesis from Intensity and Event Frames / Pini, Stefano; Borghi, Guido; Vezzani, Roberto; Cucchiara, Rita. - (2019). (Intervento presentato al convegno 20th International Conference on Image Analysis and Processing tenutosi a Trento, Italy nel 9-13 September 2019) [10.1007/978-3-030-30642-7_28].

Video synthesis from Intensity and Event Frames

Stefano Pini;Guido Borghi;Roberto Vezzani;Rita Cucchiara
2019

Abstract

Event cameras, neuromorphic devices that naturally respond to brightness changes, have multiple advantages with respect to traditional cameras. However, the difficulty of applying traditional computer vision algorithms on event data limits their usability. Therefore, in this paper we investigate the use of a deep learning-based architecture that combines an initial grayscale frame and a series of event data to estimate the following intensity frames. In particular, a fully-convolutional encoder-decoder network is employed and evaluated for the frame synthesis task on an automotive event-based dataset. Performance obtained with pixel-wise metrics confirms the quality of the images synthesized by the proposed architecture.
2019
20th International Conference on Image Analysis and Processing
Trento, Italy
9-13 September 2019
Pini, Stefano; Borghi, Guido; Vezzani, Roberto; Cucchiara, Rita
Video synthesis from Intensity and Event Frames / Pini, Stefano; Borghi, Guido; Vezzani, Roberto; Cucchiara, Rita. - (2019). (Intervento presentato al convegno 20th International Conference on Image Analysis and Processing tenutosi a Trento, Italy nel 9-13 September 2019) [10.1007/978-3-030-30642-7_28].
File in questo prodotto:
File Dimensione Formato  
ICIAP19_Event_Cameras.pdf

Open access

Tipologia: Versione originale dell'autore proposta per la pubblicazione
Dimensione 975.6 kB
Formato Adobe PDF
975.6 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1178955
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 9
  • ???jsp.display-item.citation.isi??? 10
social impact