We present a generalization of the person-image generation task, in which a human image is generated conditioned on a target pose and a set X of source appearance images. In this way, we can exploit multiple, possibly complementary images of the same person which are usually available at training and at testing time. The solution we propose is mainly based on a local attention mechanism which selects relevant information from different source image regions, avoiding the necessity to build specific generators for each specific cardinality of X. The empirical evaluation of our method shows the practical interest of addressing the person-image generation problem in a multi-source setting.

Attention-based Fusion for Multi-source Human Image Generation / Lathuiliere, Stephane; Sangineto, Enver; Siarohin, Aliaksandr; Sebe, Nicu. - (2020), pp. 428-437. (Intervento presentato al convegno WACV 2020 tenutosi a Snowmass Village; United States nel 1-5 March 2020) [10.1109/WACV45572.2020.9093602].

Attention-based Fusion for Multi-source Human Image Generation

Sangineto, Enver;Sebe, Nicu
2020

Abstract

We present a generalization of the person-image generation task, in which a human image is generated conditioned on a target pose and a set X of source appearance images. In this way, we can exploit multiple, possibly complementary images of the same person which are usually available at training and at testing time. The solution we propose is mainly based on a local attention mechanism which selects relevant information from different source image regions, avoiding the necessity to build specific generators for each specific cardinality of X. The empirical evaluation of our method shows the practical interest of addressing the person-image generation problem in a multi-source setting.
2020
WACV 2020
Snowmass Village; United States
1-5 March 2020
428
437
Lathuiliere, Stephane; Sangineto, Enver; Siarohin, Aliaksandr; Sebe, Nicu
Attention-based Fusion for Multi-source Human Image Generation / Lathuiliere, Stephane; Sangineto, Enver; Siarohin, Aliaksandr; Sebe, Nicu. - (2020), pp. 428-437. (Intervento presentato al convegno WACV 2020 tenutosi a Snowmass Village; United States nel 1-5 March 2020) [10.1109/WACV45572.2020.9093602].
File in questo prodotto:
File Dimensione Formato  
Lathuiliere_Attention-based_Fusion_for_Multi-source_Human_Image_Generation_WACV_2020_paper.pdf

Accesso riservato

Dimensione 601.93 kB
Formato Adobe PDF
601.93 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1264512
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 12
  • ???jsp.display-item.citation.isi??? 9
social impact