The photorealistic acquisition of 3D objects often requires color information from digital photography to be mapped on the acquired geometry, in order to obtain a textured 3D model. This paper presents a novel fully automatic 2D/3D global registration pipeline consisting of several stages that simultaneously register the input image set on the corresponding 3D object. The first stage exploits Structure From Motion (SFM) on the image set in order to generate a sparse point cloud. During the second stage, this point cloud is aligned to the 3D object using an extension of the 4 Point Congruent Set (4PCS) algorithm for the alignment of range maps. The extension accounts for models with different scales and unknown regions of overlap. In the last processing stage a global refinement algorithm based on mutual information optimizes the color projection of the aligned photos on the 3D object, in order to obtain high quality textures. The proposed registration pipeline is general, capable of dealing with small and big objects of any shape, and robust. We present results from six real cases, evaluating the quality of the final colors mapped onto the 3D object. A comparison with a ground truth dataset is also presented.

Fully Automatic Registration of Image Sets on Approximate Geometry / Corsini, M; Dellepiane, Matteo; Ganovelli, Fabio; Gherardi, Riccardo; Fusiello, Andrea; Scopigno, Roberto. - In: INTERNATIONAL JOURNAL OF COMPUTER VISION. - ISSN 0920-5691. - ELETTRONICO. - 102:1-3(2013), pp. 91-111. [10.1007/s11263-012-0552-5]

Fully Automatic Registration of Image Sets on Approximate Geometry

Corsini M;
2013

Abstract

The photorealistic acquisition of 3D objects often requires color information from digital photography to be mapped on the acquired geometry, in order to obtain a textured 3D model. This paper presents a novel fully automatic 2D/3D global registration pipeline consisting of several stages that simultaneously register the input image set on the corresponding 3D object. The first stage exploits Structure From Motion (SFM) on the image set in order to generate a sparse point cloud. During the second stage, this point cloud is aligned to the 3D object using an extension of the 4 Point Congruent Set (4PCS) algorithm for the alignment of range maps. The extension accounts for models with different scales and unknown regions of overlap. In the last processing stage a global refinement algorithm based on mutual information optimizes the color projection of the aligned photos on the 3D object, in order to obtain high quality textures. The proposed registration pipeline is general, capable of dealing with small and big objects of any shape, and robust. We present results from six real cases, evaluating the quality of the final colors mapped onto the 3D object. A comparison with a ground truth dataset is also presented.
10-ago-2012
102
1-3
91
111
Fully Automatic Registration of Image Sets on Approximate Geometry / Corsini, M; Dellepiane, Matteo; Ganovelli, Fabio; Gherardi, Riccardo; Fusiello, Andrea; Scopigno, Roberto. - In: INTERNATIONAL JOURNAL OF COMPUTER VISION. - ISSN 0920-5691. - ELETTRONICO. - 102:1-3(2013), pp. 91-111. [10.1007/s11263-012-0552-5]
Corsini, M; Dellepiane, Matteo; Ganovelli, Fabio; Gherardi, Riccardo; Fusiello, Andrea; Scopigno, Roberto
File in questo prodotto:
File Dimensione Formato  
IJCV2012_globalregistration_onlinefirst.pdf

non disponibili

Dimensione 3.58 MB
Formato Adobe PDF
3.58 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1170195
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 64
  • ???jsp.display-item.citation.isi??? 57
social impact