Generating dense point clouds from sparse raw data benefits downstream 3D understanding tasks, but existing models are limited to a fixed upsampling ratio or to a short range of integer values. In this paper, we present APU-SMOG, a Transformer-based model for Arbitrary Point cloud Upsampling (APU). The sparse input is firstly mapped to a Spherical Mixture of Gaussians (SMOG) distribution, from which an arbitrary number of points can be sampled. Then, these samples are fed as queries to the Transformer decoder, which maps them back to the target surface. Extensive qualitative and quantitative evaluations show that APU-SMOG outperforms state-of-the-art fixed-ratio methods, while effectively enabling upsampling with any scaling factor, including non-integer values, with a single trained model. The code will be made available.

Arbitrary Point Cloud Upsampling with Spherical Mixture of Gaussians / Dell'Eva, Anthony; Orsingher, Marco; Bertozzi, Massimo. - (2022), pp. 465-474. (Intervento presentato al convegno IEEE International Conference on 3D Vision (3DV)) [10.1109/3DV57658.2022.00058].

Arbitrary Point Cloud Upsampling with Spherical Mixture of Gaussians

Dell'Eva, Anthony
;
Orsingher, Marco;Bertozzi, Massimo
2022-01-01

Abstract

Generating dense point clouds from sparse raw data benefits downstream 3D understanding tasks, but existing models are limited to a fixed upsampling ratio or to a short range of integer values. In this paper, we present APU-SMOG, a Transformer-based model for Arbitrary Point cloud Upsampling (APU). The sparse input is firstly mapped to a Spherical Mixture of Gaussians (SMOG) distribution, from which an arbitrary number of points can be sampled. Then, these samples are fed as queries to the Transformer decoder, which maps them back to the target surface. Extensive qualitative and quantitative evaluations show that APU-SMOG outperforms state-of-the-art fixed-ratio methods, while effectively enabling upsampling with any scaling factor, including non-integer values, with a single trained model. The code will be made available.
2022
978-1-6654-5670-8
Arbitrary Point Cloud Upsampling with Spherical Mixture of Gaussians / Dell'Eva, Anthony; Orsingher, Marco; Bertozzi, Massimo. - (2022), pp. 465-474. (Intervento presentato al convegno IEEE International Conference on 3D Vision (3DV)) [10.1109/3DV57658.2022.00058].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11381/2939991
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
social impact