In this work we present a novel method to plan the next best view of a depth camera by leveraging on a Convolutional Neural Network (CNN), and on a probabilistic occupancy map of the environment for ray casting operations. In particular, a hybrid approach is introduced that exploits the convolutional encoder-decoder to perform object completion, and an algorithm based on ray casting to evaluate the information gain of possible sensor view poses. Automatic object completion consists of inferring the occupancy probability of the regions of space that have not been observed. A comparison against several methods, including City-CNN, was carried out in 2D and 3D environments on publicly available datasets. In particular, to enable comparison, the original City-CNN algorithm was modified to work with depth cameras. Experiments indicate that the proposed method achieves the best results in terms of exploration accuracy. Results on a real robot are also presented.

A probabilistic next best view planner for depth cameras based on deep learning / Monica, R.; Aleotti, J.. - In: IEEE ROBOTICS AND AUTOMATION LETTERS. - ISSN 2377-3766. - 6:2(2021), pp. 9372797.3529-9372797.3536. [10.1109/LRA.2021.3064298]

A probabilistic next best view planner for depth cameras based on deep learning

Monica R.;Aleotti J.
2021-01-01

Abstract

In this work we present a novel method to plan the next best view of a depth camera by leveraging on a Convolutional Neural Network (CNN), and on a probabilistic occupancy map of the environment for ray casting operations. In particular, a hybrid approach is introduced that exploits the convolutional encoder-decoder to perform object completion, and an algorithm based on ray casting to evaluate the information gain of possible sensor view poses. Automatic object completion consists of inferring the occupancy probability of the regions of space that have not been observed. A comparison against several methods, including City-CNN, was carried out in 2D and 3D environments on publicly available datasets. In particular, to enable comparison, the original City-CNN algorithm was modified to work with depth cameras. Experiments indicate that the proposed method achieves the best results in terms of exploration accuracy. Results on a real robot are also presented.
2021
A probabilistic next best view planner for depth cameras based on deep learning / Monica, R.; Aleotti, J.. - In: IEEE ROBOTICS AND AUTOMATION LETTERS. - ISSN 2377-3766. - 6:2(2021), pp. 9372797.3529-9372797.3536. [10.1109/LRA.2021.3064298]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11381/2891661
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 12
  • ???jsp.display-item.citation.isi??? 11
social impact