A balanced diet is the key to a healthy lifestyle and is crucial for preventing or dealing with many chronic diseases such as diabetes and obesity. Therefore, monitoring diet can be an effective way of improving people's health. However, manual reporting of food intake has been shown to be inaccurate and often impractical. This paper presents a new approach to food intake quantity estimation using image-based modeling. The modeling method consists of three steps: firstly, a short video of the food is taken by the user's smartphone. From such a video, six frames are selected based on the pictures' viewpoints as determined by the smartphone's orientation sensors. Secondly, the user marks one of the frames to seed an interactive segmentation algorithm. Segmentation is based on a Gaussian Mixture Model alongside the graph-cut algorithm. Finally, a customized image-based modeling algorithm generates a point-cloud to model the food. At the same time, a stochastic object-detection method locates a checkerboard used as size/ground reference. The modeling algorithm is optimized such that the use of six input images still results in an acceptable computation cost. In our evaluation procedure, we achieved an average accuracy of 92%on a test set that includes images of different kinds of pasta and bread, with an average processing time of about 23 s.

A new approach to image-based estimation of food volume / Hassannejad, Hamid; Matrella, Guido; Ciampolini, Paolo; DE MUNARI, Ilaria; Mordonini, Monica; Cagnoni, Stefano. - In: ALGORITHMS. - ISSN 1999-4893. - 10:2(2017), pp. 1-14. [10.3390/a10020066]

A new approach to image-based estimation of food volume

HASSANNEJAD, Hamid;MATRELLA, Guido;CIAMPOLINI, Paolo;DE MUNARI, Ilaria;MORDONINI, Monica;CAGNONI, Stefano
2017-01-01

Abstract

A balanced diet is the key to a healthy lifestyle and is crucial for preventing or dealing with many chronic diseases such as diabetes and obesity. Therefore, monitoring diet can be an effective way of improving people's health. However, manual reporting of food intake has been shown to be inaccurate and often impractical. This paper presents a new approach to food intake quantity estimation using image-based modeling. The modeling method consists of three steps: firstly, a short video of the food is taken by the user's smartphone. From such a video, six frames are selected based on the pictures' viewpoints as determined by the smartphone's orientation sensors. Secondly, the user marks one of the frames to seed an interactive segmentation algorithm. Segmentation is based on a Gaussian Mixture Model alongside the graph-cut algorithm. Finally, a customized image-based modeling algorithm generates a point-cloud to model the food. At the same time, a stochastic object-detection method locates a checkerboard used as size/ground reference. The modeling algorithm is optimized such that the use of six input images still results in an acceptable computation cost. In our evaluation procedure, we achieved an average accuracy of 92%on a test set that includes images of different kinds of pasta and bread, with an average processing time of about 23 s.
2017
A new approach to image-based estimation of food volume / Hassannejad, Hamid; Matrella, Guido; Ciampolini, Paolo; DE MUNARI, Ilaria; Mordonini, Monica; Cagnoni, Stefano. - In: ALGORITHMS. - ISSN 1999-4893. - 10:2(2017), pp. 1-14. [10.3390/a10020066]
File in questo prodotto:
File Dimensione Formato  
Hassannejad_Algorithms17.pdf

accesso aperto

Descrizione: Hassannejad_Algorithms17
Tipologia: Versione (PDF) editoriale
Licenza: Creative commons
Dimensione 8.46 MB
Formato Adobe PDF
8.46 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11381/2828032
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 25
  • ???jsp.display-item.citation.isi??? 21
social impact