I2N: image to nutrients, a sensor guided semi-automated tool for annotation of images for nutrition analysis of eating episodes
- PMID: 37575335
- PMCID: PMC10415029
- DOI: 10.3389/fnut.2023.1191962
I2N: image to nutrients, a sensor guided semi-automated tool for annotation of images for nutrition analysis of eating episodes
Abstract
Introduction: Dietary assessment is important for understanding nutritional status. Traditional methods of monitoring food intake through self-report such as diet diaries, 24-hour dietary recall, and food frequency questionnaires may be subject to errors and can be time-consuming for the user.
Methods: This paper presents a semi-automatic dietary assessment tool we developed - a desktop application called Image to Nutrients (I2N) - to process sensor-detected eating events and images captured during these eating events by a wearable sensor. I2N has the capacity to offer multiple food and nutrient databases (e.g., USDA-SR, FNDDS, USDA Global Branded Food Products Database) for annotating eating episodes and food items. I2N estimates energy intake, nutritional content, and the amount consumed. The components of I2N are three-fold: 1) sensor-guided image review, 2) annotation of food images for nutritional analysis, and 3) access to multiple food databases. Two studies were used to evaluate the feasibility and usefulness of I2N: 1) a US-based study with 30 participants and a total of 60 days of data and 2) a Ghana-based study with 41 participants and a total of 41 days of data).
Results: In both studies, a total of 314 eating episodes were annotated using at least three food databases. Using I2N's sensor-guided image review, the number of images that needed to be reviewed was reduced by 93% and 85% for the two studies, respectively, compared to reviewing all the images.
Discussion: I2N is a unique tool that allows for simultaneous viewing of food images, sensor-guided image review, and access to multiple databases in one tool, making nutritional analysis of food images efficient. The tool is flexible, allowing for nutritional analysis of images if sensor signals aren't available.
Keywords: food intake; image annotation; image to nutrients; software; wearable sensor.
Copyright © 2023 Ghosh, McCrory, Marden, Higgins, Anderson, Domfe, Jia, Lo, Frost, Steiner-Asiedu, Baranowski, Sun and Sazonov.
Conflict of interest statement
MM serves on the Avocado Nutrition Science Advisory for the Hass Avocado Board. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Figures
Similar articles
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
Review of the validity and feasibility of image-assisted methods for dietary assessment.Int J Obes (Lond). 2020 Dec;44(12):2358-2371. doi: 10.1038/s41366-020-00693-2. Epub 2020 Oct 8. Int J Obes (Lond). 2020. PMID: 33033394 Free PMC article. Review.
-
Validity and Usability of a Smartphone Image-Based Dietary Assessment App Compared to 3-Day Food Diaries in Assessing Dietary Intake Among Canadian Adults: Randomized Controlled Trial.JMIR Mhealth Uhealth. 2020 Sep 9;8(9):e16953. doi: 10.2196/16953. JMIR Mhealth Uhealth. 2020. PMID: 32902389 Free PMC article. Clinical Trial.
-
"Automatic Ingestion Monitor Version 2" - A Novel Wearable Device for Automatic Food Intake Detection and Passive Capture of Food Images.IEEE J Biomed Health Inform. 2021 Feb;25(2):568-576. doi: 10.1109/JBHI.2020.2995473. Epub 2021 Feb 5. IEEE J Biomed Health Inform. 2021. PMID: 32750904 Free PMC article.
-
Image-assisted dietary assessment: a systematic review of the evidence.J Acad Nutr Diet. 2015 Jan;115(1):64-77. doi: 10.1016/j.jand.2014.09.015. Epub 2014 Nov 11. J Acad Nutr Diet. 2015. PMID: 25441955 Review.
References
-
- Obesity . (2021). Available at: https://www.who.int/news-room/facts-in-pictures/detail/6-facts-on-obesity
-
- Johansson G, Wikman Å, Åhrén AM, Hallmans G, Johansson I. Underreporting of energy intake in repeated 24-hour recalls related to gender, age, weight status, day of interview, educational level, reported food intake, smoking habits and area of living. Public Health Nutr. (2001) 4:919–27. doi: 10.1079/PHN2001124 - DOI - PubMed
LinkOut - more resources
Full Text Sources
Research Materials