Dietary Assessment with Multimodal ChatGPT: A Systematic Analysis

no code implementations • 14 Dec 2023 • Frank P. -W. Lo, Jianing Qiu, Zeyu Wang, Junhong Chen, Bo Xiao, Wu Yuan, Stamatia Giannarou, Gary Frost, Benny Lo

Although artificial intelligence (AI)-based solutions have been devised to automate the dietary assessment process, these prior AI methodologies encounter challenges in their ability to generalize across a diverse range of food types, dietary behaviors, and cultural contexts.

Image Captioning Scene Understanding

Clustering Egocentric Images in Passive Dietary Monitoring with Self-Supervised Learning

no code implementations • 25 Aug 2022 • Jiachuan Peng, Peilun Shi, Jianing Qiu, Xinwei Ju, Frank P. -W. Lo, Xiao Gu, Wenyan Jia, Tom Baranowski, Matilda Steiner-Asiedu, Alex K. Anderson, Megan A McCrory, Edward Sazonov, Mingui Sun, Gary Frost, Benny Lo

By clustering images into separate events, annotators and dietitians can examine and analyze the data more efficiently and facilitate the subsequent dietary assessment processes.

Clustering Self-Supervised Learning

Egocentric Image Captioning for Privacy-Preserved Passive Dietary Intake Monitoring

no code implementations • 1 Jul 2021 • Jianing Qiu, Frank P. -W. Lo, Xiao Gu, Modou L. Jobarteh, Wenyan Jia, Tom Baranowski, Matilda Steiner-Asiedu, Alex K. Anderson, Megan A McCrory, Edward Sazonov, Mingui Sun, Gary Frost, Benny Lo

In this paper, we propose a privacy-preserved secure solution (i. e., egocentric image captioning) for dietary assessment with passive monitoring, which unifies food recognition, volume estimation, and scene understanding.

Food Recognition Image Captioning +1

An Intelligent Passive Food Intake Assessment System with Egocentric Cameras

no code implementations • 7 May 2021 • Frank Po Wen Lo, Modou L Jobarteh, Yingnan Sun, Jianing Qiu, Shuo Jiang, Gary Frost, Benny Lo

Malnutrition is a major public health concern in low-and-middle-income countries (LMICs).

Semantic Segmentation