A feasibility study to assess Mediterranean Diet adherence using an AI-powered system.

Mediterranean diet (MD) can play a major role in decreasing the risks of non-communicable diseases and preventing overweight and obesity. In order for a person to follow the MD and assess their adherence to it, proper dietary assessment methods are required. We have developed an Artificial Intelligence-powered system that recognizes the food and drink items from a single meal photo and estimates their respective serving size, and integrated it into a smartphone application that automatically calculates MD adherence score and outputs a weekly feedback report. We compared the MD adherence score of four users as calculated by the system versus an expert dietitian, and the mean difference was 3.5% and statistically not significant. Afterwards, we conducted a feasibility study with 24 participants, to evaluate the system's performance and to gather the users' and dietitians' feedback. The image recognition system achieved 61.8% mean Average Precision for the testing set and 57.3% for the feasibility study images (where the ground truth was taken as the participants' annotations). The feedback from the participants of the feasibility study was also very positive.

Evaluation of a Novel Artificial Intelligence System to Monitor and Assess Energy and Macronutrient Intake in Hospitalised Older Patients.

Malnutrition is common, especially among older, hospitalised patients, and is associated with higher mortality, longer hospitalisation stays, infections, and loss of muscle mass. It is therefore of utmost importance to employ a proper method for dietary assessment that can be used for the identification and management of malnourished hospitalised patients. In this study, we propose an automated Artificial Intelligence (AI)-based system that receives input images of the meals before and after their consumption and is able to estimate the patient's energy, carbohydrate, protein, fat, and fatty acids intake. The system jointly segments the images into the different food components and plate types, estimates the volume of each component before and after consumption, and calculates the energy and macronutrient intake for every meal, based on the kitchen's menu database. Data acquired from an acute geriatric hospital as well as from our previous study were used for the fine-tuning and evaluation of the system. The results from both our system and the hospital's standard procedure were compared to the estimations of experts. Agreement was better with the system, suggesting that it has the potential to replace standard clinical procedures with a positive impact on time spent directly with the patients.

Perspectives and Preferences of Adult Smartphone Users Regarding Nutrition and Diet Apps: Web-Based Survey Study.

BACKGROUND: Digital technologies have evolved dramatically in recent years, finding applications in a variety of aspects of everyday life. Smartphones and mobile apps are being used for a steadily increasing number of tasks, including health monitoring. A large number of nutrition and diet apps are available, and some of them are very popular in terms of user downloads, highlighting a trend toward diet monitoring and assessment. OBJECTIVE: We sought to explore the perspectives of end users on the features, current use, and acceptance of nutrition and diet mHealth apps with a survey. We expect that this study can provide user insights to assist researchers and developers in achieving innovative dietary assessments. METHODS: A multidisciplinary team designed and compiled the survey. Before its release, it was pilot-tested by 18 end users. A 19-question survey was finally developed and was translated into six languages: English, German, French, Spanish, Italian, and Greek. The participants were mainly recruited via social media platforms and mailing lists of universities, university hospitals, and patient associations. RESULTS: A total of 2382 respondents (1891 female, 79.4%; 474 male, 19.9%; and 17 neither, 0.7%) with a mean age of 27.2 years (SD 8.5) completed the survey. Approximately half of the participants (1227/2382, 51.5%) had used a nutrition and diet app. The primary criteria for selecting such an app were ease of use (1570/2382, 65.9%), free cost (1413/2382, 59.3%), and ability to produce automatic readings of caloric content (1231/2382, 51.7%) and macronutrient content (1117/2382, 46.9%) (ie, food type and portion size are estimated by the system without any contribution from the user). An app was less likely to be selected if it incorrectly estimated portion size, calories, or nutrient content (798/2382, 33.5%). Other important limitations included the use of a database that does not include local foods (655/2382, 27.5%) or that may omit major foods (977/2382, 41%). CONCLUSIONS: This comprehensive study in a mostly European population assessed the preferences and perspectives of potential nutrition and diet app users. Understanding user needs will benefit researchers who develop tools for innovative dietary assessment as well as those who assist research on behavioral changes related to nutrition.

The Human Factor in Automated Image-Based Nutrition Apps: Analysis of Common Mistakes Using the goFOOD Lite App.

BACKGROUND: Technological advancements have enabled nutrient estimation by smartphone apps such as goFOOD. This is an artificial intelligence-based smartphone system, which uses food images or video captured by the user as input and then translates these into estimates of nutrient content. The quality of the data is highly dependent on the images the user records. This can lead to a major loss of data and impaired quality. Instead of removing these data from the study, in-depth analysis is needed to explore common mistakes and to use them for further improvement of automated apps for nutrition assessment. OBJECTIVE: The aim of this study is to analyze common mistakes made by participants using the goFOOD Lite app, a version of goFOOD, which was designed for food-logging, but without providing results to the users, to improve both the instructions provided and the automated functionalities of the app. METHODS: The 48 study participants were given face-to-face instructions for goFOOD Lite and were asked to record 2 pictures (1 recording) before and 2 pictures (1 recording) after the daily consumption of each food or beverage, using a reference card as a fiducial marker. All pictures that were discarded for processing due to mistakes were analyzed to record the main mistakes made by users. RESULTS: Of the 468 recordings of nonpackaged food items captured by the app, 60 (12.8%) had to be discarded due to errors in the capturing procedure. The principal problems were as follows: wrong fiducial marker or improper marker use (19 recordings), plate issues such as a noncompatible or nonvisible plate (8 recordings), a combination of various issues (17 recordings), and other reasons such as obstacles (hand) in front of the camera or matching recording pairs (16 recordings). CONCLUSIONS: No other study has focused on the principal problems in the use of automatic apps for assessing nutritional intake. This study shows that it is important to provide study participants with detailed instructions if high-quality data are to be obtained. Future developments could focus on making it easier to recognize food on various plates from its color or shape and on exploring alternatives to using fiducial markers. It is also essential for future studies to understand the training needed by the participants as well as to enhance the app's user-friendliness and to develop automatic image checks based on participant feedback.

Assessing Mediterranean Diet Adherence with the Smartphone: The Medipiatto Project.

The Mediterranean diet (MD) is regarded as a healthy eating pattern with beneficial effects both for the decrease of the risk for non-communicable diseases and also for body weight reduction. In the current manuscript, we propose an automated smartphone application which monitors and evaluates the user's adherence to MD using images of the food and drinks that they consume. We define a set of rules for automatic adherence estimation, which focuses on the main MD food groups. We use a combination of a convolutional neural network (CNN) and a graph convolutional network to detect the types of foods and quantities from the users' food images and the defined set of rules to evaluate the adherence to MD. Our experiments show that our system outperforms a basic CNN in terms of recognizing food items and estimating quantity and yields comparable results as experienced dietitians when it comes to overall MD adherence estimation. As the system is novel, these results are promising; however, there is room for improvement of the accuracy by gathering and training with more data and certain refinements can be performed such as re-defining the set of rules to also be able to be used for sub-groups of MD (e.g., vegetarian type of MD).

goFOODTM: An Artificial Intelligence System for Dietary Assessment.

Accurate estimation of nutritional information may lead to healthier diets and better clinical outcomes. We propose a dietary assessment system based on artificial intelligence (AI), named goFOODTM. The system can estimate the calorie and macronutrient content of a meal, on the sole basis of food images captured by a smartphone. goFOODTM requires an input of two meal images or a short video. For conventional single-camera smartphones, the images must be captured from two different viewing angles; smartphones equipped with two rear cameras require only a single press of the shutter button. The deep neural networks are used to process the two images and implements food detection, segmentation and recognition, while a 3D reconstruction algorithm estimates the food's volume. Each meal's calorie and macronutrient content is calculated from the food category, volume and the nutrient database. goFOODTM supports 319 fine-grained food categories, and has been validated on two multimedia databases that contain non-standardized and fast food meals. The experimental results demonstrate that goFOODTM performed better than experienced dietitians on the non-standardized meal database, and was comparable to them on the fast food database. goFOODTM provides a simple and efficient solution to the end-user for dietary assessment.

What Healthcare Professionals Think of "Nutrition & Diet" Apps: An International Survey.

Accurate dietary assessment is crucial for both the prevention and treatment of nutrition-related diseases. Since mobile-based dietary assessment solutions are promising, we sought to examine the acceptability of "Nutrition and Diet" (ND) apps by Healthcare Professionals (HCP), explore their preferences on apps' features and identify predictors of acceptance. A 23 question survey was developed by an interdisciplinary team and pilot-tested. The survey was completed by 1001 HCP from 73 countries and 6 continents. The HCP (dietitians: 833, doctors: 75, nurses: 62, other: 31/females: 847, males: 150, neither: 4) had a mean age (SD) of 34.4 (10.2) years and mean job experience in years (SD): 7.7 (8.2). There were 45.5% who have recommended ND apps to their clients/patients. Of those who have not yet recommended an app, 22.5% do not know of their existence. Important criteria for selecting an app were ease of use (87.1%), apps being free of charge (72.6%) and validated (69%). Significant barriers were the use of inaccurate food composition database (52%), lack of local food composition database support (48.2%) and tech-savviness (43.3%). Although the adoption of smartphones is growing and mobile health research is advancing, there is room for improvement in the recommendation of ND apps by HCP.

Meta-analysis of the radiological and clinical features of Usual Interstitial Pneumonia (UIP) and Nonspecific Interstitial Pneumonia (NSIP).

PURPOSE: To conduct a meta-analysis to determine specific computed tomography (CT) patterns and clinical features that discriminate between nonspecific interstitial pneumonia (NSIP) and usual interstitial pneumonia (UIP). MATERIALS AND METHODS: The PubMed/Medline and Embase databases were searched for studies describing the radiological patterns of UIP and NSIP in chest CT images. Only studies involving histologically confirmed diagnoses and a consensus diagnosis by an interstitial lung disease (ILD) board were included in this analysis. The radiological patterns and patient demographics were extracted from suitable articles. We used random-effects meta-analysis by DerSimonian & Laird and calculated pooled odds ratios for binary data and pooled mean differences for continuous data. RESULTS: Of the 794 search results, 33 articles describing 2,318 patients met the inclusion criteria. Twelve of these studies included both NSIP (338 patients) and UIP (447 patients). NSIP-patients were significantly younger (NSIP: median age 54.8 years, UIP: 59.7 years; mean difference (MD) -4.4; p = 0.001; 95% CI: -6.97 to -1.77), less often male (NSIP: median 52.8%, UIP: 73.6%; pooled odds ratio (OR) 0.32; p<0.001; 95% CI: 0.17 to 0.60), and less often smokers (NSIP: median 55.1%, UIP: 73.9%; OR 0.42; p = 0.005; 95% CI: 0.23 to 0.77) than patients with UIP. The CT findings from patients with NSIP revealed significantly lower levels of the honeycombing pattern (NSIP: median 28.9%, UIP: 73.4%; OR 0.07; p<0.001; 95% CI: 0.02 to 0.30) with less peripheral predominance (NSIP: median 41.8%, UIP: 83.3%; OR 0.21; p<0.001; 95% CI: 0.11 to 0.38) and more subpleural sparing (NSIP: median 40.7%, UIP: 4.3%; OR 16.3; p = 0.005; 95% CI: 2.28 to 117). CONCLUSION: Honeycombing with a peripheral predominance was significantly associated with a diagnosis of UIP. The NSIP pattern showed more subpleural sparing. The UIP pattern was predominantly observed in elderly males with a history of smoking, whereas NSIP occurred in a younger patient population.

Computer-Aided Diagnosis of Pulmonary Fibrosis Using Deep Learning and CT Images.

OBJECTIVES: The objective of this study is to assess the performance of a computer-aided diagnosis (CAD) system (INTACT system) for the automatic classification of high-resolution computed tomography images into 4 radiological diagnostic categories and to compare this with the performance of radiologists on the same task. MATERIALS AND METHODS: For the comparison, a total of 105 cases of pulmonary fibrosis were studied (54 cases of nonspecific interstitial pneumonia and 51 cases of usual interstitial pneumonia). All diagnoses were interstitial lung disease board consensus diagnoses (radiologically or histologically proven cases) and were retrospectively selected from our database. Two subspecialized chest radiologists made a consensual ground truth radiological diagnosis, according to the Fleischner Society recommendations. A comparison analysis was performed between the INTACT system and 2 other radiologists with different years of experience (readers 1 and 2). The INTACT system consists of a sequential pipeline in which first the anatomical structures of the lung are segmented, then the various types of pathological lung tissue are identified and characterized, and this information is then fed to a random forest classifier able to recommend a radiological diagnosis. RESULTS: Reader 1, reader 2, and INTACT achieved similar accuracy for classifying pulmonary fibrosis into the original 4 categories: 0.6, 0.54, and 0.56, respectively, with P > 0.45. The INTACT system achieved an F-score (harmonic mean for precision and recall) of 0.56, whereas the 2 readers, on average, achieved 0.57 (P = 0.991). For the pooled classification (2 groups, with and without the need for biopsy), reader 1, reader 2, and CAD had similar accuracies of 0.81, 0.70, and 0.81, respectively. The F-score was again similar for the CAD system and the radiologists. The CAD system and the average reader reached F-scores of 0.80 and 0.79 (P = 0.898). CONCLUSIONS: We found that a computer-aided detection algorithm based on machine learning was able to classify idiopathic pulmonary fibrosis with similar accuracy to a human reader.

An Artificial Intelligence-Based System for Nutrient Intake Assessment of Hospitalised Patients.

Regular nutrient intake monitoring in hospitalised patients plays a critical role in reducing the risk of disease-related malnutrition (DRM). Although several methods to estimate nutrient intake have been developed, there is still a clear demand for a more reliable and fully automated technique, as this could improve the data accuracy and reduce both the participant burden and the health costs. In this paper, we propose a novel system based on artificial intelligence to accurately estimate nutrient intake, by simply processing RGB depth image pairs captured before and after a meal consumption. For the development and evaluation of the system, a dedicated and new database of images and recipes of 322 meals was assembled, coupled to data annotation using innovative strategies. With this database, a system was developed that employed a novel multi-task neural network and an algorithm for 3D surface construction. This allowed sequential semantic food segmentation and estimation of the volume of the consumed food, and permitted fully automatic estimation of nutrient intake for each food type with a 15% estimation error.