Artificial intelligence facial recognition system for diagnosis of endocrine and metabolic syndromes based on a facial image database.

AIM: To build a facial image database and to explore the diagnostic efficacy and influencing factors of the artificial intelligence-based facial recognition (AI-FR) system for multiple endocrine and metabolic syndromes. METHODS: Individuals with multiple endocrine and metabolic syndromes and healthy controls were included from public literature and databases. In this facial image database, facial images and clinical data were collected for each participant and dFRI (disease facial recognition intensity) was calculated to quantify facial complexity of each syndrome. AI-FR diagnosis models were trained for each disease using three algorithms: support vector machine (SVM), principal component analysis k-nearest neighbor (PCA-KNN), and adaptive boosting (AdaBoost). Diagnostic performance was evaluated. Optimal efficacy was achieved as the best index among the three models. Effect factors of AI-FR diagnosis were explored with regression analysis. RESULTS: 462 cases of 10 endocrine and metabolic syndromes and 2310 controls were included into the facial image database. The AI-FR diagnostic models showed diagnostic accuracies of 0.827-0.920 with SVM, 0.766-0.890 with PCA-KNN, and 0.818-0.935 with AdaBoost. Higher dFRI was associated with higher optimal area under the curve (AUC) (P = 0.035). No significant correlation was observed between the sample size of the training set and diagnostic performance. CONCLUSIONS: A multi-ethnic, multi-regional, and multi-disease facial database for 10 endocrine and metabolic syndromes was built. AI-FR models displayed ideal diagnostic performance. dFRI proved associated with the diagnostic performance, suggesting inherent facial features might contribute to the performance of AI-FR models.

High Dynamic Range Image Reconstruction from Saturated Images of Metallic Objects.

This study considers a method for reconstructing a high dynamic range (HDR) original image from a single saturated low dynamic range (LDR) image of metallic objects. A deep neural network approach was adopted for the direct mapping of an 8-bit LDR image to HDR. An HDR image database was first constructed using a large number of various metallic objects with different shapes. Each captured HDR image was clipped to create a set of 8-bit LDR images. All pairs of HDR and LDR images were used to train and test the network. Subsequently, a convolutional neural network (CNN) was designed in the form of a deep U-Net-like architecture. The network consisted of an encoder, a decoder, and a skip connection to maintain high image resolution. The CNN algorithm was constructed using the learning functions in MATLAB. The entire network consisted of 32 layers and 85,900 learnable parameters. The performance of the proposed method was examined in experiments using a test image set. The proposed method was also compared with other methods and confirmed to be significantly superior in terms of reconstruction accuracy, histogram fitting, and psychological evaluation.

Thyroid Ultrasound Image Database and Marker Mask Inpainting Method for Research and Development.

OBJECTIVE: The main objective of this study was to build a rich and high-quality thyroid ultrasound image database (TUD) for computer-aided diagnosis (CAD) systems to support accurate diagnosis and prognostic modeling of thyroid disorders. Because most of the raw thyroid ultrasound images contain artificial markers, which seriously affect the robustness of CAD systems because of their strong prior location information, we propose a marker mask inpainting (MMI) method to erase artificial markers and improve image quality. METHODS: First, a set of thyroid ultrasound images were collected from the General Hospital of the Northern Theater Command. Then, two modules were designed in MMI, namely, the marker detection (MD) module and marker erasure (ME) module. The MD module detects all markers in the image and stores them in a binary mask. According to the binary mask, the ME module erases the markers and generates an unmarked image. Finally, a new TUD based on the marked images and unmarked images was built. The TUD is carefully annotated and statistically analyzed by professional physicians to ensure accuracy and consistency. Moreover, several normal thyroid gland images and some ancillary information on benign and malignant nodules are provided. RESULTS: Several typical segmentation models were evaluated on the TUD. The experimental results revealed that our TUD can facilitate the development of more accurate CAD systems for the analysis of thyroid nodule-related lesions in ultrasound images. The effectiveness of our MMI method was determined in quantitative experiments. CONCLUSION: The rich and high-quality resource TUD promotes the development of more effective diagnostic and treatment methods for thyroid diseases. Furthermore, MMI for erasing artificial markers and generating unmarked images is proposed to improve the quality of thyroid ultrasound images. Our TUD database is available at https://github.com/NEU-LX/TUD-Datebase.

ORCA: A picture database of object-scene arrangements for cross-cultural and aging research.

In recent years, cross-cultural research on the modulation of basic cognitive processes by culture has intensified - also from an aging perspective. Despite this increased research interest, only a few cross-culturally normed non-verbal stimulus sets are available to support cross-cultural cognitive research in younger and older adults. Here we present the ORCA (Official Rating of Complex Arrangements) picture database, which includes a total of 720 object-scene compositions sorted into 180 quadruples (e.g., two different helmets placed in two different deserts). Each quadruple contains visually and semantically matched pairs of objects and pairs of scenes with varying degrees of semantic fit between objects and scenes. A total of 95 younger and older German and Chinese adults rated every object-scene pair on object familiarity and semantic fit between object and scene. While the ratings were significantly correlated between cultures and age groups, small but significant culture and age differences emerged. Object familiarity was higher for older adults than younger adults and for German participants than for Chinese participants. Semantic fit was rated lower by German older adults and Chinese younger adults as compared to German younger adults and Chinese older adults. Due to the large number of stimuli, our database is particularly well suited for cognitive and neuroscientific research on cross-cultural and age-related differences in perception, attention, and memory.

Sequestration of imaging studies in MIDRC: stratified sampling to balance demographic characteristics of patients in a multi-institutional data commons.

Purpose: The Medical Imaging and Data Resource Center (MIDRC) is a multi-institutional effort to accelerate medical imaging machine intelligence research and create a publicly available image repository/commons as well as a sequestered commons for performance evaluation and benchmarking of algorithms. After de-identification, approximately 80% of the medical images and associated metadata become part of the open commons and 20% are sequestered from the open commons. To ensure that both commons are representative of the population available, we introduced a stratified sampling method to balance the demographic characteristics across the two datasets. Approach: Our method uses multi-dimensional stratified sampling where several demographic variables of interest are sequentially used to separate the data into individual strata, each representing a unique combination of variables. Within each resulting stratum, patients are assigned to the open or sequestered commons. This algorithm was used on an example dataset containing 5000 patients using the variables of race, age, sex at birth, ethnicity, COVID-19 status, and image modality and compared resulting demographic distributions to naïve random sampling of the dataset over 2000 independent trials. Results: Resulting prevalence of each demographic variable matched the prevalence from the input dataset within one standard deviation. Mann-Whitney U test results supported the hypothesis that sequestration by stratified sampling provided more balanced subsets than naïve randomization, except for demographic subcategories with very low prevalence. Conclusions: The developed multi-dimensional stratified sampling algorithm can partition a large dataset while maintaining balance across several variables, superior to the balance achieved from naïve randomization.

[Advances in digital twins technology of human skeletal muscle].

The human skeletal muscle drives skeletal movement through contraction. Embedding its functional information into the human morphological framework and constructing a digital twin of skeletal muscle for simulating physical and physiological functions of skeletal muscle are of great significance for the study of "virtual physiological humans". Based on relevant literature both domestically and internationally, this paper firstly summarizes the technical framework for constructing skeletal muscle digital twins, and then provides a review from five aspects including skeletal muscle digital twins modeling technology, skeletal muscle data collection technology, simulation analysis technology, simulation platform and human medical image database. On this basis, it is pointed out that further research is needed in areas such as skeletal muscle model generalization, accuracy improvement, and model coupling. The methods and means of constructing skeletal muscle digital twins summarized in the paper are expected to provide reference for researchers in this field, and the development direction pointed out can serve as the next focus of research.

Integration of USDA Food Classification System and Food Composition Database for Image-Based Dietary Assessment among Individuals Using Insulin.

New imaging technologies to identify food can reduce the reporting burden of participants but heavily rely on the quality of the food image databases to which they are linked to accurately identify food images. The objective of this study was to develop methods to create a food image database based on the most commonly consumed U.S. foods and those contributing the most to energy. The objective included using a systematic classification structure for foods based on the standardized United States Department of Agriculture (USDA) What We Eat in America (WWEIA) food classification system that can ultimately be used to link food images to a nutrition composition database, the USDA Food and Nutrient Database for Dietary Studies (FNDDS). The food image database was built using images mined from the web that were fitted with bounding boxes, identified, annotated, and then organized according to classifications aligning with USDA WWEIA. The images were classified by food category and subcategory and then assigned a corresponding USDA food code within the USDA's FNDDS in order to systematically organize the food images and facilitate a linkage to nutrient composition. The resulting food image database can be used in food identification and dietary assessment.

NITS-IQA Database: A New Image Quality Assessment Database.

This paper describes a newly-created image database termed as the NITS-IQA database for image quality assessment (IQA). In spite of recently developed IQA databases, which contain a collection of a huge number of images and type of distortions, there is still a lack of new distortion and use of real natural images taken by the camera. The NITS-IQA database contains total 414 images, including 405 distorted images (nine types of distortion with five levels in each of the distortion type) and nine original images. In this paper, a detailed step by step description of the database development along with the procedure of the subjective test experiment is explained. The subjective test experiment is carried out in order to obtain the individual opinion score of the quality of the images presented before them. The mean opinion score (MOS) is obtained from the individual opinion score. In this paper, the Pearson, Spearman and Kendall rank correlation between a state-of-the-art IQA technique and the MOS are analyzed and presented.

EBHI: A new Enteroscope Biopsy Histopathological H&E Image Dataset for image classification evaluation.

BACKGROUND AND PURPOSE: Colorectal cancer has become the third most common cancer worldwide, accounting for approximately 10% of cancer patients. Early detection of the disease is important for the treatment of colorectal cancer patients. Histopathological examination is the gold standard for screening colorectal cancer. However, the current lack of histopathological image datasets of colorectal cancer, especially enteroscope biopsies, hinders the accurate evaluation of computer-aided diagnosis techniques. Therefore, a multi-category colorectal cancer dataset is needed to test various medical image classification methods to find high classification accuracy and strong robustness. METHODS: A new publicly available Enteroscope Biopsy Histopathological H&E Image Dataset (EBHI) is published in this paper. To demonstrate the effectiveness of the EBHI dataset, we have utilized several machine learning, convolutional neural networks and novel transformer-based classifiers for experimentation and evaluation, using an image with a magnification of 200×. RESULTS: Experimental results show that the deep learning method performs well on the EBHI dataset. Classical machine learning methods achieve maximum accuracy of 76.02% and deep learning method achieves a maximum accuracy of 95.37%. CONCLUSION: To the best of our knowledge, EBHI is the first publicly available colorectal histopathology enteroscope biopsy dataset with four magnifications and five types of images of tumor differentiation stages, totaling 5532 images. We believe that EBHI could attract researchers to explore new classification algorithms for the automated diagnosis of colorectal cancer, which could help physicians and patients in clinical settings.

Image collection and annotation platforms to establish a multi-source database of oral lesions.

OBJECTIVE: To describe the development of a platform for image collection and annotation that resulted in a multi-sourced international image dataset of oral lesions to facilitate the development of automated lesion classification algorithms. MATERIALS AND METHODS: We developed a web-interface, hosted on a web server to collect oral lesions images from international partners. Further, we developed a customised annotation tool, also a web-interface for systematic annotation of images to build a rich clinically labelled dataset. We evaluated the sensitivities comparing referral decisions through the annotation process with the clinical diagnosis of the lesions. RESULTS: The image repository hosts 2474 images of oral lesions consisting of oral cancer, oral potentially malignant disorders and other oral lesions that were collected through MeMoSA® UPLOAD. Eight-hundred images were annotated by seven oral medicine specialists on MeMoSA® ANNOTATE, to mark the lesion and to collect clinical labels. The sensitivity in referral decision for all lesions that required a referral for cancer management/surveillance was moderate to high depending on the type of lesion (64.3%-100%). CONCLUSION: This is the first description of a database with clinically labelled oral lesions. This database could accelerate the improvement of AI algorithms that can promote the early detection of high-risk oral lesions.

Research progress on image standard database of artificial intelligence-assisted radiotherapy for lung cancer / 中华放射肿瘤学杂志

Lung cancer is the malignant tumor with the highest mortality rate in the world. Radiotherapy plays an important role in the comprehensive treatment of lung cancer. With the continuous advancement of radiotherapy technology and equipment, it has become one of the effective therapeutic options for lung cancer. In recent years, artificial intelligence technology has developed rapidly and has been widely applied in clinical practice, especially in the diagnosis and treatment of lung cancer imaging. The image database can be obtained by sorting and summarizing the images, which can be used in clinical work and scientific research. In this article, the application of artificial intelligence in lung cancer radiotherapy imaging and lung cancer imaging database was reviewed, aiming to provide reference for the construction of artificial intelligence radiotherapy imaging database for lung cancer.

Advances in digital twins technology of human skeletal muscle / 生物医学工程学杂志

The human skeletal muscle drives skeletal movement through contraction. Embedding its functional information into the human morphological framework and constructing a digital twin of skeletal muscle for simulating physical and physiological functions of skeletal muscle are of great significance for the study of "virtual physiological humans". Based on relevant literature both domestically and internationally, this paper firstly summarizes the technical framework for constructing skeletal muscle digital twins, and then provides a review from five aspects including skeletal muscle digital twins modeling technology, skeletal muscle data collection technology, simulation analysis technology, simulation platform and human medical image database. On this basis, it is pointed out that further research is needed in areas such as skeletal muscle model generalization, accuracy improvement, and model coupling. The methods and means of constructing skeletal muscle digital twins summarized in the paper are expected to provide reference for researchers in this field, and the development direction pointed out can serve as the next focus of research.

The Restrain Food Database: validation of an open-source database of foods that should be eaten more or less as part of a healthy diet.

Studies of food-related behaviours often involve measuring responses to pictorial stimuli of foods. Creating these can be burdensome, requiring a significant commitment of time, and with sharing of images for future research constrained by legal copyright restrictions. The Restrain Food Database is an open-source database of 626 images of foods that are categorized as those people could eat more or less of as part of a healthy diet. This paper describes the database and details how to navigate it using our purpose-built R Shiny tool and a pre-registered online validation of a sample of images. A total of 2150 participants provided appetitive ratings, perceptions of nutritional content and ratings of image quality for images from the database. We found support for differences between Food Category on appetitive ratings which were also moderated by state hunger ratings. Findings relating to individual differences in appetite ratings as well as differences between BMI weight categories are also reported. Our findings validate the food categorization in the Restrain Food Database and provide descriptive information for individual images within this investigation. This database should ease the burden of selecting and creating appropriate images for future studies.

C-NMC: B-lineage acute lymphoblastic leukaemia: A blood cancer dataset.

Development of computer-aided cancer diagnostic tools is an active research area owing to the advancements in deep-learning domain. Such technological solutions provide affordable and easily deployable diagnostic tools. Leukaemia, or blood cancer, is one of the leading cancers causing more than 0.3 million deaths every year. In order to aid the development of such an AI-enabled tool, we collected and curated a microscopic image dataset, namely C-NMC, of more than 15000 cancer cell images at a very high resolution of B-Lineage Acute Lymphoblastic Leukaemia (B-ALL). The dataset is prepared at the subject-level and contains images of both healthy and cancer patients. So far, this is the largest (as well as curated) dataset on B-ALL cancer in the public domain. C-NMC is available at The Cancer Imaging Archive (TCIA), USA and can be helpful for the research community worldwide for the development of B-ALL cancer diagnostic tools. This dataset was utilized in an international medical imaging challenge held at ISBI 2019 conference in Venice, Italy. In this paper, we present a detailed description and challenges of this dataset. We also present benchmarking results of all the methods applied so far on this dataset.

ISIEA: An image database of social inclusion and exclusion in young Asian adults.

Human beings have a fundamental need to belong. Evaluating and dealing with social exclusion and social inclusion events, which represent negative and positive social interactions, respectively, are closely linked to our physical and mental health. In addition to traditional paradigms that simulate scenarios of social interaction, images are utilized as effective visual stimuli for research on socio-emotional processing and regulation. Since the current mainstream emotional image database lacks social stimuli based on a specific social context, we introduced an open-access image database of social inclusion/exclusion in young Asian adults (ISIEA). This database contains a set of 164 images depicting social interaction scenarios under three categories of social contexts (social exclusion, social neutral, and social inclusion). All images were normatively rated on valence, arousal, inclusion score, and vicarious feeling by 150 participants in Study 1. We additionally examined the relationships between image ratings and the potential factors influencing ratings. The importance of facial expression and social context in the image rating of ISIEA was examined in Study 2. We believe that this database allows researchers to select appropriate materials for socially related studies and to flexibly conduct experimental control.

A lightweight convolutional neural network for recognition of severity stages of maydis leaf blight disease of maize.

Maydis leaf blight (MLB) of maize (Zea Mays L.), a serious fungal disease, is capable of causing up to 70% damage to the crop under severe conditions. Severity of diseases is considered as one of the important factors for proper crop management and overall crop yield. Therefore, it is quite essential to identify the disease at the earliest possible stage to overcome the yield loss. In this study, we created an image database of maize crop, MDSD (Maydis leaf blight Disease Severity Dataset), containing 1,760 digital images of MLB disease, collected from different agricultural fields and categorized into four groups viz. healthy, low, medium and high severity stages. Next, we proposed a lightweight convolutional neural network (CNN) to identify the severity stages of MLB disease. The proposed network is a simple CNN framework augmented with two modified Inception modules, making it a lightweight and efficient multi-scale feature extractor. The proposed network reported approx. 99.13% classification accuracy with the f1-score of 98.97% on the test images of MDSD. Furthermore, the class-wise accuracy levels were 100% for healthy samples, 98% for low severity samples and 99% for the medium and high severity samples. In addition to that, our network significantly outperforms the popular pretrained models, viz. VGG16, VGG19, InceptionV3, ResNet50, Xception, MobileNetV2, DenseNet121 and NASNetMobile for the MDSD image database. The experimental findings revealed that our proposed lightweight network is excellent in identifying the images of severity stages of MLB disease despite complicated background conditions.

ODTiD: Optic Nerve Head SD-OCT Image Dataset.

INTRODUCTION: Optic disc tilt (ODT) or tilted optic disc is a common finding in the general population. It is due to anomalous development caused by the malclosure of the embryonic optic fissure. ODT is commonly associated with high myopia as well as other conditions. In recent days, the common method to image the optic disc (OD) is by optical coherence tomography (OCT). To the best of our knowledge, there are no datasets of ODT available in the public domain. This dataset aims to make open access raw ODT OCT images to test out new image processing segmentation algorithms. METHODS: This dataset of ODT images contains both horizontal and vertical cross-sectional images obtained using spectral-domain optical coherence tomography (SD-OCT, Cirrus 5000, Carl Zeiss Meditec Inc., Dublin, CA). The optic disc cube 200×200 program was used and all the images are aligned with the center of the optic nerve head. This dataset includes images from both clinically normal (20 eyes) and myopic subjects (101 eyes). RESULTS: The dataset consists of clear (121) and manually marked (121) images resulting in a total of 242 images. The age distribution for all subjects combined is 27.24 ± 9.28 (range, 11.0-69.0) years. For normal subjects mean ± SD age distribution is 32.40 ± 17.23 years. Similarly, the myopia age distribution is 26.22 ± 6.37 years. Ground truth images, ie, manually segmented by a clinical expert are provided along with other meta-data includes age, gender, laterality, refractive error classification, spherical equivalent (SE), best-corrected visual acuity (BCVA), intraocular pressure (IOP), and axial length (AXL). CONCLUSION: This open, public database is online at the ICPSR website of the University of Michigan. The dataset can be used to test and validate newly developed automated segmentation algorithms.

X-ray computed tomography for 3D plant imaging.

X-ray computed tomography (CT) is a valuable tool for 3D imaging of plant tissues and organs. Applications include the study of plant development and organ morphogenesis, as well as modeling of transport processes in plants. Some challenges remain, however, including attaining higher contrast for easier quantification, increasing the resolution for imaging subcellular features, and decreasing image acquisition and processing time for high-throughput phenotyping. In addition, phase contrast, multispectral, dark-field, soft X-ray, and time-resolved imaging are emerging. At the same time, a large amount of 3D image data are becoming available, posing challenges for data management. We review recent advances in the area of X-ray CT for plant imaging, and describe opportunities for using such images for studying transport processes in plants.

Image dataset of pomegranate fruits (Punica granatum) for various machine vision applications.

Dataset - an essential aspect and the requirement for any of the machine learning project. Collection/creation of dataset in the agriculture domain is highly challenging task because the domain itself is uncertain. Main objective of the present paper is to create an image dataset of pomegranate fruits of different grades. Accordingly, we have considered 'Ruby' cultivar of pomegranate and sincerely constructed the dataset. Fruits belonging to three grades are considered. The images for each fruit are covered from all the three angles. The dataset created also contains the weights of the fruits. The dataset consists of 12 folders named after their effective quality grades. The usage of this dataset is already proved in the works carried out by the authors in their previous studies. This dataset is highly helpful for the data science engineer / machine learning programmer or machine learning expert working in the field of precision agriculture.