An interactive atlas of three-dimensional syndromic facial morphology.

Craniofacial phenotyping is critical for both syndrome delineation and diagnosis because craniofacial abnormalities occur in 30% of characterized genetic syndromes. Clinical reports, textbooks, and available software tools typically provide two-dimensional, static images and illustrations of the characteristic phenotypes of genetic syndromes. In this work, we provide an interactive web application that provides three-dimensional, dynamic visualizations for the characteristic craniofacial effects of 95 syndromes. Users can visualize syndrome facial appearance estimates quantified from data and easily compare craniofacial phenotypes of different syndromes. Our application also provides a map of morphological similarity between a target syndrome and other syndromes. Finally, users can upload 3D facial scans of individuals and compare them to our syndrome atlas estimates. In summary, we provide an interactive reference for the craniofacial phenotypes of syndromes that allows for precise, individual-specific comparisons of dysmorphology.

Comparing 2D and 3D representations for face-based genetic syndrome diagnosis.

Human genetic syndromes are often challenging to diagnose clinically. Facial phenotype is a key diagnostic indicator for hundreds of genetic syndromes and computer-assisted facial phenotyping is a promising approach to assist diagnosis. Most previous approaches to automated face-based syndrome diagnosis have analyzed different datasets of either 2D images or surface mesh-based 3D facial representations, making direct comparisons of performance challenging. In this work, we developed a set of subject-matched 2D and 3D facial representations, which we then analyzed with the aim of comparing the performance of 2D and 3D image-based approaches to computer-assisted syndrome diagnosis. This work represents the most comprehensive subject-matched analyses to date on this topic. In our analyses of 1907 subject faces representing 43 different genetic syndromes, 3D surface-based syndrome classification models significantly outperformed 2D image-based models trained and evaluated on the same subject faces. These results suggest that the clinical adoption of 3D facial scanning technology and continued collection of syndromic 3D facial scan data may substantially improve face-based syndrome diagnosis.

Detecting 3D syndromic faces as outliers using unsupervised normalizing flow models.

Many genetic syndromes are associated with distinctive facial features. Several computer-assisted methods have been proposed that make use of facial features for syndrome diagnosis. Training supervised classifiers, the most common approach for this purpose, requires large, comprehensive, and difficult to collect databases of syndromic facial images. In this work, we use unsupervised, normalizing flow-based manifold and density estimation models trained entirely on unaffected subjects to detect syndromic 3D faces as statistical outliers. Furthermore, we demonstrate a general, user-friendly, gradient-based interpretability mechanism that enables clinicians and patients to understand model inferences. 3D facial surface scans of 2471 unaffected subjects and 1629 syndromic subjects representing 262 different genetic syndromes were used to train and evaluate the models. The flow-based models outperformed unsupervised comparison methods, with the best model achieving an ROC-AUC of 86.3% on a challenging, age and sex diverse data set. In addition to highlighting the viability of outlier-based syndrome screening tools, our methods generalize and extend previously proposed outlier scores for 3D face-based syndrome detection, resulting in improved performance for unsupervised syndrome detection.

An exploratory causal analysis of the relationships between the brain age gap and cardiovascular risk factors.

The brain age gap (BAG) has been shown to capture accelerated brain aging patterns and might serve as a biomarker for several neurological diseases. Moreover, it was also shown that it captures other biological information related to modifiable cardiovascular risk factors. Previous studies have explored statistical relationships between the BAG and cardiovascular risk factors. However, none of those studies explored causal relationships between the BAG and cardiovascular risk factors. In this work, we employ causal structure discovery techniques and define a Bayesian network to model the assumed causal relationships between the BAG, estimated using morphometric T1-weighted magnetic resonance imaging brain features from 2025 adults, and several cardiovascular risk factors. This setup allows us to not only assess observed conditional probability distributions of the BAG given cardiovascular risk factors, but also to isolate the causal effect of each cardiovascular risk factor on BAG using causal inference. Results demonstrate the feasibility of the proposed causal analysis approach by illustrating intuitive causal relationships between variables. For example, body-mass-index, waist-to-hip ratio, smoking, and alcohol consumption were found to impact the BAG, with the greatest impact for obesity markers resulting in higher chances of developing accelerated brain aging. Moreover, the findings show that causal effects differ from correlational effects, demonstrating the importance of accounting for variable relationships and confounders when evaluating the information captured by a biomarker. Our work demonstrates the feasibility and advantages of using causal analyses instead of purely correlation-based and univariate statistical analyses in the context of brain aging and related problems.

A Deep Invertible 3-D Facial Shape Model for Interpretable Genetic Syndrome Diagnosis.

One of the primary difficulties in treating patients with genetic syndromes is diagnosing their condition. Many syndromes are associated with characteristic facial features that can be imaged and utilized by computer-assisted diagnosis systems. In this work, we develop a novel 3D facial surface modeling approach with the objective of maximizing diagnostic model interpretability within a flexible deep learning framework. Therefore, an invertible normalizing flow architecture is introduced to enable both inferential and generative tasks in a unified and efficient manner. The proposed model can be used (1) to infer syndrome diagnosis and other demographic variables given a 3D facial surface scan and (2) to explain model inferences to non-technical users via multiple interpretability mechanisms. The model was trained and evaluated on more than 4700 facial surface scans from subjects with 47 different syndromes. For the challenging task of predicting syndrome diagnosis given a new 3D facial surface scan, age, and sex of a subject, the model achieves a competitive overall top-1 accuracy of 71%, and a mean sensitivity of 43% across all syndrome classes. We believe that invertible models such as the one presented in this work can achieve competitive inferential performance while greatly increasing model interpretability in the domain of medical diagnosis.

Sex Differences in Adult Facial Three-Dimensional Morphology: Application to Gender-Affirming Facial Surgery.

Background: Gender-affirming facial surgery (GFS) is pursued by transgender individuals who desire facial features that better reflect their gender identity. Currently, there are a few objective guidelines to justify and facilitate effective surgical decision making. Objective: To quantify the effect of sex on adult facial size and shape through an analysis of three-dimensional (3D) facial surface images. Materials and Methods: Facial measurements were obtained by registering an atlas facial surface to 3D surface scans of 545 males and 1028 females older than 20 years of age. The differences between male and female faces were analyzed and visualized for a set of predefined surgically relevant facial regions. Results: On average, male faces are 7.3% larger than female faces (Cohen's D = 2.17). Sex is associated with significant facial shape differences (p < 0.0001) in the entire face as well as in each sub-region considered in this study. The facial regions in which sex has the largest effect on shape are the brow, jaw, nose, and cheek. Conclusions: These findings provide biologic data-driven anatomic guidance and justification for GFS, particularly forehead contouring cranioplasty, mandible and chin alterations, rhinoplasty, and cheek modifications.

Invertible Modeling of Bidirectional Relationships in Neuroimaging With Normalizing Flows: Application to Brain Aging.

Many machine learning tasks in neuroimaging aim at modeling complex relationships between a brain's morphology as seen in structural MR images and clinical scores and variables of interest. A frequently modeled process is healthy brain aging for which many image-based brain age estimation or age-conditioned brain morphology template generation approaches exist. While age estimation is a regression task, template generation is related to generative modeling. Both tasks can be seen as inverse directions of the same relationship between brain morphology and age. However, this view is rarely exploited and most existing approaches train separate models for each direction. In this paper, we propose a novel bidirectional approach that unifies score regression and generative morphology modeling and we use it to build a bidirectional brain aging model. We achieve this by defining an invertible normalizing flow architecture that learns a probability distribution of 3D brain morphology conditioned on age. The use of full 3D brain data is achieved by deriving a manifold-constrained formulation that models morphology variations within a low-dimensional subspace of diffeomorphic transformations. This modeling idea is evaluated on a database of MR scans of more than 5000 subjects. The evaluation results show that our bidirectional brain aging model (1) accurately estimates brain age, (2) is able to visually explain its decisions through attribution maps and counterfactuals, (3) generates realistic age-specific brain morphology templates, (4) supports the analysis of morphological variations, and (5) can be utilized for subject-specific brain aging simulation.

Supervised machine learning tools: a tutorial for clinicians.

In an increasingly data-driven world, artificial intelligence is expected to be a key tool for converting big data into tangible benefits and the healthcare domain is no exception to this. Machine learning aims to identify complex patterns in multi-dimensional data and use these uncovered patterns to classify new unseen cases or make data-driven predictions. In recent years, deep neural networks have shown to be capable of producing results that considerably exceed those of conventional machine learning methods for various classification and regression tasks. In this paper, we provide an accessible tutorial of the most important supervised machine learning concepts and methods, including deep learning, which are potentially the most relevant for the medical domain. We aim to take some of the mystery out of machine learning and depict how machine learning models can be useful for medical applications. Finally, this tutorial provides a few practical suggestions for how to properly design a machine learning model for a generic medical problem.

Fully Automatic Landmarking of Syndromic 3D Facial Surface Scans Using 2D Images.

3D facial landmarks are known to be diagnostically relevant biometrics for many genetic syndromes. The objective of this study was to extend a state-of-the-art image-based 2D facial landmarking algorithm for the challenging task of 3D landmark identification on subjects with genetic syndromes, who often have moderate to severe facial dysmorphia. The automatic 3D facial landmarking algorithm presented here uses 2D image-based facial detection and landmarking models to identify 12 landmarks on 3D facial surface scans. The landmarking algorithm was evaluated using a test set of 444 facial scans with ground truth landmarks identified by two different human observers. Three hundred and sixty nine of the subjects in the test set had a genetic syndrome that is associated with facial dysmorphology. For comparison purposes, the manual landmarks were also used to initialize a non-linear surface-based registration of a non-syndromic atlas to each subject scan. Compared to the average intra- and inter-observer landmark distances of 1.1 mm and 1.5 mm respectively, the average distance between the manual landmark positions and those produced by the automatic image-based landmarking algorithm was 2.5 mm. The average error of the registration-based approach was 3.1 mm. Comparing the distributions of Procrustes distances from the mean for each landmarking approach showed that the surface registration algorithm produces a systemic bias towards the atlas shape. In summary, the image-based automatic landmarking approach performed well on this challenging test set, outperforming a semi-automatic surface registration approach, and producing landmark errors that are comparable to state-of-the-art 3D geometry-based facial landmarking algorithms evaluated on non-syndromic subjects.

Automated syndrome diagnosis by three-dimensional facial imaging.

PURPOSE: Deep phenotyping is an emerging trend in precision medicine for genetic disease. The shape of the face is affected in 30-40% of known genetic syndromes. Here, we determine whether syndromes can be diagnosed from 3D images of human faces. METHODS: We analyzed variation in three-dimensional (3D) facial images of 7057 subjects: 3327 with 396 different syndromes, 727 of their relatives, and 3003 unrelated, unaffected subjects. We developed and tested machine learning and parametric approaches to automated syndrome diagnosis using 3D facial images. RESULTS: Unrelated, unaffected subjects were correctly classified with 96% accuracy. Considering both syndromic and unrelated, unaffected subjects together, balanced accuracy was 73% and mean sensitivity 49%. Excluding unrelated, unaffected subjects substantially improved both balanced accuracy (78.1%) and sensitivity (56.9%) of syndrome diagnosis. The best predictors of classification accuracy were phenotypic severity and facial distinctiveness of syndromes. Surprisingly, unaffected relatives of syndromic subjects were frequently classified as syndromic, often to the syndrome of their affected relative. CONCLUSION: Deep phenotyping by quantitative 3D facial imaging has considerable potential to facilitate syndrome diagnosis. Furthermore, 3D facial imaging of "unaffected" relatives may identify unrecognized cases or may reveal novel examples of semidominant inheritance.

Rapid automated landmarking for morphometric analysis of three-dimensional facial scans.

Automated phenotyping is essential for the creation of large, highly standardized datasets from anatomical imaging data. Such datasets can support large-scale studies of complex traits or clinical studies related to precision medicine or clinical trials. We have developed a method that generates three-dimensional landmark data that meet the requirements of standard geometric morphometric analyses. The method is robust and can be implemented without high-performance computing resources. We validated the method using both direct comparison to manual landmarking on the same individuals and also analyses of the variation patterns and outlier patterns in a large dataset of automated and manual landmark data. Direct comparison of manual and automated landmarks reveals that automated landmark data are less variable, but more highly integrated and reproducible. Automated data produce covariation structure that closely resembles that of manual landmarks. We further find that while our method does produce some landmarking errors, they tend to be readily detectable and can be fixed by adjusting parameters used in the registration and control-point steps. Data generated using the method described here have been successfully used to study the genomic architecture of facial shape in two different genome-wide association studies of facial shape.