Protein Design Using Physics Informed Neural Networks.

The inverse protein folding problem, also known as protein sequence design, seeks to predict an amino acid sequence that folds into a specific structure and performs a specific function. Recent advancements in machine learning techniques have been successful in generating functional sequences, outperforming previous energy function-based methods. However, these machine learning methods are limited in their interoperability and robustness, especially when designing proteins that must function under non-ambient conditions, such as high temperature, extreme pH, or in various ionic solvents. To address this issue, we propose a new Physics-Informed Neural Networks (PINNs)-based protein sequence design approach. Our approach combines all-atom molecular dynamics simulations, a PINNs MD surrogate model, and a relaxation of binary programming to solve the protein design task while optimizing both energy and the structural stability of proteins. We demonstrate the effectiveness of our design framework in designing proteins that can function under non-ambient conditions.

Mimetic Neural Networks: A Unified Framework for Protein Design and Folding.

Recent advancements in machine learning techniques for protein structure prediction motivate better results in its inverse problem-protein design. In this work we introduce a new graph mimetic neural network, MimNet, and show that it is possible to build a reversible architecture that solves the structure and design problems in tandem, allowing to improve protein backbone design when the structure is better estimated. We use the ProteinNet data set and show that the state of the art results in protein design can be met and even improved, given recent architectures for protein folding.

A Soft Labeling Approach to Develop Automated Algorithms that Incorporate Uncertainty in Pulmonary Opacification on Chest CT using COVID-19 Pneumonia.

RATIONALE AND OBJECTIVES: Hard data labels for automated algorithm training are binary and cannot incorporate uncertainty between labels. We proposed and evaluated a soft labeling methodology to quantify opacification and percent well-aerated lung (%WAL) on chest CT, that considers uncertainty in segmenting pulmonary opacifications and reduces labeling burden. MATERIALS AND METHODS: We retrospectively sourced 760 COVID-19 chest CT scans from five international centers between January and June 2020. We created pixel-wise labels for >27,000 axial slices that classify three pulmonary opacification patterns: pure ground-glass, crazy-paving, consolidation. We also quantified %WAL as the total area of lung without opacifications. Inter-user hard label variability was quantified using Shannon entropy (range=0-1.39, low-high entropy/variability). We incorporated a soft labeling and modeling cycle following an initial model with hard labels and compared performance using point-wise accuracy and intersection-over-union of opacity labels with ground-truth, and correlation with ground-truth %WAL. RESULTS: Hard labels annotated by 12 radiologists demonstrated large inter-user variability (3.37% of pixels achieved complete agreement). Our soft labeling approach increased point-wise accuracy from 60.0% to 84.3% (p=0.01) compared to hard labeling at predicting opacification type and area involvement. The soft label model accurately predicted %WAL (R=0.900) compared to the hard label model (R=0.856), but the improvement was not statistically significant (p=0.349). CONCLUSION: Our soft labeling approach increased accuracy for automated quantification and classification of pulmonary opacification on chest CT. Although we developed the model on COVID-19, our intent is broad application for pulmonary opacification contexts and to provide a foundation for future development using soft labeling methods.

GlymphVIS: Visualizing Glymphatic Transport Pathways Using Regularized Optimal Transport.

The glymphatic system (GS) is a transit passage that facil-itates brain metabolic waste removal and its dysfunction has been asso-ciated with neurodegenerative diseases such as Alzheimer's disease. The GS has been studied by acquiring temporal contrast enhanced magnetic resonance imaging (MRI) sequences of a rodent brain, and tracking the cerebrospinal fluid injected contrast agent as it flows through the GS. We present here a novel visualization framework, GlymphVIS, which uses regularized optimal transport (OT) to study the flow behavior between time points at which the images are taken. Using this regularized OT app-roach, we can incorporate diffusion, handle noise, and accurately capture and visualize the time varying dynamics in GS transport. Moreover, we are able to reduce the registration mean-squared and infinity-norm error across time points by up to a factor of 5 as compared to the current state-of-the-art method. Our visualization pipeline yields flow patterns that align well with experts' current findings of the glymphatic system.

Automatic Alignment of Myocardial Perfusion Images With Contrast-Enhanced Cardiac Computed Tomography.

Explicit fusion of perfusion data from Positron Emission Tomography (PET) or Single Photon Emission Computed Tomography (SPECT) with coronary artery anatomy from Computed Tomographic Coronary Angiography (CTA) has been shown to improve the diagnostic yield for coronary artery disease (CAD) compared to either modality alone. However, most clinically available methods were developed for multimodal scanners or require interactive alignment prior to display and analysis. A new approach was developed to register the two distributions obtained either from a single multimodal imager or from separate scanners, and a preliminary validation was undertaken to compare the automatic alignment to interactive alignment by two experts.

Automatic Alignment of Myocardial Perfusion Images with Contrast Cardiac Tomography.

Explicit fusion of perfusion data from Positron Emission Tomography (PET) or Single Photon Emission Computed Tomography (SPECT) with coronary artery anatomy from Computed Tomographic Coronary Angiography (CTCA) has been shown to improve the diagnostic yield for coronary artery disease (CAD) compared to either modality alone. However, most clinically available methods were developed for multimodal scanners or require interactive alignment prior to display and analysis. A new approach was developed to register and display the two distributions obtained either from a single multimodal imager or from separate scanners, and a preliminary validation was undertaken using interactive alignment by experts.

AN EFFICIENT NUMERICAL METHOD FOR THE SOLUTION OF THE L(2) OPTIMAL MASS TRANSFER PROBLEM.

In this paper we present a new computationally efficient numerical scheme for the minimizing flow approach for the computation of the optimal L(2) mass transport mapping. In contrast to the integration of a time dependent partial differential equation proposed in [S. Angenent, S. Haker, and A. Tannenbaum, SIAM J. Math. Anal., 35 (2003), pp. 61-97], we employ in the present work a direct variational method. The efficacy of the approach is demonstrated on both real and synthetic data.

3D nonrigid registration via optimal mass transport on the GPU.

In this paper, we present a new computationally efficient numerical scheme for the minimizing flow approach for optimal mass transport (OMT) with applications to non-rigid 3D image registration. The approach utilizes all of the gray-scale data in both images, and the optimal mapping from image A to image B is the inverse of the optimal mapping from B to A. Further, no landmarks need to be specified, and the minimizer of the distance functional involved is unique. Our implementation also employs multigrid, and parallel methodologies on a consumer graphics processing unit (GPU) for fast computation. Although computing the optimal map has been shown to be computationally expensive in the past, we show that our approach is orders of magnitude faster then previous work and is capable of finding transport maps with optimality measures (mean curl) previously unattainable by other works (which directly influences the accuracy of registration). We give results where the algorithm was used to compute non-rigid registrations of 3D synthetic data as well as intra-patient pre-operative and post-operative 3D brain MRI datasets.

Multimodal Registration of White Matter Brain Data via Optimal Mass Transport.

The elastic registration of medical scans from different acquisition sequences is becoming an important topic for many research labs that would like to continue the post-processing of medical scans acquired via the new generation of high-field-strength scanners. In this note, we present a parameter-free registration algorithm that is well suited for this scenario as it requires no tuning to specific acquisition sequences. The algorithm encompasses a new numerical scheme for computing elastic registration maps based on the minimizing flow approach to optimal mass transport. The approach utilizes all of the gray-scale data in both images, and the optimal mapping from image A to image B is the inverse of the optimal mapping from B to A. Further, no landmarks need to be specified, and the minimizer of the distance functional involved is unique. We apply the algorithm to register the white matter folds of two different scans and use the results to parcellate the cortex of the target image. To the best of our knowledge, this is the first time that the optimal mass transport function has been applied to register large 3D multimodal data sets.

Intensity gradient based registration and fusion of multi-modal images.

OBJECTIVES: A particular problem in image registration arises for multi-modal images taken from different imaging devices and/or modalities. Starting in 1995, mutual information has shown to be a very successful distance measure for multi-modal image registration. Therefore, mutual information is considered to be the state-of-the-art approach to multi-modal image registration. However, mutual information has also a number of well-known drawbacks. Its main disadvantage is that it is known to be highly non-convex and has typically many local maxima. METHODS: This observation motivates us to seek a different image similarity measure which is better suited for optimization but as well capable to handle multi-modal images. RESULTS: In this work, we investigate an alternative distance measure which is based on normalized gradients. CONCLUSIONS: As we show, the alternative approach is deterministic, much simpler, easier to interpret, fast and straightforward to implement, faster to compute, and also much more suitable to numerical optimization.

Intensity gradient based registration and fusion of multi-modal images.

A particular problem in image registration arises for multimodal images taken from different imaging devices and/or modalities. Starting in 1995, mutual information has shown to be a very successful distance measure for multi-modal image registration. However, mutual information has also a number of well-known drawbacks. Its main disadvantage is that it is known to be highly non-convex and has typically many local maxima. This observation motivate us to seek a different image similarity measure which is better suited for optimization but as well capable to handle multi-modal images. In this work we investigate an alternative distance measure which is based on normalized gradients and compare its performance to Mutual Information. We call the new distance measure Normalized Gradient Fields (NGF).