Shape analysis of training data for neural networks in Electrical Impedance Tomography.

Electrical Impedance Tomography (EIT) is a cost-effective and fast way to visualize dielectric properties of the human body, through the injection of alternating currents and measurement of the resulting potential on the bodies surface. However, this comes at the cost of low resolution as EIT is a non-linear ill-posed inverse problem. Recently Deep Learning methods have gained the interest in this field, as they provide a way to mimic non-linear functions. Most of the approaches focus on the structure of the Artificial Neural Networks (ANNs), while only glancing over the used training data. However, the structure of the training data is of great importance, as it needs to be simulated. In this work, we analyze the effect of basic shapes to be included as targets in the training data set. We compared inclusions of ellipsoids, cubes and octahedra as training data for ANNs in terms of reconstruction quality. For that, we used the well-established GREIT figures of merit on laboratory tank measurements. We found that ellipsoids resulted in the best reconstruction quality of EIT images. This shows that the choice of simulation data has an impact on the ANN reconstruction quality.Clinical relevance- This work helps to improve time independent EIT reconstruction, which in turn allows for extraction of time independent features of e.g., the lung.

Multi-modal body part segmentation of infants using deep learning.

BACKGROUND: Monitoring the body temperature of premature infants is vital, as it allows optimal temperature control and may provide early warning signs for severe diseases such as sepsis. Thermography may be a non-contact and wireless alternative to state-of-the-art, cable-based methods. For monitoring use in clinical practice, automatic segmentation of the different body regions is necessary due to the movement of the infant. METHODS: This work presents and evaluates algorithms for automatic segmentation of infant body parts using deep learning methods. Based on a U-Net architecture, three neural networks were developed and compared. While the first two only used one imaging modality (visible light or thermography), the third applied a feature fusion of both. For training and evaluation, a dataset containing 600 visible light and 600 thermography images from 20 recordings of infants was created and manually labeled. In addition, we used transfer learning on publicly available datasets of adults in combination with data augmentation to improve the segmentation results. RESULTS: Individual optimization of the three deep learning models revealed that transfer learning and data augmentation improved segmentation regardless of the imaging modality. The fusion model achieved the best results during the final evaluation with a mean Intersection-over-Union (mIoU) of 0.85, closely followed by the RGB model. Only the thermography model achieved a lower accuracy (mIoU of 0.75). The results of the individual classes showed that all body parts were well-segmented, only the accuracy on the torso is inferior since the models struggle when only small areas of the skin are visible. CONCLUSION: The presented multi-modal neural networks represent a new approach to the problem of infant body segmentation with limited available data. Robust results were obtained by applying feature fusion, cross-modality transfer learning and classical augmentation strategies.

Conditional Generative Adversarial Networks for Data Augmentation of a Neonatal Image Dataset.

In today's neonatal intensive care units, monitoring vital signs such as heart rate and respiration is fundamental for neonatal care. However, the attached sensors and electrodes restrict movement and can cause medical-adhesive-related skin injuries due to the immature skin of preterm infants, which may lead to serious complications. Thus, unobtrusive camera-based monitoring techniques in combination with image processing algorithms based on deep learning have the potential to allow cable-free vital signs measurements. Since the accuracy of deep-learning-based methods depends on the amount of training data, proper validation of the algorithms is difficult due to the limited image data of neonates. In order to enlarge such datasets, this study investigates the application of a conditional generative adversarial network for data augmentation by using edge detection frames from neonates to create RGB images. Different edge detection algorithms were used to validate the input images' effect on the adversarial network's generator. The state-of-the-art network architecture Pix2PixHD was adapted, and several hyperparameters were optimized. The quality of the generated RGB images was evaluated using a Mechanical Turk-like multistage survey conducted by 30 volunteers and the FID score. In a fake-only stage, 23% of the images were categorized as real. A direct comparison of generated and real (manually augmented) images revealed that 28% of the fake data were evaluated as more realistic. An FID score of 103.82 was achieved. Therefore, the conducted study shows promising results for the training and application of conditional generative adversarial networks to augment highly limited neonatal image datasets.

Camera fusion for real-time temperature monitoring of neonates using deep learning.

The continuous monitoring of vital signs is a crucial aspect of medical care in neonatal intensive care units. Since cable-based sensors pose a potential risk for the immature skin of preterm infants, unobtrusive monitoring techniques using camera systems are increasingly investigated. The combination of deep learning-based algorithms and camera modalities such as RGB and infrared thermography can improve the development of cable-free methods for the extraction of vital parameters. In this study, a real-time approach for local extraction of temperatures on the body surface of neonates using a multi-modal clinical dataset was implemented. Therefore, a trained deep learning-based keypoint detector was used for body landmark prediction in RGB. Image registration was conducted to transfer the RGB points to the corresponding thermographic recordings. These landmarks were used to extract the body surface temperature in various regions to determine the central-peripheral temperature difference. A validation of the keypoint detector showed a mean average precision of 0.82. The registration resulted in mean absolute errors of 16.4 px (8.2 mm) for x and 22.4 px (11.2 mm) for y. The evaluation of the temperature extraction revealed a mean absolute error of 0.55 [Formula: see text]C. A final performance of 31 fps was observed on the NVIDIA Jetson Xavier NX module, which proves real-time capability on an embedded GPU system. As a result, the approach can perform real-time temperature extraction on a low-cost GPU module.

A Rotational Invariant Neural Network for Electrical Impedance Tomography Imaging without Reference Voltage: RF-REIM-NET.

Background: Electrical Impedance Tomography (EIT) is a radiation-free technique for image reconstruction. However, as the inverse problem of EIT is non-linear and ill-posed, the reconstruction of sharp conductivity images poses a major problem. With the emergence of artificial neural networks (ANN), their application in EIT has recently gained interest. Methodology: We propose an ANN that can solve the inverse problem without the presence of a reference voltage. At the end of the ANN, we reused the dense layers multiple times, considering that the EIT exhibits rotational symmetries in a circular domain. To avoid bias in training data, the conductivity range used in the simulations was greater than expected in measurements. We also propose a new method that creates new data samples from existing training data. Results: We show that our ANN is more robust with respect to noise compared with the analytical Gauss-Newton approach. The reconstruction results for EIT phantom tank measurements are also clearer, as ringing artefacts are less pronounced. To evaluate the performance of the ANN under real-world conditions, we perform reconstructions on an experimental pig study with computed tomography for comparison. Conclusions: Our proposed ANN can reconstruct EIT images without the need of a reference voltage.

Dual-Modality Volume Measurement Integrated on a Ventricular Assist Device.

OBJECTIVE: Ventricular assist devices (VADs) are implanted in patients suffering from end-stage heart failure to sustain the blood circulation. Real-time volume measurement could be a valuable tool to monitor patients and enable physiological control strategies to provide individualized therapy. However, volume measurement using one sensor modality requires re-calibration in the critical time post VAD implantation. METHODS: To overcome this limitation, we have integrated ultrasound and impedance volume measurement techniques into a cannula of an apical VAD. We tested both modalities across a volume range from 140-420 mL using two differently sized and shaped biventricular silicon heart phantoms, which were subjected to physiological pressures in an in-vitro test bench. We compared results from standard calibrated measurements with calculations found by a quadratic optimization for the single modality and their combination (dual-modality) and validated the results using twofold cross-validation. RESULTS: The dual-modality approach resulted in most favorable limits of agreement (LOA) of -0.83 ± 1.54% compared to -13.88 ± 5.90% for ultrasound and -43.45 ± 10.28% for electric impedance, separately. CONCLUSION: The results of the dual-modality approach were as accurate as the standard calibrated measurement and valid over a large range of volumes (140-420 mL). In this in-vitro study, we show how a dual-modality ventricular volume measurement of ultrasound and electric impedance increases the robustness and renders calibration obsolete. SIGNIFICANCE: Ventricular volumes could be measured accurately in the critical period post VAD implantation despite ventricular remodeling.