Exploiting holographically encoded variance to transmit labelled images through a multimode optical fiber.

Artificial intelligence has emerged as promising tool to decode an image transmitted through a multimode fiber (MMF) by applying deep learning techniques. By transmitting thousands of images through the MMF, deep neural networks (DNNs) are able to decipher the seemingly random output speckle patterns and unveil the intrinsic input-output relationship. High fidelity reconstruction is obtained for datasets with a large degree of homogeneity, which underutilizes the capacity of the combined MMF-DNN system. Here, we show that holographic modulation can encode an additional layer of variance on the output speckle pattern, improving the overall transmissive capabilities of the system. Operatively, we have implemented this by adding a holographic label to the original dataset and injecting the resulting phase image into the fiber facet through a Fourier transform lens. The resulting speckle pattern dataset can be clustered primarily by holographic label, and can be reconstructed without loss of fidelity. As an application, we describe how color images may be segmented into RGB components and each color component may then be labelled by distinct hologram. A ResUNet architecture was then used to decode each class of speckle patterns and reconstruct the color image without the need for temporal synchronization between sender and receiver.

Manifold Learning Enables Interpretable Analysis of Raman Spectra from Extracellular Vesicle and Other Mixtures.

Extracellular vesicles (EVs) have emerged as promising diagnostic and therapeutic candidates in many biomedical applications. However, EV research continues to rely heavily on in vitro cell cultures for EV production, where the exogenous EVs present in fetal bovine (FBS) or other required serum supplementation can be difficult to remove entirely. Despite this and other potential applications involving EV mixtures, there are currently no rapid, robust, inexpensive, and label-free methods for determining the relative concentrations of different EV subpopulations within a sample. In this study, we demonstrate that surface-enhanced Raman spectroscopy (SERS) can biochemically fingerprint fetal bovine serum-derived and bioreactor-produced EVs, and after applying a novel manifold learning technique to the acquired spectra, enables the quantitative detection of the relative amounts of different EV populations within an unknown sample. We first developed this method using known ratios of Rhodamine B to Rhodamine 6G, then using known ratios of FBS EVs to breast cancer EVs from a bioreactor culture. In addition to quantifying EV mixtures, the proposed deep learning architecture provides some knowledge discovery capabilities which we demonstrate by applying it to dynamic Raman spectra of a chemical milling process. This label-free characterization and analytical approach should translate well to other EV SERS applications, such as monitoring the integrity of semipermeable membranes within EV bioreactors, ensuring the quality or potency of diagnostic or therapeutic EVs, determining relative amounts of EVs produced in complex co-culture systems, as well as many Raman spectroscopy applications.

Cascaded Deep Convolutional Neural Networks as Improved Methods of Preprocessing Raman Spectroscopy Data.

Machine learning has had a significant impact on the value of spectroscopic characterization tools, particularly in biomedical applications, due to its ability to detect latent patterns within complex spectral data. However, it often requires extensive data preprocessing, including baseline correction and denoising, which can lead to an unintentional bias during classification. To address this, we developed two deep learning methods capable of fully preprocessing raw Raman spectroscopy data without any human input. First, cascaded deep convolutional neural networks (CNN) based on either ResNet or U-Net architectures were trained on randomly generated spectra with augmented defects. Then, they were tested using simulated Raman spectra, surface-enhanced Raman spectroscopy (SERS) imaging of chemical species, low resolution Raman spectra of human bladder cancer tissue, and finally, classification of SERS spectra from human placental extracellular vesicles (EVs). Both approaches resulted in faster training and complete spectral preprocessing in a single step, with more speed, defect tolerance, and classification accuracy compared to conventional methods. These findings indicate that cascaded CNN preprocessing is ideal for biomedical Raman spectroscopy applications in which large numbers of heterogeneous spectra with diverse defects need to be automatically, rapidly, and reproducibly preprocessed.

Classification of Preeclamptic Placental Extracellular Vesicles Using Femtosecond Laser Fabricated Nanoplasmonic Sensors.

Placental extracellular vesicles (EVs) play an essential role in pregnancy by protecting and transporting diverse biomolecules that aid in fetomaternal communication. However, in preeclampsia, they have also been implicated in contributing to disease progression. Despite their potential clinical value, current technologies cannot provide a rapid and effective means of differentiating between healthy and diseased placental EVs. To address this, a fabrication process called laser-induced nanostructuring of SERS-active thin films (LINST) was developed to produce scalable nanoplasmonic substrates that provide exceptional Raman signal enhancement and allow the biochemical fingerprinting of EVs. After validating the performance of LINST substrates with chemical standards, placental EVs from tissue explant cultures were characterized, demonstrating that preeclamptic and normotensive placental EVs have classifiably distinct Raman spectra following the application of advanced machine learning algorithms. Given the abundance of placental EVs in maternal circulation, these findings encourage immediate exploration of surface-enhanced Raman spectroscopy (SERS) of EVs as a promising method for preeclampsia liquid biopsies, while this novel fabrication process will provide a versatile and scalable substrate for many other SERS applications.

Space curvature-inspired nanoplasmonic sensor for breast cancer extracellular vesicle fingerprinting and machine learning classification.

Extracellular vesicles (EVs) are micro and nanoscale lipid-enclosed packages that have shown potential as liquid biopsy targets for cancer because their structure and contents reflect their cell of origin. However, progress towards the clinical applications of EVs has been hindered due to the low abundance of disease-specific EVs compared to EVs from healthy cells; such applications thus require highly sensitive and adaptable characterization tools. To address this obstacle, we designed and fabricated a novel space curvature-inspired surfaced-enhanced Raman spectroscopy (SERS) substrate and tested its capabilities using bioreactor-produced and size exclusion chromatography-purified breast cancer EVs of three different subtypes. Our findings demonstrate the platform's ability to effectively fingerprint and efficiently classify, for the first time, three distinct subtypes of breast cancer EVs following the application of machine learning algorithms on the acquired spectra. This platform and characterization approach will enhance the viability of EVs and nanoplasmonic sensors towards clinical utility for breast cancer and many other applications to improve human health.

Three-dimensional transformation optics for arbitrary coordinate systems: transforming conductive materials and boundaries.

A three-dimensional transformation optics method, leading to homogeneous materials, applicable to any non-Cartesian coordinate systems or waveguides/objects of arbitrary cross-sections is presented. Both the conductive boundary and internal material of the desired device is determined by the proposed formulation. The method is applicable to a wide range of waveguide, radiation, and cloaking problems, and is demonstrated for circular waveguide couplers and an external cloak. An advantage of the present method is that the material properties are simplified by appropriately selecting the conductive boundaries. For instance, a right-angle circular waveguide bend is presented which uses only one homogenous material. Also, transformation of conductive materials and boundaries are studied. The conditions in which the transformed boundaries remain conductive are discussed. In addition, it is demonstrated that negative infinite conductivity can be replaced with positive conductivity, without affecting the field outside the conductive boundary. It is also observed that a negative finite conductivity can be replaced with a positive one, by accepting some small errors. The general mathematical procedure and formulation for calculating the parametric surface equations of the conductive peripheries are presented.