Surgical phase and instrument recognition: how to identify appropriate dataset splits.

PURPOSE: Machine learning approaches can only be reliably evaluated if training, validation, and test data splits are representative and not affected by the absence of classes. Surgical workflow and instrument recognition are two tasks that are complicated in this manner, because of heavy data imbalances resulting from different length of phases and their potential erratic occurrences. Furthermore, sub-properties like instrument (co-)occurrence are usually not particularly considered when defining the split. METHODS: We present a publicly available data visualization tool that enables interactive exploration of dataset partitions for surgical phase and instrument recognition. The application focuses on the visualization of the occurrence of phases, phase transitions, instruments, and instrument combinations across sets. Particularly, it facilitates assessment of dataset splits, especially regarding identification of sub-optimal dataset splits. RESULTS: We performed analysis of the datasets Cholec80, CATARACTS, CaDIS, M2CAI-workflow, and M2CAI-tool using the proposed application. We were able to uncover phase transitions, individual instruments, and combinations of surgical instruments that were not represented in one of the sets. Addressing these issues, we identify possible improvements in the splits using our tool. A user study with ten participants demonstrated that the participants were able to successfully solve a selection of data exploration tasks. CONCLUSION: In highly unbalanced class distributions, special care should be taken with respect to the selection of an appropriate dataset split because it can greatly influence the assessments of machine learning approaches. Our interactive tool allows for determination of better splits to improve current practices in the field. The live application is available at https://cardio-ai.github.io/endovis-ml/ .

Interactive visual exploration of surgical process data.

PURPOSE: Integrated operating rooms provide rich sources of temporal information about surgical procedures, which has led to the emergence of surgical data science. However, little emphasis has been put on interactive visualization of such temporal datasets to gain further insights. Our goal is to put heterogeneous data sequences in relation to better understand the workflows of individual procedures as well as selected subsets, e.g., with respect to different surgical phase distributions and surgical instrument usage patterns. METHODS: We developed a reusable web-based application design to analyze data derived from surgical procedure recordings. It consists of aggregated, synchronized visualizations for the original temporal data as well as for derived information, and includes tailored interaction techniques for selection and filtering. To enable reproducibility, we evaluated it across four types of surgeries from two openly available datasets (HeiCo and Cholec80). User evaluation has been conducted with twelve students and practitioners with surgical and technical background. RESULTS: The evaluation showed that the application has the complexity of an expert tool (System Usability Score of 57.73) but allowed the participants to solve various analysis tasks correctly (78.8% on average) and to come up with novel hypotheses regarding the data. CONCLUSION: The novel application supports postoperative expert-driven analysis, improving the understanding of surgical workflows and the underlying datasets. It facilitates analysis across multiple synchronized views representing information from different data sources and, thereby, advances the field of surgical data science.

Sub-cycle time resolution of multi-photon momentum transfer in strong-field ionization.

During multi-photon ionization of an atom it is well understood how the involved photons transfer their energy to the ion and the photoelectron. However, the transfer of the photon linear momentum is still not fully understood. Here, we present a time-resolved measurement of linear momentum transfer along the laser pulse propagation direction. We can show that the linear momentum transfer to the photoelectron depends on the ionization time within the laser cycle using the attoclock technique. We can mostly explain the measured linear momentum transfer within a classical model for a free electron in a laser field. However, corrections are required due to the parent-ion interaction and due to the initial momentum when the electron enters the continuum. The parent-ion interaction induces a negative attosecond time delay between the appearance in the continuum of the electron with minimal linear momentum transfer and the point in time with maximum ionization rate.

Room-Temperature Lasing from Monolithically Integrated GaAs Microdisks on Silicon.

Additional functionalities on semiconductor microchips are progressively important in order to keep up with the ever-increasing demand for more powerful computational systems. Monolithic III-V integration on Si promises to merge mature Si CMOS processing technology with III-V semiconductors possessing superior material properties, e. g., in terms of carrier mobility or band structure (direct band gap). In particular, Si photonics would strongly benefit from an integration scheme for active III-V optoelectronic devices in order to enable low-cost and power-efficient electronic-photonic integrated circuits. We report on room-temperature lasing from AlGaAs/GaAs microdisk cavities monolithically integrated on Si(001) using a selective epitaxial growth technique called template-assisted selective epitaxy. The grown gain material possesses high optical quality without indication of threading dislocations, antiphase boundaries, or twin defects. The devices exhibit single-mode lasing at T < 250 K and lasing thresholds between 2 and 18 pJ/pulse depending on the cavity size (1-3 µm in diameter).

Textural features in pre-treatment [F18]-FDG-PET/CT are correlated with risk of local recurrence and disease-specific survival in early stage NSCLC patients receiving primary stereotactic radiation therapy.

BACKGROUND: Textural features in FDG-PET have been shown to provide prognostic information in a variety of tumor entities. Here we evaluate their predictive value for recurrence and prognosis in NSCLC patients receiving primary stereotactic radiation therapy (SBRT). METHODS: 45 patients with early stage NSCLC (T1 or T2 tumor, no lymph node or distant metastases) were included in this retrospective study and followed over a median of 21.4 months (range 3.1-71.1). All patients were considered non-operable due to concomitant disease and referred to SBRT as the primary treatment modality. Pre-treatment FDG-PET/CT scans were obtained from all patients. SUV and volume-based analysis as well as extraction of textural features based on neighborhood gray-tone difference matrices (NGTDM) and gray-level co-occurence matrices (GLCM) were performed using InterView Fusion™ (Mediso Inc., Budapest). The ability to predict local recurrence (LR), lymph node (LN) and distant metastases (DM) was measured using the receiver operating characteristic (ROC). Univariate and multivariate analysis of overall and disease-specific survival were executed. RESULTS: 7 out of 45 patients (16%) experienced LR, 11 (24%) LN and 11 (24%) DM. ROC revealed a significant correlation of several textural parameters with LR with an AUC value for entropy of 0.872. While there was also a significant correlation of LR with tumor size in the overall cohort, only texture was predictive when examining T1 (tumor diameter < = 3 cm) and T2 (>3 cm) subgroups. No correlation of the examined PET parameters with LN or DM was shown. In univariate survival analysis, both heterogeneity and tumor size were predictive for disease-specific survival, but only texture determined by entropy was determined as an independent factor in multivariate analysis (hazard ratio 7.48, p = .016). Overall survival was not significantly correlated to any examined parameter, most likely due to the high comorbidity in our cohort. CONCLUSIONS: Our study adds to the growing evidence that tumor heterogeneity as described by FDG-PET texture is associated with response to radiation therapy in NSCLC. The results may be helpful into identifying patients who might profit from an intensified treatment regime, but need to be verified in a prospective patient cohort before being incorporated into routine clinical practice.

Lasing from individual GaAs-AlGaAs core-shell nanowires up to room temperature.

Semiconductor nanowires are widely considered to be the next frontier in the drive towards ultra-small, highly efficient coherent light sources. While NW lasers in the visible and ultraviolet have been widely demonstrated, the major role of surface and Auger recombination has hindered their development in the near infrared. Here we report infrared lasing up to room temperature from individual core-shell GaAs-AlGaAs nanowires. When subject to pulsed optical excitation, NWs exhibit lasing, characterized by single-mode emission at 10 K with a linewidth <60 GHz. The major role of non-radiative surface recombination is obviated by the presence of an AlGaAs shell around the GaAs-active region. Remarkably low threshold pump power densities down to ~760 W cm(-2) are observed at 10 K, with a characteristic temperature of T(0)=109±12 K and lasing operation up to room temperature. Our results show that, by carefully designing the materials composition profile, high-performance infrared NW lasers can be realised using III/V semiconductors.

High mobility one- and two-dimensional electron systems in nanowire-based quantum heterostructures.

Free-standing semiconductor nanowires in combination with advanced gate-architectures hold an exceptional promise as miniaturized building blocks in future integrated circuits. However, semiconductor nanowires are often corrupted by an increased number of close-by surface states, which are detrimental with respect to their optical and electronic properties. This conceptual challenge hampers their potentials in high-speed electronics and therefore new concepts are needed in order to enhance carrier mobilities. We have introduced a novel type of core-shell nanowire heterostructures that incorporate modulation or remote doping and hence may lead to high-mobility electrons. We demonstrate the validity of such concepts using inelastic light scattering to study single modulation-doped GaAs/Al0.16Ga0.84As core-multishell nanowires grown on silicon. We conclude from a detailed experimental study and theoretical analysis of the observed spin and charge density fluctuations that one- and two-dimensional electron channels are formed in a GaAs coaxial quantum well spatially separated from the donor ions. A total carrier density of about 3 × 10(7) cm(-1) and an electron mobility in the order of 50,000 cm(2)/(V s) are estimated. Spatial mappings of individual GaAs/Al0.16Ga0.84As core-multishell nanowires show inhomogeneous properties along the wires probably related to structural defects. The first demonstration of such unambiguous 1D- and 2D-electron channels and the respective charge carrier properties in these advanced nanowire-based quantum heterostructures is the basis for various novel nanoelectronic and photonic devices.

Enhanced luminescence properties of InAs-InAsP core-shell nanowires.

Utilizing narrow band gap nanowire (NW) materials to extend nanophotonic applications to the mid-infrared spectral region (>2-3 µm) is highly attractive, however, progress has been seriously hampered due to their poor radiative efficiencies arising from nonradiative surface and Auger recombination. Here, we demonstrate up to ~ 10(2) times enhancements of the emission intensities from InAs NWs by growing an InAsP shell to produce core-shell NWs. By systematically varying the thickness and phosphorus (P)-content of the InAsP shell, we demonstrate the ability to further tune the emission energy via large strain-induced peak shifts that already exceed >100 meV at comparatively low fractional P-contents. Increasing the P-content is found to give rise to additional line width broadening due to asymmetric shell growth generated by a unique transition from {110}- to {112}-sidewall growth as confirmed by cross-sectional scanning transmission electron microscopy. The results also elucidate the detrimental effects of plastic strain relaxation on the emission characteristics, particularly in core-shell structures with very high P-content and shell thickness. Overall, our findings highlight that enhanced mid-infrared emission efficiencies with effective carrier confinement and suppression of nonradiative recombination are highly sensitive to the quality of the InAs-InAsP core-shell interface.