A novel endoimaging system for endoscopic 3D reconstruction in bladder cancer patients.

INTRODUCTION: The methods employed to document cystoscopic findings in bladder cancer patients lack accuracy and are subject to observer variability. We propose a novel endoimaging system and an online documentation platform to provide post-procedural 3D bladder reconstructions for improved diagnosis, management and follow-up. MATERIAL AND METHODS: The RaVeNNA4pi consortium is comprised of five industrial partners, two university hospitals and two technical institutes. These are grouped into hardware, software and clinical partners according to their professional expertise. The envisaged endoimaging system consists of an innovative cystoscope that generates 3D bladder reconstructions allowing users to remotely access a cloud-based centralized database to visualize individualized 3D bladder models from previous cystoscopies archived in DICOM format. RESULTS: Preliminary investigations successfully tracked the endoscope's rotational and translational movements. The structure-from-motion pipeline was tested in a bladder phantom and satisfactorily demonstrated 3D reconstructions of the processing sequence. AI-based semantic image segmentation achieved a 0.67 dice-score-coefficient over all classes. An online-platform allows physicians and patients to digitally visualize endoscopic findings by navigating a 3D bladder model. CONCLUSIONS: Our work demonstrates the current developments of a novel endoimaging system equipped with the potential to generate 3D bladder reconstructions from cystoscopy videos and AI-assisted automated detection of bladder tumors.

A high resolution bladder wall map: feasibility study.

The aim of this work is to provide the surgeon-urologist with a system for automatic 2D and 3D-reconstruction of the bladder wall to help him within the treatment of bladder cancer as well as planning and documentation of the interventions. Within this small pilot-framework a fast feasibility study was made to clear if it is generally possible to build a bladder wall model using a special endoscope with an embedded laser-based distance measurement, an optical navigation system and modern image stitching techniques. Some experiments with a realistic bladder phantom have shown that this initial concept is generally acceptable and can be used with some extensions to build a system which can provide an automatic bladder wall reconstruction in real time to be used within a surgical intervention.