Combined person classification with airborne optical sectioning.

Fully autonomous drones have been demonstrated to find lost or injured persons under strongly occluding forest canopy. Airborne optical sectioning (AOS), a novel synthetic aperture imaging technique, together with deep-learning-based classification enables high detection rates under realistic search-and-rescue conditions. We demonstrate that false detections can be significantly suppressed and true detections boosted by combining classifications from multiple AOS-rather than single-integral images. This improves classification rates especially in the presence of occlusion. To make this possible, we modified the AOS imaging process to support large overlaps between subsequent integrals, enabling real-time and on-board scanning and processing of groundspeeds up to 10 m/s.

Airborne Optical Sectioning for Nesting Observation.

We describe how a new and low-cost aerial scanning technique, airborne optical sectioning (AOS), can support ornithologists in nesting observation. After capturing thermal and color images during a seven minutes drone flight over a 40 × 12 m patch of the nesting site of Austria's largest heron population, a total of 65 herons and 27 nests could be identified, classified, and localized in a sparse 3D reconstruction of the forest. AOS is a synthetic aperture imaging technique that removes occlusion caused by leaves and branches. It registers recorded images to a common 3D coordinate system to support the reconstruction and analysis of the entire forest volume, which is impossible with conventional 2D or 3D imaging techniques. The recorded data is published with open access.

Synthetic Aperture Imaging With Drones.

Synthetic apertures sample the signal of wide aperture sensors with either arrays of static or single moving smaller aperture sensors whose individual signals are computationally combined to increase the resolution, depth-of-field, frame rate, contrast, and signal-to-noise ratio. This principle has been used for radar, telescopes, microscopes, sonar, ultrasound, laser, and optical imaging. With airborne optical sectioning (AOS), we apply camera drones for synthetic aperture imaging to uncover the ruins of a 19th century fortification system that is concealed by dense forest and shrubs. Compared to alternative airborne scanning technologies (such as LiDAR), AOS is cheaper, delivers surface color information, achieves higher sampling resolutions, and (in contrast to photogrammetry) does not suffer from inaccurate correspondence matches and long processing times.

Micro-lens aperture array for enhanced thin-film imaging using luminescent concentrators.

We present a 300 µm thick optical Söller collimator realized by X-ray lithography on a PMMA wafer which, when paired with luminescent concentrator films, forms the first complete prototype of a short-distance, flexible, scalable imaging system that is less than 1 mm thick. We describe two ways of increasing the light-gathering ability of the collimator by using hexagonal aperture cells and embedded micro-lenses, evaluate a new micro-lens aperture array (MLAA) for proof of concept, and analyze the optical imaging properties of flexible MLAAs when realized as thin films.

Compressive Volumetric Light-Field Excitation.

We explain how volumetric light-field excitation can be converted to a process that entirely avoids 3D reconstruction, deconvolution, and calibration of optical elements while taking scattering in the probe better into account. For spatially static probes, this is achieved by an efficient (one-time) light-transport sampling and light-field factorization. Individual probe particles (and arbitrary combinations thereof) can subsequently be excited in a dynamically controlled way while still supporting volumetric reconstruction of the entire probe in real-time based on a single light-field recording.

Volumetric Light-Field Excitation.

We explain how to concentrate light simultaneously at multiple selected volumetric positions by means of a 4D illumination light field. First, to select target objects, a 4D imaging light field is captured. A light field mask is then computed automatically for this selection to avoid illumination of the remaining areas. With one-photon illumination, simultaneous generation of complex volumetric light patterns becomes possible. As a full light-field can be captured and projected simultaneously at the desired exposure and excitation times, short readout and lighting durations are supported.