Parallax and Distortion in Fluoroscopy Units.

BACKGROUND: Parallax is an imaging phenomenon where an object appears to be at different positions when viewed from different angles. Distortion can occur secondary to internal fluoroscopic, or external environmental, factors. Fluoroscopy is a vital tool to assist surgeons intraoperatively. However, parallax and distortion can lead to inaccuracy, potentially leading to incorrect surgical decisions. The purpose of this study was to investigate the prevalence of parallax/distortion in large fluoroscopy units at a level-1 trauma center. METHODS: Two types of C-arm models were evaluated, including (1) round image intensifiers, and (2) flat plate detectors (FPD). A square plexiglass grid with embedded wire at ½-in intervals was created, with a round metal washer secured centrally. The grid was placed 16 in from the image intensifier. A metal ball bearing (BB) was secured to the center of the x-ray tube. Fluoroscopic images were obtained until the BB and washer were "center-center." A straight blade served as a fiducial marker to ensure there was no off-axis angulation. Standard anterior-posterior and lateral views were obtained. External factors were considered, tested, and limited. Images were printed and the patterns of parallax/distortion were identified. RESULTS: All 11/11 (100%) of fluoroscopy units had some degree of parallax and/or distortion. We noted 3 different patterns, including sigmoidal, converging, and diverging. The FPD units had less apparent distortion overall; however, two-thirds (66%) were off-axis in the x- and y-axes in relation to the fiducial marker. CONCLUSION: All fluoroscopy units had varying degrees and patterns of parallax/distortion. We noted less overall distortion in FPDs. However, some of these units may produce images that are off-axis. This research has important implications for improving the accuracy of intraoperative fluoroscopy. Musculoskeletal surgeons should understand the limitations of fluoroscopy and how to combat parallax distortion to improve surgical outcomes and reduce patient morbidity. LEVEL OF EVIDENCE: Level V.

Self-supervised dual-head attentional bootstrap learning network for prostate cancer screening in transrectal ultrasound images.

Current convolutional neural network-based ultrasound automatic classification models for prostate cancer often rely on extensive manual labeling. Although Self-supervised Learning (SSL) have shown promise in addressing this problem, those data that from medical scenarios contains intra-class similarity conflicts, so using loss calculations directly that include positive and negative sample pairs can mislead training. SSL method tends to focus on global consistency at the image level and does not consider the internal informative relationships of the feature map. To improve the efficiency of prostate cancer diagnosis, using SSL method to learn key diagnostic information in ultrasound images, we proposed a self-supervised dual-head attentional bootstrap learning network (SDABL), including Online-Net and Target-Net. Self-Position Attention Module (SPAM) and adaptive maximum channel attention module (CAAM) are inserted in both paths simultaneously. They captures position and inter-channel attention and of the original feature map with a small number of parameters, solve the information optimization problem of feature maps in SSL. In loss calculations, we discard the construction of negative sample pairs, and instead guide the network to learn the consistency of the location space and channel space by drawing closer to the embedding representation of positive samples continuously. We conducted numerous experiments on the prostate Transrectal ultrasound (TRUS) dataset, experiments show that our SDABL pre-training method has significant advantages over both mainstream contrast learning methods and other attention-based methods. Specifically, the SDABL pre-trained backbone achieves 80.46% accuracy on our TRUS dataset after fine-tuning.

Resolution of Virtual Depth Sectioning from Four-Dimensional Scanning Transmission Electron Microscopy.

One approach to three-dimensional structure determination using the wealth of scattering data in four-dimensional (4D) scanning transmission electron microscopy (STEM) is the parallax method proposed by Ophus et al. (2019. Advanced phase reconstruction methods enabled by 4D scanning transmission electron microscopy, Microsc Microanal25, 10-11), which determines the scattering matrix and uses it to synthesize a virtual depth-sectioning reconstruction of the sample structure. Drawing on an equivalence with a hypothetical confocal imaging mode, we derive contrast transfer and point spread functions for this parallax method applied to weakly scattering objects, showing them identical to earlier depth-sectioning STEM modes when only bright field signal is used, but that improved depth resolution is possible if dark field signal can be used. Through a simulation-based study of doped Si, we show that this depth resolution is preserved for thicker samples, explore the impact of shot noise on the parallax reconstructions, discuss challenges to making use of dark field signal, and identify cases where the interpretation of the parallax reconstruction breaks down.

How Relevant Is the Parallax Effect on Low Centered Pelvic Radiographs in Total Hip Arthroplasty.

The correct cup position in total hip arthroplasty (THA) is usually assessed on anteroposterior low centered pelvic radiographs, harboring the risk of misinterpretation due to projection of a three-dimensional geometry on a two-dimensional plane. In the current study, we evaluate the effect of this parallax effect on the cup inclination and anteversion in THA. In the course of a prospective clinical trial, 116 standardized low centered pelvic radiographs, as routinely obtained after THA, were evaluated regarding the impact of central beam deviation on the cup inclination and anteversion angles. Measurements of the horizontal and vertical beam offset with two different methods of parallax correction were compared with each other. Furthermore, the effect of parallax correction on the accuracy ofmeasuring the cup position was investigated. The mean difference between the two parallax correction methods was 0.2° ± 0.1° (from 0° to 0.4°) for the cup inclination and 0.1° ± 0.1° (from -0.1° to 0.2°) for the anteversion. For a typically intended cup position of a 45° inclination and 15° anteversion, the parallax effect led to a mean error of -1.5° ± 0.3° for the inclination and 0.6° ± 1.0° for the anteversion. Central beam deviation resulted in a projected higher cup inclination up to 3.7°, and this effect was more prominent in cups with higher anteversion. In contrast, the projected inclination decreased due to the parallax effect up to 3.2°, especially in cups with high inclination. The parallax effect on routinely obtained low centered pelvic radiographs is low and not clinically relevant due to the compensating effect of simultaneous medial and caudal central beam deviation.

Zoom disrupts eye contact behaviour: problems and solutions.

Natural, dynamic eye contact behaviour is critical to social interaction but is dysfunctional in video conferencing. In analysing the problem, I introduce the concept of directionality and emphasize the critical role of motion parallax. I then sketch approaches towards re-establishing directionality and enabling natural, dynamic eye contact in video conferences.

Effects of the Loss of Binocular and Motion Parallax on Static Postural Stability.

Depth information is important for postural stability and is generated by two visual systems: binocular and motion parallax. The effect of each type of parallax on postural stability remains unclear. We investigated the effects of binocular and motion parallax loss on static postural stability using a virtual reality (VR) system with a head-mounted display (HMD). A total of 24 healthy young adults were asked to stand still on a foam surface fixed on a force plate. They wore an HMD and faced a visual background in the VR system under four visual test conditions: normal vision (Control), absence of motion parallax (Non-MP)/binocular parallax (Non-BP), and absence of both motion and binocular parallax (Non-P). The sway area and velocity in the anteroposterior and mediolateral directions of the center-of-pressure displacements were measured. All postural stability measurements were significantly higher under the Non-MP and Non-P conditions than those under the Control and Non-BP conditions, with no significant differences in the postural stability measurements between the Control and Non-BP conditions. In conclusion, motion parallax has a more prominent effect on static postural stability than binocular parallax, which clarifies the underlying mechanisms of postural instability and informs the development of rehabilitation methods for people with visual impairments.

Data of nearby space objects using SIMBAD astronomical database.

Although SIMBAD Astronomical Database lets us write our query to extract data, there are some problems. Max record number in each query is too low. Also, repeating the name of stars in different records is a big problem. Hence, we wrote a script and executed it at different distances. Also, we wrote a program for grouping data and deleting repeated records. The article represents the distance, temperature, and Redshift of 93,060 nearby space objects, including stars, quasars, white dwarfs, and carbon stars. The objects' temperatures are between 671 and 99,575 K, and the distances of the objects are between 413.13 and 0.5 (mas). We have retrieved this information from almost 2,200,000 records. In addition, we have added two new columns for providing equivalent distances in the light year and peak frequency of the black body. All data are in a simple table in a Microsoft Access Database and a copy in the Excel. We have excluded data from space objects whose temperature doesn't exist and space objects whose Redshift is less than zero (Blueshift). The SIMBAD Astronomical Database provides the distance of the space objects using the parallax method. The advantage of choosing nearby stars is using the Parallax method for calculating the distance of the stars, which is more precise than other methods. The Parallax data help us to investigate space objects in a no-expansion universe. We can use this data in many different investigations. Finding a correlation between temperature and Redshift of stars, investigating the nature of nearby space objects with Redshift higher than 1, and investigating the origin of the Quantum Redshift in a no expansion universe using parallax distance are some useful usages of this data.

Parallax Inference for Robust Temporal Monocular Depth Estimation in Unstructured Environments.

Estimating the distance to objects is crucial for autonomous vehicles, but cost, weight or power constraints sometimes prevent the use of dedicated depth sensors. In this case, the distance has to be estimated from on-board mounted RGB cameras, which is a complex task especially for environments such as natural outdoor landscapes. In this paper, we present a new depth estimation method suitable for use in such landscapes. First, we establish a bijective relationship between depth and the visual parallax of two consecutive frames and show how to exploit it to perform motion-invariant pixel-wise depth estimation. Then, we detail our architecture which is based on a pyramidal convolutional neural network where each level refines an input parallax map estimate by using two customized cost volumes. We use these cost volumes to leverage the visual spatio-temporal constraints imposed by motion and make the network robust for varied scenes. We benchmarked our approach both in test and generalization modes on public datasets featuring synthetic camera trajectories recorded in a wide variety of outdoor scenes. Results show that our network outperforms the state of the art on these datasets, while also performing well on a standard depth estimation benchmark.

Harnessing the parallax for better spatial awareness.

Despite easy access to imaging diagnostic procedures and an abundance of spatial data, most cardiac interventions are still performed under two-dimensional fluoroscopy. Incorporating anatomical data from scans into procedures plans has the potential to improve the swiftness and outcomes of percutaneous cardiac interventions. Therefore, procedure planning based on the specific anatomy is becoming a new standard of excellence in interventional cardiology. Still, we often tend to disregard specific spatial relations and the actual direction of catheter tip movement inside the body, relying on a try and error approach. The precise spatial orientation of instruments and prosthetic devices is crucial, especially during structural heart interventions. Here, we present how deliberate movements of objects under fluoroscopy can reveal the spatial orientation of catheters and other devices. We also propose a novel "two-point rule" for identifying three-dimensional relations between points in space. Understanding and applying this rule might substantially increase the spatial awareness of operators performing cardiovascular interventions. Although the concept is pretty simple, using it "live" during interventional cardiology procedures requires thorough understanding and practice. We propose the "two-point rule" as a crucial rule to develop expertise in spatial orientation under fluoroscopy and ensure high-quality outcomes.

Corrigendum: Optical See-Through Head-Mounted Displays With Short Focal Distance: Conditions for Mitigating Parallax-Related Registration Error.

[This corrects the article DOI: 10.3389/frobt.2020.572001.].

Measuring Membrane Penetration Depths and Conformational Changes in Membrane Peptides and Proteins.

The structural organization and dynamic nature of the biomembrane components are important determinants for numerous cellular functions. Particularly, membrane proteins are critically important for various physiological functions and are important drug targets. The mechanistic insights on the complex functionality of membrane lipids and proteins can be elucidated by understanding the interplay between structure and dynamics. In this regard, membrane penetration depth represents an important parameter to obtain the precise depth of membrane-embedded molecules that often define the conformation and topology of membrane probes and proteins. In this review, we discuss about the widely used fluorescence quenching-based methods (parallax method, distribution analysis, and dual-quencher analysis) to accurately determine the membrane penetration depths of fluorescent probes that are either membrane-embedded or attached to lipids and proteins. Further, we also discuss a relatively novel fluorescence quenching method that utilizes tryptophan residue as the quencher, namely the tryptophan-induced quenching, which is sensitive to monitor small-scale conformational changes (short distances of < 15 Å) and useful in mapping distances in proteins. We have provided numerous examples for the benefit of readers to appreciate the importance and applicability of these simple yet powerful methods to study membrane proteins.

Intraoperative stitched fluoroscopic images: effect of parallax on angular measurements of the spine.

BACKGROUND CONTEXT: Intraoperative stitched O-arm images are commonplace during spinal deformity correction surgeries; however, the accuracy of stitched images for measuring angular measures is unknown. PURPOSE: To examine the effect of radiographic parallax effect of stitched O-arm images by assessing the regional curve agreement with measurements from computed tomography (CT). STUDY DESIGN/SETTING: Experimental radiographic study. PATIENT SAMPLE: Four whole body cadavers (age: 81±14, sex: 2M/2F) and two fabricated spine model phantoms from surgical cases, one with extreme scoliosis and one normal spine, were utilized. OUTCOME MEASURES: The limits of agreement for angular measures between CT (gold-standard) and intraoperative stitched fluoroscopic images were calculated. Further, intra- and inter-rater reliability was measured. METHODS: A series of adjacent anterior-posterior and lateral images were acquired cranial to caudal using an O-arm in three table configurations (standard position, off-axis in the coronal plane, and reverse Trendelenburg) and stitched manually. Regional angular measures were extracted, and the limits of agreement were calculated between each table position and CT using a Bland-Altman approach. RESULTS: The observers displayed excellent inter-rater reliability across table positions (range: 0.944-0.989) and intra-rater reliability (0.979-0.995). The limits of agreement results showed a similar and better agreement was observed for the Standard and Reverse Trendelenburg than the Off-Axis position. CONCLUSIONS: This work shows reliable regional curvature measurements can be calculated with good agreement with CT in common table positions, but care should be taken to ensure the patient is perpendicular to the X-rays, particularly in the lateral view.

Motion parallax for object localization in electric fields.

Parallax, as a visual effect, is used for depth perception of objects. But is there also the effect of parallax in the context of electric field imagery? In this work, the example of weakly electric fish is used to investigate how the self-generated electric field that these fish utilize for orientation and communication alike, may be used as a template to define electric parallax. The skin of the electric fish possesses a vast amount of electroreceptors that detect the self-emitted dipole-like electric field. In this work, the weakly electric fish is abstracted as an electric dipole with a sensor line in between the two emitters. With an analytical description of the object distortion for a uniform electric field, the distortion in a dipole-like field is simplified and simulated. On the basis of this simulation, the parallax effect could be demonstrated in electric field images i.e. by closer inspection of voltage profiles on the sensor line. Therefore, electric parallax can be defined as the relative movement of a signal feature of the voltage profile (here, the maximum or peak of the voltage profile) that travels along the sensor line peak trace (PT). The PT width correlates with the object's vertical distance to the sensor line, as close objects create a large PT and distant objects a small PT, comparable with the effect of visual motion parallax.

The role of binocular disparity and active motion parallax in cybersickness.

Cybersickness is an enduring problem for users of virtual environments. While it is generally assumed that cybersickness is caused by discrepancies in perceived self-motion between the visual and vestibular systems, little is known about the relative contribution of active motion parallax and binocular disparity to the occurrence of cybersickness. We investigated the role of these two depth cues in cybersickness by simulating a roller-coaster ride using a head-mounted display. Participants could see the tracks via a virtual frame placed at the front of the roller-coaster cart. We manipulated the state of the frame, so it behaved like: (1) a window into the virtual scene, (2) a 2D screen, (3) and (4) a window for one of the two depth cues, and a 2D screen for the other. Participants completed the Simulator Sickness Questionnaire before and after the experiment, and verbally reported their level of discomfort at repeated intervals during the ride. Additionally, participants' electrodermal activity (EDA) was recorded. The results of the questionnaire and the continuous ratings revealed the largest increase in cybersickness when the frame behaved like a window, and least increase when the frame behaved like a 2D screen. Cybersickness scores were at an intermediate level for the conditions where the frame simulated only one depth cue. This suggests that neither active motion parallax nor binocular disparity had a more prominent effect on the severity of cybersickness. The EDA responses increased at about the same rate in all conditions, suggesting that EDA is not necessarily coupled with subjectively experienced cybersickness.

Cue vetoing in depth estimation: Physical and virtual stimuli.

Motion parallax and binocular disparity contribute to the perceived depth of three-dimensional (3D) objects. However, depth is often misperceived, even when both cues are available. This may be due in part to conflicts with unmodelled cues endemic to computerized displays. Here we evaluated the impact of display-based cue conflicts on depth cue integration by comparing perceived depth for physical and virtual objects. Truncated square pyramids were rendered using Blender and 3D printed. We assessed perceived depth using a discrimination task with motion parallax, binocular disparity, and their combination. Physical stimuli were presented with precise control over position and lighting. Virtual stimuli were viewed using a head-mounted display. To generate motion parallax, observers made lateral head movements using a chin rest on a motion platform. Observers indicated if the width of the front face appeared greater or less than the distance between this surface and the base. We found that accuracy was similar for virtual and physical pyramids. All estimates were more precise when depth was defined by binocular disparity than motion parallax. Our probabilistic model shows that a linear combination model does not adequately describe performance in either physical or virtual conditions. While there was inter-observer variability in weights, performance in all conditions was best predicted by a veto model that excludes the less reliable depth cue, in this case motion parallax.

Characterization of the mid-coronal plane method for measurement of radiographic change in knee joint space width across different levels of image parallax.

OBJECTIVE: Radiographic measurement of the change in knee joint space width (ΔJSW) is often affected by image parallax, which causes an apparent exaggeration of JSW due to projectional differences. This issue with parallax (quantified by intermargin distance) can in part be addressed with a novel mid-coronal plane (MCP) measurement method. The objectives of the study were to determine 1) accuracy and 2) reproducibility of the MCP method, and 3) compare the MCP method to that used in the Osteoarthritis Initiative (OAI) for different categories of parallax. METHODS: Posteroanterior radiographs (n = 70) with known JSW were digitally reconstructed from CT images of cadaver knees and used to determine the accuracy of ΔJSW using the MCP method for parallax categories of None, Mild/Moderate, and Severe. Reproducibility was determined from pairs of clinical radiographs selected from the OAI (n = 170). The MCP method was also compared to the OAI methodology. Both reproducibility and agreement were characterized by Bland-Altman analysis and intraclass correlation coefficients (ICC). RESULTS: The MCP method was accurate to 0.11 mm in cases with no parallax, and 0.18 mm across all categories of parallax for medial and lateral compartments. Reproducibility of the MCP method was graded "excellent" (ICC 0.98, 95% CI [0.98, 0.99]). The MCP results agreed very well with the OAI (ICC 0.92, 95% CI [0.89, 0.94]), with mean absolute differences between methods increasing with increasing parallax. CONCLUSION: The MCP method is an accurate, reproducible alternative to the OAI method for multi-center clinical trials where subject and X-ray beam positioning may be variable.

Evaluation of dual-ended readout GAGG-based DOI-PET detectors with different surface treatments.

PURPOSE: Parallax error is a major issue in small animal positron emission tomography (PET) scanners which are used in preclinical studies or detailed scanning of human organs. Several methods have been proposed and investigated to reduce this radial artifact in PET images by estimating the depth of interaction (DOI) of 511-keV photons in the crystal. Among all, the dual-ended readout method seems to be very simple and effective as it does not have any fabrication and readout complications. In the past, some studies suggested that increasing the roughness of crystal lateral surfaces improves DOI resolution. In this paper, this was experimentally examined for four Ce:GAGG crystals with different surface structures. METHODS: Four 1.2 × 1.2 × 20 mm3 GAGG crystals with following surface treatment were examined: polished with optical finishing, fine grinding (using a fine surface grinding machine), fine cutting (no treatment), and coarse cutting (no treatment). These crystals were coupled individually to two SiPMs for dual-ended readout and placed in a coincidence detection circuit for electronic collimation of 511 keV incidents. The crystals were compared in terms of energy response and DOI estimation capability. RESULTS: DOI function for each crystal was extracted and FWHM DOI resolution was calculated. DOI resolution for the polished crystal varied in the range of 0.54-4.14 mm throughout the length of the crystal due to its nonlinear DOI function. The fine grinding crystal showed a linear DOI function within the dynamic range of (-0.75, 0.75), and its DOI resolution varied in the range of 1.24-1.50 mm (1.37 ± 0.13 mm DOI resolution). The fine-cut crystal had almost a linear DOI function and a wider dynamic range of (-0.85, 0.85) and therefore the best performance with 1.2 ± 0.08 mm DOI resolution. However, for the crystal with the roughest surface (coarse-cut crystal), even though the dynamic range expanded to (-0.95, 0.95), its DOI function became nonlinear resulting in 1.24 ± 0.28 mm DOI resolution. This means there is an optimum surface roughness to provide the crystal with the best DOI capability. The pulse-height spectrum measured at each depth was used as a measure to compare the energy performance of the four crystals. The photopeak of 511 keV was observed for all depths, all crystals. The photopeak position for the coarse-cut crystal had extensive depth dependency which results in poorer energy resolution unless the energy window is calibrated for each depth. This variation of photopeak for the fine-cut and fine grinding crystals was comparable with that of polished crystal. CONCLUSION: This paper reports 1.2 ± 0.08 mm FWHM DOI resolution for a fine-cut unpolished crystal. This resolution is as narrow as the crystal width, resulting in the complete elimination of parallax error in PET images. Results suggest that there is an optimum roughness for the best performance of the dual-ended method and further increase in the roughness, degrades DOI resolution. Thanks to the high light yield of GAGG, the energy performance of the fine-cut crystal is acceptable, and the depth dependency of the spectrum is negligible.

Liquid Level Detection in Standard Capacity Measures with Machine Vision.

Capacity measures are commonly used volume standards for testing measuring systems for liquids other than water. Manual readings from the measuring scale can often be difficult due to the location of the capacity measure or to the nature of the measured liquid. This article focuses on the automation of this procedure by using a single camera machine vision system. A camera positioned perpendicular to the transparent neck captures the image of the liquid meniscus and the measuring scale. The volume reading is determined with the user-defined software in the LabVIEW programming environment, which carries out the image preprocessing, detection of the scale marks and the liquid level, correction of lens distortion and parallax effects and final unit conversions. The realized measuring system for liquid level detection in standard capacity measures is tested and validated by comparing the automated measurement results with those taken by the operators. The results confirm the appropriateness of the presented measuring system for the field of legal metrology.

Motion parallax via head movements modulates visuo-motor control in pigeons.

Although it has been proposed that birds acquire visual depth cues through dynamic head movements, behavioral evidence on how birds use motion parallax depth cues caused by self-motion is lacking. This study investigated whether self-generated motion parallax modulates pecking motor control and visual size perception in pigeons (Columba livia). We trained pigeons to peck a target on a touch monitor and to classify it as small or large. To manipulate motion parallax of the target, we changed the target position on the monitor according to the bird's head position in real time using a custom-built head tracker with two cameras. Pecking motor control was affected by the manipulation of motion parallax: when the motion parallax signified the target position farther than the monitor surface, the head position just before pecking to target was near the monitor surface, and vice versa. By contrast, motion parallax did not affect how the pigeons classified target sizes, implying that motion parallax might not contribute to size constancy in pigeons. These results indicate that motion parallax via head movements modulates pecking motor control in pigeons, suggesting that head movements of pigeons have the visual function of accessing motion parallax depth cues.

Image Stitching Based on Nonrigid Warping for Urban Scene.

Image stitching based on a global alignment model is widely used in computer vision. However, the resulting stitched image may look blurry or ghosted due to parallax. To solve this problem, we propose a parallax-tolerant image stitching method based on nonrigid warping in this paper. Given a group of putative feature correspondences between overlapping images, we first use a semiparametric function fitting, which introduces a motion coherence constraint to remove outliers. Then, the input images are warped according to a nonrigid warp model based on Gaussian radial basis functions. The nonrigid warping is a kind of elastic deformation that is flexible and smooth enough to eliminate moderate parallax errors. This leads to high-precision alignment in the overlapped region. For the nonoverlapping region, we use a rigid similarity model to reduce distortion. Through effective transition, the nonrigid warping of the overlapped region and the rigid warping of the nonoverlapping region can be used jointly. Our method can obtain more accurate local alignment while maintaining the overall shape of the image. Experimental results on several challenging data sets for urban scene show that the proposed approach is better than state-of-the-art approaches in both qualitative and quantitative indicators.