Reproducible Tract Profiles 2 (RTP2) suite, from diffusion MRI acquisition to clinical practice and research.

Diffusion MRI is a complex technique, where new discoveries and implementations occur at a fast pace. The expertise needed for data analyses and accurate and reproducible results is increasingly demanding and requires multidisciplinary collaborations. In the present work we introduce Reproducible Tract Profiles 2 (RTP2), a set of flexible and automated methods to analyze anatomical MRI and diffusion weighted imaging (DWI) data for reproducible tractography. RTP2 reads structural MRI data and processes them through a succession of serialized containerized analyses. We describe the DWI algorithms used to identify white-matter tracts and their summary metrics, the flexible architecture of the platform, and the tools to programmatically access and control the computations. The combination of these three components provides an easy-to-use automatized tool developed and tested over 20 years, to obtain usable and reliable state-of-the-art diffusion metrics at the individual and group levels for basic research and clinical practice.

Measuring brain beats: Cardiac-aligned fast functional magnetic resonance imaging signals.

Blood and cerebrospinal fluid (CSF) pulse and flow throughout the brain, driven by the cardiac cycle. These fluid dynamics, which are essential to healthy brain function, are characterized by several noninvasive magnetic resonance imaging (MRI) methods. Recent developments in fast MRI, specifically simultaneous multislice acquisition methods, provide a new opportunity to rapidly and broadly assess cardiac-driven flow, including CSF spaces, surface vessels and parenchymal vessels. We use these techniques to assess blood and CSF flow dynamics in brief (3.5 min) scans on a conventional 3 T MRI scanner in five subjects. Cardiac pulses are measured with a photoplethysmography (PPG) on the index finger, along with functional MRI (fMRI) signals in the brain. We, retrospectively, align the fMRI signals to the heartbeat. Highly reliable cardiac-gated fMRI temporal signals are observed in CSF and blood on the timescale of one heartbeat (test-retest reliability within subjects R2  > 50%). In blood vessels, a local minimum is observed following systole. In CSF spaces, the ventricles and subarachnoid spaces have a local maximum following systole instead. Slower resting-state scans with slice timing, retrospectively, aligned to the cardiac pulse, reveal similar cardiac-gated responses. The cardiac-gated measurements estimate the amplitude and phase of fMRI pulsations in the CSF relative to those in the arteries, an estimate of the local intracranial impedance. Cardiac aligned fMRI signals can provide new insights about fluid dynamics or diagnostics for diseases where these dynamics are important.

Visual encoding: Principles and software.

For more than two centuries scientists and engineers have worked to understand and model how the eye encodes electromagnetic radiation (light). We now understand the principles of how light is transmitted through the optics of the eye and encoded by retinal photoreceptors and light-sensitive neurons. In recent years, new instrumentation has enabled scientists to measure the specific parameters of the optics and photoreceptor encoding. We implemented the principles and parameter estimates that characterize the human eye in an open-source software toolbox. This chapter describes the principles behind these tools and illustrates how to use them to compute the initial visual encoding.

Population Receptive Field Shapes in Early Visual Cortex Are Nearly Circular.

The visual field region where a stimulus evokes a neural response is called the receptive field (RF). Analytical tools combined with functional MRI (fMRI) can estimate the RF of the population of neurons within a voxel. Circular population RF (pRF) methods accurately specify the central position of the pRF and provide some information about the spatial extent (diameter) of the RF. A number of investigators developed methods to further estimate the shape of the pRF, for example, whether the shape is more circular or elliptical. There is a report that there are many pRFs with highly elliptical pRFs in early visual cortex (V1-V3; Silson et al., 2018). Large aspect ratios (>2) are difficult to reconcile with the spatial scale of orientation columns or visual field map properties in early visual cortex. We started to replicate the experiments and found that the software used in the publication does not accurately estimate RF shape: it produces elliptical fits to circular ground-truth data. We analyzed an independent data set with a different software package that was validated over a specific range of measurement conditions, to show that in early visual cortex the aspect ratios are <2. Furthermore, current empirical and theoretical methods do not have enough precision to discriminate ellipses with aspect ratios of 1.5 from circles. Through simulation we identify methods for improving sensitivity that may estimate ellipses with smaller aspect ratios. The results we present are quantitatively consistent with prior assessments using other methodologies.SIGNIFICANCE STATEMENT We evaluated whether the shape of many population receptive fields (RFs) in early visual cortex is elliptical and differs substantially from circular. We evaluated two tools for estimating elliptical models of the pRF; one tool was valid over the measured compliance range. Using the validated tool, we found no evidence that confidently rejects circular fits to the pRF in visual field maps V1, V2, and V3. The new measurements and analyses are consistent with prior theoretical and experimental assessments in the literature.

V1 Projection Zone Signals in Human Macular Degeneration Depend on Task Despite Absence of Visual Stimulus.

Identifying the plastic and stable components of the visual cortex after retinal loss is an important topic in visual neuroscience and neuro-ophthalmology.1-5 Humans with juvenile macular degeneration (JMD) show significant blood-oxygen-level-dependent (BOLD) responses in the primary visual area (V1) lesion projection zone (LPZ),6 despite the absence of the feedforward signals from the degenerated retina. Our previous study7 reported that V1 LPZ responds to full-field visual stimuli during the one-back task (OBT), not during passive viewing, suggesting the involvement of task-related feedback signals. Aiming to clarify whether visual inputs to the intact retina are necessary for the LPZ responses, here, we measured BOLD responses to tactile and auditory stimuli for both JMD patients and control participants with and without OBT. Participants were instructed to close their eyes during the experiment for the purpose of eliminating retinal inputs. Without OBT, no V1 responses were detected in both groups of participants. With OBT, to the contrary, both stimuli caused substantial V1 responses in JMD patients, but not controls. Furthermore, we also found that the task-dependent activity in V1 LPZ became less pronounced when JMD patients opened their eyes, suggesting that task-related feedback signals can be partially suppressed by residual feedforward signals. Modality-independent V1 LPZ responses only in the task condition suggest that V1 LPZ responses reflect task-related feedback signals rather than reorganized feedforward visual inputs.

Data-science ready, multisite, human diffusion MRI white-matter-tract statistics.

The white matter tracts in the living human brain are critical for healthy function, and the diffusion MRI measured in these tracts is correlated with diverse behavioral measures. The technical skills required to analyze diffusion MRI data are complex: data acquisition requires MRI sequence development and acquisition expertise, analyzing raw-data into meaningful summary statistics requires computational neuroimaging and neuroanatomy expertise. The human white matter study field will advance faster if the tract summaries are available in plain data-science-ready format for non-diffusion MRI experts, such as statisticians, computer graphic researchers or data scientists in general. Here, we share a curated and processed dataset from three different MRI centers in a format that is data-science ready. The multisite data we share include measures of within and between MRI center variation in white-matter-tract diffusion measurements. Along with the dataset description and summary statistics, we describe the state-of-the-art computational system that guarantees reproducibility and provenance from the original scanner output.

A computational observer model of spatial contrast sensitivity: Effects of photocurrent encoding, fixational eye movements, and inference engine.

We have recently shown that the relative spatial contrast sensitivity function (CSF) of a computational observer operating on the cone mosaic photopigment excitations of a stationary retina has the same shape as human subjects. Absolute human sensitivity, however, is 5- to 10-fold lower than the computational observer. Here we model how additional known features of early vision affect the CSF: fixational eye movements and the conversion of cone photopigment excitations to cone photocurrents (phototransduction). For a computational observer that uses a linear classifier applied to the responses of a stimulus-matched linear filter, fixational eye movements substantially change the shape of the CSF by reducing sensitivity above 10 c/deg. For a translation-invariant computational observer that operates on the squared response of a quadrature-pair of linear filters, the CSF shape is little changed by eye movements, but there is a two fold reduction in sensitivity. Phototransduction dynamics introduce an additional two fold sensitivity decrease. Hence, the combined effects of fixational eye movements and phototransduction bring the absolute CSF of the translation-invariant computational observer to within a factor of 1 to 2 of the human CSF. We note that the human CSF depends on processing of the retinal representation by many thalamo-cortical neurons, which are individually quite noisy. Our modeling suggests that the net effect of post-retinal noise on contrast-detection performance, when considered at the neural population and behavioral level, is quite small: The inference mechanisms that determine the CSF, presumably in cortex, make efficient use of the information carried by the cone photocurrents of the fixating eye.

A validation framework for neuroimaging software: The case of population receptive fields.

Neuroimaging software methods are complex, making it a near certainty that some implementations will contain errors. Modern computational techniques (i.e., public code and data repositories, continuous integration, containerization) enable the reproducibility of the analyses and reduce coding errors, but they do not guarantee the scientific validity of the results. It is difficult, nay impossible, for researchers to check the accuracy of software by reading the source code; ground truth test datasets are needed. Computational reproducibility means providing software so that for the same input anyone obtains the same result, right or wrong. Computational validity means obtaining the right result for the ground-truth test data. We describe a framework for validating and sharing software implementations, and we illustrate its usage with an example application: population receptive field (pRF) methods for functional MRI data. The framework is composed of three main components implemented with containerization methods to guarantee computational reproducibility. In our example pRF application, those components are: (1) synthesis of fMRI time series from ground-truth pRF parameters, (2) implementation of four public pRF analysis tools and standardization of inputs and outputs, and (3) report creation to compare the results with the ground truth parameters. The framework was useful in identifying realistic conditions that lead to imperfect parameter recovery in all four pRF implementations, that would remain undetected using classic validation methods. We provide means to mitigate these problems in future experiments. A computational validation framework supports scientific rigor and creativity, as opposed to the oft-repeated suggestion that investigators rely upon a few agreed upon packages. We hope that the framework will be helpful to validate other critical neuroimaging algorithms, as having a validation framework helps (1) developers to build new software, (2) research scientists to verify the software's accuracy, and (3) reviewers to evaluate the methods used in publications and grants.

The human connectome project for disordered emotional states: Protocol and rationale for a research domain criteria study of brain connectivity in young adult anxiety and depression.

Through the Human Connectome Project (HCP) our understanding of the functional connectome of the healthy brain has been dramatically accelerated. Given the pressing public health need, we must increase our understanding of how connectome dysfunctions give rise to disordered mental states. Mental disorders arising from high levels of negative emotion or from the loss of positive emotional experience affect over 400 million people globally. Such states of disordered emotion cut across multiple diagnostic categories of mood and anxiety disorders and are compounded by accompanying disruptions in cognitive function. Not surprisingly, these forms of psychopathology are the leading cause of disability worldwide. The Research Domain Criteria (RDoC) initiative spearheaded by NIMH offers a framework for characterizing the relations among connectome dysfunctions, anchored in neural circuits and phenotypic profiles of behavior and self-reported symptoms. Here, we report on our Connectomes Related to Human Disease protocol for integrating an RDoC framework with HCP protocols to characterize connectome dysfunctions in disordered emotional states, and present quality control data from a representative sample of participants. We focus on three RDoC domains and constructs most relevant to depression and anxiety: 1) loss and acute threat within the Negative Valence System (NVS) domain; 2) reward valuation and responsiveness within the Positive Valence System (PVS) domain; and 3) working memory and cognitive control within the Cognitive System (CS) domain. For 29 healthy controls, we present preliminary imaging data: functional magnetic resonance imaging collected in the resting state and in tasks matching our constructs of interest ("Emotion", "Gambling" and "Continuous Performance" tasks), as well as diffusion-weighted imaging. All functional scans demonstrated good signal-to-noise ratio. Established neural networks were robustly identified in the resting state condition by independent component analysis. Processing of negative emotional faces significantly activated the bilateral dorsolateral prefrontal and occipital cortices, fusiform gyrus and amygdalae. Reward elicited a response in the bilateral dorsolateral prefrontal, parietal and occipital cortices, and in the striatum. Working memory was associated with activation in the dorsolateral prefrontal, parietal, motor, temporal and insular cortices, in the striatum and cerebellum. Diffusion tractography showed consistent profiles of fractional anisotropy along known white matter tracts. We also show that results are comparable to those in a matched sample from the HCP Healthy Young Adult data release. These preliminary data provide the foundation for acquisition of 250 subjects who are experiencing disordered emotional states. When complete, these data will be used to develop a neurobiological model that maps connectome dysfunctions to specific behaviors and symptoms.

Ray tracing 3D spectral scenes through human optics models.

Scientists and engineers have created computations and made measurements that characterize the first steps of seeing. ISETBio software integrates such computations and data into an open-source software package. The initial ISETBio implementations modeled image formation (physiological optics) for planar or distant scenes. The ISET3d software described here extends that implementation, simulating image formation for three-dimensional scenes. The software system relies on a quantitative computer graphics program that ray traces the scene radiance through the physiological optics to the retinal irradiance. We describe and validate the implementation for several model eyes. Then, we use the software to quantify the impact of several physiological optics parameters on three-dimensional image formation. ISET3d is integrated with ISETBio, making it straightforward to convert the retinal irradiance into cone excitations. These methods help the user compute the predictions of optics models for a wide range of spatially rich three-dimensional scenes. They can also be used to evaluate the impact of nearby visual occlusion, the information available to binocular vision, or the retinal images expected from near-field and augmented reality displays.

Computational-observer analysis of illumination discrimination.

The spectral properties of the ambient illumination provide useful information about time of day and weather. We study the perceptual representation of illumination by analyzing measurements of how well people discriminate between illuminations across scene configurations. More specifically, we compare human performance to a computational-observer analysis that evaluates the information available in the isomerizations of cone photopigment in a model human photoreceptor mosaic. The performance of such an observer is limited by the Poisson variability of the number of isomerizations in each cone. The overall level of Poisson-limited computational-observer sensitivity exceeded that of human observers. This was modeled by increasing the amount of noise in the number of isomerizations of each cone. The additional noise brought the overall level of performance of the computational observer into the same range as that of human observers, allowing us to compare the pattern of sensitivity across stimulus manipulations. Key patterns of human performance were not accounted for by the computational observer. In particular, neither the elevation of illumination-discrimination thresholds for illuminant changes in a blue color direction (when thresholds are expressed in CIELUV ΔE units), nor the effects of varying the ensemble of surfaces in the scenes being viewed, could be accounted for by variation in the information available in the cone isomerizations.

A Conversation with Jacob Nachmias.

We are sad to report that Professor Jacob (Jack) Nachmias passed away on March 2, 2019. Nachmias was born in Athens, Greece, on June 9, 1928. To escape the Nazis, he and his family came to the United States in 1939. He received his undergraduate degree from Cornell University and then an MA from Swarthmore College, where he worked with Hans Wallach and Wolfgang Kohler; his PhD in Psychology was from Harvard University. Nachmias spent the majority of his career as a Professor of Psychology at the University of Pennsylvania. He made fundamental contributions to our understanding of vision, most notably through the study of eye movements, the development of signal detection theory and forced-choice psychophysical methods, and the psychophysical characterization of spatial-frequency-selective visual channels. Nachmias' work was recognized by his election to the National Academy of Sciences and receipt of the Optical Society's Tillyer Award.

Replication and generalization in applied neuroimaging.

There is much interest in translating neuroimaging findings into meaningful clinical diagnostics. The goal of scientific discoveries differs from clinical diagnostics. Scientific discoveries must replicate under a specific set of conditions; to translate to the clinic we must show that findings using purpose-built scientific instruments will be observable in clinical populations and instruments. Here we describe and evaluate data and computational methods designed to translate a scientific observation to a clinical setting. Using diffusion weighted imaging (DWI), Wahl et al. (2010) observed that across subjects the mean fractional anisotropy (FA) of homologous pairs of tracts is highly correlated. We hypothesize that this is a fundamental biological trait that should be present in most healthy participants, and deviations from this assessment may be a useful diagnostic metric. Using this metric as an illustration of our methods, we analyzed six pairs of homologous white matter tracts in nine different DWI datasets with 44 subjects each. Considering the original FA measurement as a baseline, we show that the new metric is between 2 and 4 times more precise when used in a clinical context. Our framework to translate research findings into clinical practice can be applied, in principle, to other neuroimaging results.

A computational-observer model of spatial contrast sensitivity: Effects of wave-front-based optics, cone-mosaic structure, and inference engine.

We present a computational-observer model of the human spatial contrast-sensitivity function based on the Image Systems Engineering Toolbox for Biology (ISETBio) simulation framework. We demonstrate that ISETBio-derived contrast-sensitivity functions agree well with ones derived using traditional ideal-observer approaches, when the mosaic, optics, and inference engine are matched. Further simulations extend earlier work by considering more realistic cone mosaics, more recent measurements of human physiological optics, and the effect of varying the inference engine used to link visual representations to psychophysical performance. Relative to earlier calculations, our simulations show that the spatial structure of realistic cone mosaics reduces the upper bounds on performance at low spatial frequencies, whereas realistic optics derived from modern wave-front measurements lead to increased upper bounds at high spatial frequencies. Finally, we demonstrate that the type of inference engine used has a substantial effect on the absolute level of predicted performance. Indeed, the performance gap between an ideal observer with exact knowledge of the relevant signals and human observers is greatly reduced when the inference engine has to learn aspects of the visual task. ISETBio-derived estimates of stimulus representations at various stages along the visual pathway provide a powerful tool for computing the limits of human performance.

Simulation of visual perception and learning with a retinal prosthesis.

OBJECTIVE: The nature of artificial vision with a retinal prosthesis, and the degree to which the brain can adapt to the unnatural input from such a device, are poorly understood. Therefore, the development of current and future devices may be aided by theory and simulations that help to infer and understand what prosthesis patients see. APPROACH: A biologically-informed, extensible computational framework is presented here to predict visual perception and the potential effect of learning with a subretinal prosthesis. The framework relies on optimal linear reconstruction of the stimulus from retinal responses to infer the visual information available to the patient. A simulation of the physiological optics of the eye and light responses of the major retinal neurons was used to calculate the optimal linear transformation for reconstructing natural images from retinal activity. The result was then used to reconstruct the visual stimulus during the artificial activation expected from a subretinal prosthesis in a degenerated retina, as a proxy for inferred visual perception. MAIN RESULTS: Several simple observations reveal the potential utility of such a simulation framework. The inferred perception obtained with prosthesis activation was substantially degraded compared to the inferred perception obtained with normal retinal responses, as expected given the limited resolution and lack of cell type specificity of the prosthesis. Consistent with clinical findings and the importance of cell type specificity, reconstruction using only ON cells, and not OFF cells, was substantially more accurate. Finally, when reconstruction was re-optimized for prosthesis stimulation, simulating the greatest potential for learning by the patient, the accuracy of inferred perception was much closer to that of healthy vision. SIGNIFICANCE: The reconstruction approach thus provides a more complete method for exploring the potential for treating blindness with retinal prostheses than has been available previously. It may also be useful for interpreting patient data in clinical trials, and for improving prosthesis design.

Diagnosing the Neural Circuitry of Reading.

We summarize the current state of knowledge of the brain's reading circuits, and then we describe opportunities to use quantitative and reproducible methods for diagnosing these circuits. Neural circuit diagnostics-by which we mean identifying the locations and responses in an individual that differ significantly from measurements in good readers-can help parents and educators select the best remediation strategy. A sustained effort to develop and share diagnostic methods can support the societal goal of improving literacy.

Learning the Image Processing Pipeline.

Many creative ideas are being proposed for image sensor designs, and these may be useful in applications ranging from consumer photography to computer vision. To understand and evaluate each new design, we must create a corresponding image processing pipeline that transforms the sensor data into a form, that is appropriate for the application. The need to design and optimize these pipelines is time-consuming and costly. We explain a method that combines machine learning and image systems simulation that automates the pipeline design. The approach is based on a new way of thinking of the image processing pipeline as a large collection of local linear filters. We illustrate how the method has been used to design pipelines for novel sensor architectures in consumer photography applications.

Occipital White Matter Tracts in Human and Macaque.

We compare several major white-matter tracts in human and macaque occipital lobe using diffusion magnetic resonance imaging. The comparison suggests similarities but also significant differences in the tracts. There are several apparently homologous tracts in the 2 species, including the vertical occipital fasciculus (VOF), optic radiation, forceps major, and inferior longitudinal fasciculus (ILF). There is one large human tract, the inferior fronto-occipital fasciculus, with no corresponding fasciculus in macaque. We could identify the macaque VOF (mVOF), which has been little studied. Its position is consistent with classical invasive anatomical studies by Wernicke. VOF homology is supported by similarity of the endpoints in V3A and ventral V4 across species. The mVOF fibers intertwine with the dorsal segment of the ILF, but the human VOF appears to be lateral to the ILF. These similarities and differences between the occipital lobe tracts will be useful in establishing which circuitry in the macaque can serve as an accurate model for human visual cortex.

In vivo evidence of functional and anatomical stripe-based subdivisions in human V2 and V3.

Visual cortex contains a hierarchy of visual areas. The earliest cortical area (V1) contains neurons responding to colour, form and motion. Later areas specialize on processing of specific features. The second visual area (V2) in non-human primates contains a stripe-based anatomical organization, initially defined using cytochrome-oxidase staining of post-mortem tissue. Neurons in these stripes have been proposed to serve distinct functional specializations, e.g. processing of color, form and motion. These stripes represent an intermediate stage in visual hierarchy and serve a key role in the increasing functional specialization of visual areas. Using sub-millimeter high-field functional and anatomical MRI (7T), we provide in vivo evidence for stripe-based subdivisions in humans. Using functional MRI, we contrasted responses elicited by stimuli alternating at slow and fast temporal frequencies. We revealed stripe-based subdivisions in V2 ending at the V1/V2 border. The human stripes reach into V3. Using anatomical MRI optimized for myelin contrast within gray matter, we also observe a stripe pattern. Stripe subdivisions preferentially responding to fast temporal frequencies are more myelinated. As such, functional and anatomical measures provide independent and converging evidence for functional organization into striped-based subdivisions in human V2 and V3.