Reliability and Replicability of Implicit and Explicit Reinforcement Learning Paradigms in People With Psychotic Disorders.

BACKGROUND: Motivational deficits in people with psychosis may be a result of impairments in reinforcement learning (RL). Therefore, behavioral paradigms that can accurately measure these impairments and their change over time are essential. METHODS: We examined the reliability and replicability of 2 RL paradigms (1 implicit and 1 explicit, each with positive and negative reinforcement components) given at 2 time points to healthy controls (n = 75), and people with bipolar disorder (n = 62), schizoaffective disorder (n = 60), and schizophrenia (n = 68). RESULTS: Internal consistency was acceptable (mean α = 0.78 ± 0.15), but test-retest reliability was fair to low (mean intraclass correlation = 0.33 ± 0.25) for both implicit and explicit RL. There were no clear effects of practice for these tasks. Largely, performance on these tasks shows intact implicit and impaired explicit RL in psychosis. Symptom presentation did not relate to performance in any robust way. CONCLUSIONS: Our findings replicate previous literature showing spared implicit RL and impaired explicit reinforcement in psychosis. This suggests typical basal ganglia dopamine release, but atypical recruitment of the orbitofrontal and dorsolateral prefrontal cortices. However, we found that these tasks have only fair to low test-retest reliability and thus may not be useful for assessing change over time in clinical trials.

Early- Versus Adult-Onset Schizophrenia as a Predictor of Response to Neuroscience-Informed Cognitive Training.

BACKGROUND: Developmental stages characterized by greater neural plasticity might be critical periods during which the effects of cognitive training (CT) could theoretically be maximized. However, experiencing a first episode of schizophrenia during childhood or adolescence (ie, early-onset schizophrenia [EOS]) may reduce the brain's ability to benefit from CT. This study examined the effects of EOS versus onset at > 18 years of age (ie, adult-onset schizophrenia [AOS]) as a predictor of response to CT and the relationship between duration of illness and cognitive improvements. METHODS: This study is a secondary analysis of data from 2 randomized trials that examined the cognitive effects of neuroscience-informed auditory training (AT) exercises in 84 outpatients with schizophrenia (26 EOS, 58 AOS, recruited between 2004 and 2014). RESULTS: There was a significant effect of time in all cognitive domains (F > 10.22, P < .002). The effect of EOS was significant only for verbal learning and memory (F = 5.79, P = .018). AOS increased the mean change score by 5.70 points in this domain, whereas EOS showed no change (t = -2.280, P = .025). However, the difference between AOS and EOS was no longer statistically significant after control for multiple comparisons. Shorter duration of illness was associated with greater improvement in problem solving in the AOS group (r = -0.27, P = .040). CONCLUSIONS: Auditory training is effective in improving cognition in both EOS and AOS. Treatment effects in all cognitive domains were similar, with the exception of verbal learning and memory. This result requires replication. Cognitive training provided earlier in the course of the illness results in greater improvements in executive functions. TRIAL REGISTRATION: ClinicalTrials.gov identifiers: NCT00312962, NCT00694889​​.

A multicenter study of ketamine effects on functional connectivity: Large scale network relationships, hubs and symptom mechanisms.

Ketamine is an uncompetitive N-methyl-d-aspartate (NMDA) glutamate receptor antagonist. It induces effects in healthy individuals that mimic symptoms associated with schizophrenia. We sought to root these experiences in altered brain function, specifically aberrant resting state functional connectivity (rsfMRI). In the present study, we acquired rsfMRI data under ketamine and placebo in a between-subjects design and analyzed seed-based measures of rsfMRI using large-scale networks, dorsolateral prefrontal cortex (DLPFC) and sub-nuclei of the thalamus. We found ketamine-induced alterations in rsfMRI connectivity similar to those seen in patients with schizophrenia, some changes that may be more comparable to early stages of schizophrenia, and other connectivity signatures seen in patients that ketamine did not recreate. We do not find any circuits from our regions of interest that correlates with positive symptoms of schizophrenia in our sample, although we find that DLPFC connectivity with ACC does correlate with a mood measure. These results provide support for ketamine's use as a model of certain biomarkers of schizophrenia, particularly for early or at-risk patients.

Utility of Imaging-Based Biomarkers for Glutamate-Targeted Drug Development in Psychotic Disorders: A Randomized Clinical Trial.

Importance: Despite strong theoretical rationale and preclinical evidence, several glutamate-targeted treatments for schizophrenia have failed in recent pivotal trials, prompting questions as to target validity, compound inadequacy, or lack of target engagement. A key limitation for glutamate-based treatment development is the lack of functional target-engagement biomarkers for translation between preclinical and early-stage clinical studies. We evaluated the utility of 3 potential biomarkers-ketamine-evoked changes in the functional magnetic imaging (fMRI) blood oxygen level-dependent response (pharmacoBOLD), glutamate proton magnetic resonance spectroscopy (1H MRS), and task-based fMRI-for detecting ketamine-related alterations in brain glutamate. Objective: To identify measures with sufficient effect size and cross-site reliability to serve as glutamatergic target engagement biomarkers within early-phase clinical studies. Design, Setting, and Participants: This randomized clinical trial was conducted at an academic research institution between May 2014 and October 2015 as part of the National Institute of Mental Health-funded Fast-Fail Trial for Psychotic Spectrum Disorders project. All raters were blinded to study group. Healthy volunteers aged 18 to 55 years of either sex and free of significant medical or psychiatric history were recruited from 3 sites. Data were analyzed between November 2015 and December 2016. Interventions: Volunteers received either sequential ketamine (0.23 mg/kg infusion over 1 minute followed by 0.58 mg/kg/h infusion over 30 minutes and then 0.29 mg/kg/h infusion over 29 minutes) or placebo infusions. Main Outcomes and Measures: Ketamine-induced changes in pharmacoBOLD, 1H MRS, and task-based fMRI measures, along with symptom ratings. Measures were prespecified prior to data collection. Results: Of the 65 volunteers, 41 (63%) were male, and the mean (SD) age was 31.1 (9.6) years; 59 (91%) had at least 1 valid scan. A total of 53 volunteers (82%) completed both ketamine infusions. In pharmacoBOLD, a highly robust increase (Cohen d = 5.4; P < .001) in fMRI response was observed, with a consistent response across sites. A smaller but significant signal (Cohen d = 0.64; P = .04) was also observed in 1H MRS-determined levels of glutamate+glutamine immediately following ketamine infusion. By contrast, no significant differences in task-activated fMRI responses were found between groups. Conclusions and Relevance: These findings demonstrate robust effects of ketamine on pharmacoBOLD across sites, supporting its utility for definitive assessment of functional target engagement. Other measures, while sensitive to ketamine effects, were not sufficiently robust for use as cross-site target engagement measures. Trial Registration: clinicaltrials.gov Identifier: NCT02134951.

Cognitive Control of Episodic Memory in Schizophrenia: Differential Role of Dorsolateral and Ventrolateral Prefrontal Cortex.

BACKGROUND: Dorsal (DLPFC) and ventral (VLPFC) subregions in lateral prefrontal cortex play distinct roles in episodic memory, and both are implicated in schizophrenia. We test the hypothesis that schizophrenia differentially impairs DLPFC versus VLPFC control of episodic encoding. METHODS: Cognitive control was manipulated by requiring participants to encode targets and avoid encoding non-targets based upon stimulus properties of test stimuli. The more automatic encoding response (target versus non-target) was predicted to engage VLPFC in both groups. Conversely, having to overcome the prepotent encoding response (non-targets versus targets) was predicted to produce greater DLPFC activation in controls than in patients. Encoding occurred during event-related fMRI in a sample of 21 individuals with schizophrenia and 30 healthy participants. Scanning was followed by recognition testing outside the scanner. RESULTS: Patients were less successful differentially remembering target versus non-target stimuli, and retrieval difficulties correlated with more severe disorganized symptoms. As predicted, the target versus non-target contrast activated the VLPFC and correlated with retrieval success in both groups. Conversely, the non-target versus target contrast produced greater DLPFC activation in controls than in patients, and DLPFC activation correlated with performance only in controls. CONCLUSION: Individuals with schizophrenia can successfully engage the VLPFC to provide control over semantic encoding of individual items, but are specifically impaired at engaging the DLPFC to main context for task-appropriate encoding and thereby generate improved memory for target versus non-target items. This extends previous cognitive control models based on response selection tasks to the memory domain.

Neural correlates of relational and item-specific encoding during working and long-term memory in schizophrenia.

Successful long-term memory (LTM) depends upon effective control of information in working memory (WM), and there is evidence that both WM and LTM are impaired by schizophrenia. This study tests the hypothesis that LTM deficits in schizophrenia may result from impaired control of relational processing in WM due to dorsolateral prefrontal cortex (DLPFC) dysfunction. fMRI was performed on 19 healthy controls and 20 patients with schizophrenia during WM tasks emphasizing relational (reorder trials) versus item-specific (rehearse trials) processing. WM activity was also examined with respect to LTM recognition on a task administered outside the scanner. Receiver operator characteristic analysis assessed familiarity and recollection components of LTM. Patients showed a disproportionate familiarity deficit for reorder versus rehearse trials against a background of generalized LTM impairments. Relational processing during WM led to DLPFC activation in both groups. However, this activation was less focal in patients than in controls, and patients with more severe negative symptoms showed less of a DLPFC increase. fMRI analysis of subsequent recognition performance revealed a group by condition interaction. High LTM for reorder versus rehearse trials was associated with bilateral DLPFC activation in controls, but not in patients who activated the left middle temporal and inferior occipital gyrus. Results indicate that although patients can activate the DLPFC on a structured relational WM task, this activation is less focal and does not translate to high retrieval success, suggesting a disruption in the interaction between WM and LTM processes in schizophrenia.

Relational and Item-Specific Encoding (RISE): task development and psychometric characteristics.

OBJECTIVES: The Relational and Item-Specific Encoding task (RISE) was designed to assess contributions of specific encoding and retrieval processes to episodic memory in schizophrenia. This manuscript describes how a cognitive neuroscience functional imaging paradigm was translated for clinical research. METHODS: The RISE manipulates encoding by requiring participants to decide whether stimuli are "living/nonliving" (item-specific) or whether one stimulus fits inside the other (relational) and estimates familiarity (F) and recollection (R) by examining receiver operator characteristics (ROC) and assessing item and associative recognition. Two studies examined psychometric characteristics and tested the hypothesis that patients have differential deficits in relational vs item-specific encoding and disproportionate impairments in recollection vs familiarity. RESULTS: Study 1, using visual objects, provided support for the encoding hypotheses and revealed good internal consistency and alternate forms reliability, with small differences between test forms. ROC analysis revealed R and F deficits, with F deficits most prominent following relational encoding. Study 2 used word stimuli, which lowered item recognition, but patients had difficulty understanding task demands, and words were less desirable for non-English speaking clinical trials, leading to the decision to proceed with the original task. CONCLUSIONS: The RISE is a valid and reliable measure of item-specific and relational memory that is well tolerated, with good psychometric characteristics and equivalent forms to facilitate treatment studies. Results indicate that episodic memory in schizophrenia is most preserved under conditions promoting item-specific encoding that is supported by familiarity-based recognition and is most impaired under relational encoding and recollection-based retrieval conditions.

The clinical translation of a measure of gain control: the contrast-contrast effect task.

The goal of the current project was to further develop a measure of gain control--the Contrast-Contrast Effect (CCE)--for use in clinical studies of schizophrenia. The CCE is based on an illusion in which presenting a medium contrast patch surrounded by a high-contrast patch induces individuals to perceive that center patch as having lower contrast than when the patch is presented in isolation. Thus, in the CCE, impaired gain control should lead to more accurate perceptions of the center patch. We tested 132 individuals with Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, schizophrenia or schizoaffective disorder and 130 demographically similar healthy controls. The results indicated that the CCE effect can be obtained with standard equipment, simplified scoring, and a short interstimulus interval (100 ms), revealing a robust suppression of perceived contrast of the center patch when surrounded by a high-contrast annulus. Furthermore, we found a significant reduction in the effect of the high-contrast surround among individuals with schizophrenia, though the effect size was smaller than original reported by Dakin. However, when we eliminated subjects who performed poorly on "catch" trials that controlled for off-task performance, the reduced surround effect among patients was no longer significant in the main analyses. Importantly, this suggests that at least part of the reduced surround effect (if not all) in schizophrenia could be attributable to impaired attentional mechanisms that contribute to off-task performance. Additional analyses suggested that the length of the task could be shortened without losing power to detect surround effects in healthy individuals.

CNTRICS imaging biomarkers final task selection: Long-term memory and reinforcement learning.

Functional imaging paradigms hold great promise as biomarkers for schizophrenia research as they can detect altered neural activity associated with the cognitive and emotional processing deficits that are so disabling to this patient population. In an attempt to identify the most promising functional imaging biomarkers for research on long-term memory (LTM), the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) initiative selected "item encoding and retrieval," "relational encoding and retrieval," and "reinforcement learning" as key LTM constructs to guide the nomination process. This manuscript reports on the outcome of the third CNTRICS biomarkers meeting in which nominated paradigms in each of these domains were discussed by a review panel to arrive at a consensus on which of the nominated paradigms could be recommended for immediate translational development. After briefly describing this decision process, information is presented from the nominating authors describing the 4 functional imaging paradigms that were selected for immediate development. In addition to describing the tasks, information is provided on cognitive and neural construct validity, sensitivity to behavioral or pharmacological manipulations, availability of animal models, psychometric characteristics, effects of schizophrenia, and avenues for future development.

Optimization of a goal maintenance task for use in clinical applications.

BACKGROUND: We sought to develop a Dot Pattern Expectancy task (DPX) to assess goal maintenance for use in clinical trials. Altering the standard task created 5 versions of the DPX to compare-a standard version and 4 others. Alterations in the interstimulus interval (ISI) length and the strength of a learned prepotent response distinguished the different tasks. These adjustments were designed to decrease administration time and/or improve reliability of the data. METHODS: We determined participant eligibility in an initial session (the first of 3) using clinical interviewing tools. The initial session also included a demographic assessment and assessments of community functioning and symptom severity. All versions of the DPX were administered, across 3 sessions. Specific deficits on the context processing compared with difficulty control condition were evaluated using mixed-effects logistic regression within a hierarchical linear model. RESULTS: We analyzed the data from 136 control participants and 138 participants with schizophrenia. Relative to a difficulty control condition, patients performed worse than controls on context processing conditions that required goal maintenance. ISI did not predict errors. Stronger prepotency was associated with increased errors in the difficulty control relative to context processing condition for controls, which improved the interpretability of findings for patients. Reliability was acceptable for a version of the task with a 10-minute running time. CONCLUSIONS: The best compromise between task duration and interpretability occurred on a version with a short ISI and a strong prepotency.

Use of eye movement monitoring to examine item and relational memory in schizophrenia.

BACKGROUND: Patients with schizophrenia may be impaired at remembering interitem and item-context relationships (relational memory), even when memory for items is intact. Here, we applied the novel approach of using eye movements to assess integrity of item and relational memory in schizophrenia. This method does not rely on introspection and may be more readily translated to animal models than traditional behavioral methods. METHODS: Sixteen healthy control subjects and 16 patients were administered a scene memory task while eye movements were monitored. During testing, participants indicated whether the scenes were unchanged, contained a new item (item manipulation), had a change in item location (relational manipulation), or were new. It was predicted that memory would be disproportionately impaired when relational changes were made. RESULTS: Results confirmed that tasks were equally difficult and showed that patients were impaired identifying all scene types. These behavioral impairments were associated with more severe disorganization and negative symptoms. Eye movement results were more specific. Both groups looked disproportionately at critical regions of repeated versus novel scenes-an effect of scene repetition. However, in contrast with predictions, patients showed equivalent eye-movement-based memory impairment whether changes were relational or item-based. CONCLUSIONS: This is the first experiment to demonstrate that eye movements can be used to investigate item and relational memory in schizophrenia. The eye movement procedure was well tolerated and was more specific than behavioral measures with respect to memory impairment. Results suggest that eye movements may be of use in clinical trials and translational studies employing animal models.

Prefrontal activation deficits during episodic memory in schizophrenia.

OBJECTIVE: Episodic memory impairments represent a core deficit in schizophrenia that severely limits patients' functional outcome. This quantitative meta-analysis of functional imaging studies of episodic encoding and retrieval tests the prediction that these deficits are most consistently associated with dysfunction in the prefrontal cortex. METHOD: Activation likelihood estimation (ALE) was used to perform a quantitative meta-analysis of functional imaging studies that contrasted patients with schizophrenia and healthy volunteers during episodic encoding and retrieval. From a pool of 36 potential studies, 18 whole-brain studies in standard space that included a healthy comparison sample and low-level baseline contrast were selected. RESULTS: As predicted, patients showed less prefrontal activation than comparison subjects in the frontal pole, dorsolateral and ventrolateral prefrontal cortex during encoding, and the dorsolateral prefrontal cortex and ventrolateral prefrontal cortex during retrieval. The ventrolateral prefrontal cortex encoding deficits were not present in studies that provided patients with encoding strategies, but dorsolateral prefrontal cortex deficits remained and were not secondary to group performance differences. The only medial temporal lobe finding was relatively greater patient versus comparison subject activation in the parahippocampal gyrus during encoding and retrieval. CONCLUSIONS: The finding of prominent prefrontal dysfunction suggests that cognitive control deficits strongly contribute to episodic memory impairment in schizophrenia. Memory rehabilitation approaches developed for patients with frontal lobe lesions and pharmacotherapy approaches designed to improve prefrontal cortex function may therefore hold special promise for remediating memory deficits in patients with schizophrenia.

CNTRICS final task selection: long-term memory.

Long-term memory (LTM) is a multifactorial construct, composed of different stages of information processing and different cognitive operations that are mediated by distinct neural systems, some of which may be more responsible for the marked memory problems that limit the daily function of individuals with schizophrenia. From the outset of the CNTRICS initiative, this multidimensionality was appreciated, and an effort was made to identify the specific memory constructs and task paradigms that hold the most promise for immediate translational development. During the second CNTRICS meeting, the LTM group identified item encoding and retrieval and relational encoding and retrieval as key constructs. This article describes the process that the LTM group went through in the third and final CNTRICS meeting to select nominated tasks within the 2 LTM constructs and within a reinforcement learning construct that were judged most promising for immediate development. This discussion is followed by each nominating authors' description of their selected task paradigm, ending with some thoughts about future directions.

Patient attitudes towards surgically implantable, long-term delivery of psychiatric medicine.

The introduction of surgically implantable medication delivery systems provides psychiatric patients with reversible, uninterrupted access to medication for up to 14 months. This study designed and administered a survey to assess patients' attitudes and beliefs towards illness, medication, and this potential new treatment method. The survey included questions about demographics, insight and attitudes towards illness, current and past medication adherence, attitudes towards psychiatric and nonpsychiatric medications, and understanding and attitudes towards surgical implants. The sample of 206 psychiatric patients was almost equally split between favorably and unfavorably considering implants. Patients favorable towards implants ascribed forgetting and failure to refill medication on time as the reasons for missing doses, recognized the benefits of medication in general, and understood that the implant would be inserted under the skin. Favorable consideration of implants was positively correlated with the desire to avoid adverse consequences of missing medicine, stay well, avoid the need for daily oral medications, and decrease family burden. Unfavorable consideration of implants was related to a preference to take medication orally, concern about feeling controlled, unwillingness to try something new, and not understanding that the implant would be placed under the skin. Demographic variables, past/current medications, specific diagnosis, and illness severity did not influence the decision. This survey elucidates patients' attitudes and beliefs towards illness, medication, and surgical implants. The results indicate that a significant proportion of patients recognize the difficulties of medication adherence and the need for better methods to attain therapeutic response. Thus, the study provides impetus for future work in this area.