High frequency oscillations in human memory and cognition: a neurophysiological substrate of engrams?

Despite advances in understanding the cellular and molecular processes underlying memory and cognition, and recent successful modulation of cognitive performance in brain disorders, the neurophysiological mechanisms remain underexplored. High frequency oscillations beyond the classic electroencephalogram spectrum have emerged as a potential neural correlate of fundamental cognitive processes. High frequency oscillations are detected in the human mesial temporal lobe and neocortical intracranial recordings spanning gamma/epsilon (60-150 Hz), ripple (80-250 Hz) and higher frequency ranges. Separate from other non-oscillatory activities, these brief electrophysiological oscillations of distinct duration, frequency and amplitude are thought to be generated by coordinated spiking of neuronal ensembles within volumes as small as a single cortical column. Although the exact origins, mechanisms, and physiological roles in health and disease remain elusive, they have been associated with human memory consolidation and cognitive processing. Recent studies suggest their involvement in encoding and recall of episodic memory with a possible role in the formation and reactivation of memory traces. High frequency oscillations are detected during encoding, throughout maintenance, and right before recall of remembered items, meeting a basic definition for an engram activity. The temporal coordination of high frequency oscillations reactivated across cortical and subcortical neural networks is ideally suited for integrating multimodal memory representations, which can be replayed and consolidated during states of wakefulness and sleep. High frequency oscillations have been shown to reflect coordinated bursts of neuronal assembly firing and offer a promising substrate for tracking and modulation of the hypothetical electrophysiological engram.

Distinct hippocampal-prefrontal neural assemblies coordinate memory encoding, maintenance, and recall.

Short-term memory enables incorporation of recent experience into subsequent decision-making. This processing recruits both the prefrontal cortex and hippocampus, where neurons encode task cues, rules, and outcomes. However, precisely which information is carried when, and by which neurons, remains unclear. Using population decoding of activity in rat medial prefrontal cortex (mPFC) and dorsal hippocampal CA1, we confirm that mPFC populations lead in maintaining sample information across delays of an operant non-match to sample task, despite individual neurons firing only transiently. During sample encoding, distinct mPFC subpopulations joined distributed CA1-mPFC cell assemblies hallmarked by 4-5 Hz rhythmic modulation; CA1-mPFC assemblies re-emerged during choice episodes but were not 4-5 Hz modulated. Delay-dependent errors arose when attenuated rhythmic assembly activity heralded collapse of sustained mPFC encoding. Our results map component processes of memory-guided decisions onto heterogeneous CA1-mPFC subpopulations and the dynamics of physiologically distinct, distributed cell assemblies.

Direct electrical brain stimulation of human memory: lessons learnt and future perspectives.

Modulation of cognitive functions supporting human declarative memory is one of the grand challenges of neuroscience, and of vast importance for a variety of neuropsychiatric, neurodegenerative and neurodevelopmental diseases. Despite a recent surge of successful attempts at improving performance in a range of memory tasks, the optimal approaches and parameters for memory enhancement have yet to be determined. On a more fundamental level, it remains elusive as to how delivering electrical current in a given brain area leads to enhanced memory processing. Starting from the local and distal physiological effects on neural populations, the mechanisms of enhanced memory encoding, maintenance, consolidation or recall in response to direct electrical stimulation are only now being unravelled. With the advent of innovative neurotechnologies for concurrent recording and stimulation intracranially in the human brain, it becomes possible to study both acute and chronic effects of stimulation on memory performance and the underlying neural activities. In this review, we summarize the effects of various invasive stimulation approaches for modulating memory functions. We first outline the challenges that were faced in the initial studies of memory enhancement and the lessons learnt. Electrophysiological biomarkers are then reviewed as more objective measures of the stimulation effects than behavioural outcomes. Finally, we classify the various stimulation approaches into continuous and phasic modulation with an open or closed loop for responsive stimulation based on analysis of the recorded neural activities. Although the potential advantage of closed-loop responsive stimulation over the classic open-loop approaches is inconclusive, we foresee the emerging results from ongoing longitudinal studies and clinical trials will shed light on both the mechanisms and optimal strategies for improving declarative memory. Adaptive stimulation based on the biomarker analysis over extended periods of time is proposed as a future direction for obtaining lasting effects on memory functions. Chronic tracking and modulation of neural activities intracranially through adaptive stimulation opens tantalizing new avenues to continually monitor and treat memory and cognitive deficits in a range of brain disorders. Brain co-processors created with machine-learning tools and wireless bi-directional connectivity to seamlessly integrate implanted devices with smartphones and cloud computing are poised to enable real-time automated analysis of large data volumes and adaptively tune electrical stimulation based on electrophysiological biomarkers of behavioural states. Next-generation implantable devices for high-density recording and stimulation of electrophysiological activities, and technologies for distributed brain-computer interfaces are presented as selected future perspectives for modulating human memory and associated mental processes.

Hotspot of human verbal memory encoding in the left anterior prefrontal cortex.

BACKGROUND: Treating memory and cognitive deficits requires knowledge about anatomical sites and neural activities to be targeted with particular therapies. Emerging technologies for local brain stimulation offer attractive therapeutic options but need to be applied to target specific neural activities, at distinct times, and in specific brain regions that are critical for memory formation. METHODS: The areas that are critical for successful encoding of verbal memory as well as the underlying neural activities were determined directly in the human brain with intracranial electrophysiological recordings in epilepsy patients. We recorded a broad range of spectral activities across the cortex of 135 patients as they memorised word lists for subsequent free recall. FINDINGS: The greatest differences in the spectral power between encoding subsequently recalled and forgotten words were found in low theta frequency (3-5 Hz) activities of the left anterior prefrontal cortex. This subsequent memory effect was proportionally greater in the lower frequency bands and in the more anterior cortical regions. We found the peak of this memory signal in a distinct part of the prefrontal cortex at the junction between the Broca's area and the frontal pole. The memory effect in this confined area was significantly higher (Tukey-Kramer test, p<0.05) than in other anatomically distinct areas. INTERPRETATION: Our results suggest a focal hotspot of human verbal memory encoding located in the higher-order processing region of the prefrontal cortex, which presents a prospective target for modulating cognitive functions in the human patients. The memory effect provides an electrophysiological biomarker of low frequency neural activities, at distinct times of memory encoding, and in one hotspot location in the human brain. FUNDING: Open-access datasets were originally collected as part of a BRAIN Initiative project called Restoring Active Memory (RAM) funded by the Defence Advanced Research Project Agency (DARPA). CT, ML, MTK and this research were supported from the First Team grant of the Foundation for Polish Science co-financed by the European Union under the European Regional Development Fund.

Cognitive neuroscience: Theta network oscillations coordinate development of episodic memory.

Our ability to remember life events matures through childhood and adolescence. A new study has revealed how theta oscillations between two anatomical brain regions supporting memory and executive functions are synchronized and develop across age through functional and structural connectivity.

CyberEye: New Eye-Tracking Interfaces for Assessment and Modulation of Cognitive Functions beyond the Brain.

The emergence of innovative neurotechnologies in global brain projects has accelerated research and clinical applications of BCIs beyond sensory and motor functions. Both invasive and noninvasive sensors are developed to interface with cognitive functions engaged in thinking, communication, or remembering. The detection of eye movements by a camera offers a particularly attractive external sensor for computer interfaces to monitor, assess, and control these higher brain functions without acquiring signals from the brain. Features of gaze position and pupil dilation can be effectively used to track our attention in healthy mental processes, to enable interaction in disorders of consciousness, or to even predict memory performance in various brain diseases. In this perspective article, we propose the term 'CyberEye' to encompass emerging cognitive applications of eye-tracking interfaces for neuroscience research, clinical practice, and the biomedical industry. As CyberEye technologies continue to develop, we expect BCIs to become less dependent on brain activities, to be less invasive, and to thus be more applicable.

Independent dynamics of low, intermediate, and high frequency spectral intracranial EEG activities during human memory formation.

A wide spectrum of brain rhythms are engaged throughout the human cortex in cognitive functions. How the rhythms of various frequency ranges are coordinated across the space of the human cortex and time of memory processing is inconclusive. They can either be coordinated together across the frequency spectrum at the same cortical site and time or induced independently in particular bands. We used a large dataset of human intracranial electroencephalography (iEEG) to parse the spatiotemporal dynamics of spectral activities induced during formation of verbal memories. Encoding of words for subsequent free recall activated low frequency theta, intermediate frequency alpha and beta, and high frequency gamma power in a mosaic pattern of discrete cortical sites. A majority of the cortical sites recorded activity in only one of these frequencies, except for the visual cortex where spectral power was induced across multiple bands. Each frequency band showed characteristic dynamics of the induced power specific to cortical area and hemisphere. The power of the low, intermediate, and high frequency activities propagated in independent sequences across the visual, temporal and prefrontal cortical areas throughout subsequent phases of memory encoding. Our results provide a holistic, simplified model of the spectral activities engaged in the formation of human memory, suggesting an anatomically and temporally distributed mosaic of coordinated brain rhythms.

Contribution of Ictal Source Imaging for Localizing Seizure Onset Zone in Patients With Focal Epilepsy.

OBJECTIVE: To determine whether seizure onset zone (SOZ) can be localized accurately prior to surgical planning in patients with focal epilepsy, we performed noninvasive EEG recordings and source localization analyses on 39 patients. METHODS: In 39 patients with focal epilepsy, we recorded and extracted 138 seizures and 1,325 interictal epileptic discharges using high-density EEG. We investigated a novel approach for directly imaging sources of seizures and interictal spikes from high-density EEG recordings, and rigorously validated it for noninvasive localization of SOZ determined from intracranial EEG findings and surgical resection volume. Conventional source imaging analyses were also performed for comparison. RESULTS: Ictal source imaging showed a concordance rate of 95% when compared to intracranial EEG or resection results. The average distance from estimation to seizure onset (intracranial) electrodes is 1.35 cm in patients with concordant results, and 0.74 cm to surgical resection boundary in patients with successful surgery. About 41% of the patients were found to have multiple types of interictal activities; coincidentally, a lower concordance rate and a significantly worse performance in localizing SOZ were observed in these patients. CONCLUSION: Noninvasive ictal source imaging with high-density EEG recording can provide highly concordant results with clinical decisions obtained by invasive monitoring or confirmed by resective surgery. By means of direct seizure imaging using high-density scalp EEG recordings, the added value of ictal source imaging is particularly high in patients with complex interictal activity patterns, who may represent the most challenging cases with poor prognosis.

Author Correction: Pupil size reflects successful encoding and recall of memory in humans.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Unsupervised machine-learning classification of electrophysiologically active electrodes during human cognitive task performance.

Identification of active electrodes that record task-relevant neurophysiological activity is needed for clinical and industrial applications as well as for investigating brain functions. We developed an unsupervised, fully automated approach to classify active electrodes showing event-related intracranial EEG (iEEG) responses from 115 patients performing a free recall verbal memory task. Our approach employed new interpretable metrics that quantify spectral characteristics of the normalized iEEG signal based on power-in-band and synchrony measures. Unsupervised clustering of the metrics identified distinct sets of active electrodes across different subjects. In the total population of 11,869 electrodes, our method achieved 97% sensitivity and 92.9% specificity with the most efficient metric. We validated our results with anatomical localization revealing significantly greater distribution of active electrodes in brain regions that support verbal memory processing. We propose our machine-learning framework for objective and efficient classification and interpretation of electrophysiological signals of brain activities supporting memory and cognition.

Human Verbal Memory Encoding Is Hierarchically Distributed in a Continuous Processing Stream.

Processing of memory is supported by coordinated activity in a network of sensory, association, and motor brain regions. It remains a major challenge to determine where memory is encoded for later retrieval. Here, we used direct intracranial brain recordings from epilepsy patients performing free recall tasks to determine the temporal pattern and anatomical distribution of verbal memory encoding across the entire human cortex. High γ frequency activity (65-115 Hz) showed consistent power responses during encoding of subsequently recalled and forgotten words on a subset of electrodes localized in 16 distinct cortical areas activated in the tasks. More of the high γ power during word encoding, and less power before and after the word presentation, was characteristic of successful recall and observed across multiple brain regions. Latencies of the induced power changes and this subsequent memory effect (SME) between the recalled and forgotten words followed an anatomical sequence from visual to prefrontal cortical areas. Finally, the magnitude of the memory effect was unexpectedly found to be the largest in selected brain regions both at the top and at the bottom of the processing stream. These included the language processing areas of the prefrontal cortex and the early visual areas at the junction of the occipital and temporal lobes. Our results provide evidence for distributed encoding of verbal memory organized along a hierarchical posterior-to-anterior processing stream.

Human Computer Interface for Tracking Eye Movements Improves Assessment and Diagnosis of Patients With Acquired Brain Injuries.

One of the first clinical signs differentiating the minimally conscious state from the vegetative state is the presence of smooth pursuit eye movements occurring in direct response to moving salient stimuli. Glasgow Coma Scale (GCS) is one of the most commonly used diagnostic tools for acute phase assessment of the level of consciousness, together with a neurological examination. These classic measures are limited to qualitative neurological examination without more quantitative measures provided from e.g., tasks with tracking position of the gaze. Among this and other limitations, it is prone to a relatively high rate of misdiagnosis. Here, we developed an interface for gaze tracking to enhance the assessment of consciousness in 10 patients with acquired brain injuries. According to the acute phase GCS assessment, nine of them were considered unaware and below the minimally conscious state. Chronic neurological examination confirmed six of them below the minimally conscious state. Our new Human Computer Interface (HCI) revealed that six patients were conscious enough to complete at least one of the gaze tracking tasks. Among these six patients, one was originally diagnosed as remaining in a vegetative state and one in coma. The patient diagnosed as remaining in a chronic vegetative state scored six GCS points acutely. Following assessment with our HCI the patient was re-diagnosed with a possible locked-in syndrome. Our HCI method provides a new complementary tool for clinical assessment of patients suffering from disorders of consciousness.

Pupil size reflects successful encoding and recall of memory in humans.

Pupil responses are known to indicate brain processes involved in perception, attention and decision-making. They can provide an accessible biomarker of human memory performance and cognitive states in general. Here we investigated changes in the pupil size during encoding and recall of word lists. Consistent patterns in the pupil response were found across and within distinct phases of the free recall task. The pupil was most constricted in the initial fixation phase and was gradually more dilated through the subsequent encoding, distractor and recall phases of the task, as the word items were maintained in memory. Within the final recall phase, retrieving memory for individual words was associated with pupil dilation in absence of visual stimulation. Words that were successfully recalled showed significant differences in pupil response during their encoding compared to those that were forgotten - the pupil was more constricted before and more dilated after the onset of word presentation. Our results suggest pupil size as a potential biomarker for probing and modulation of memory processing.

Closed-loop stimulation of temporal cortex rescues functional networks and improves memory.

Memory failures are frustrating and often the result of ineffective encoding. One approach to improving memory outcomes is through direct modulation of brain activity with electrical stimulation. Previous efforts, however, have reported inconsistent effects when using open-loop stimulation and often target the hippocampus and medial temporal lobes. Here we use a closed-loop system to monitor and decode neural activity from direct brain recordings in humans. We apply targeted stimulation to lateral temporal cortex and report that this stimulation rescues periods of poor memory encoding. This system also improves later recall, revealing that the lateral temporal cortex is a reliable target for memory enhancement. Taken together, our results suggest that such systems may provide a therapeutic approach for treating memory dysfunction.

Electrical Stimulation Modulates High γ Activity and Human Memory Performance.

Direct electrical stimulation of the brain has emerged as a powerful treatment for multiple neurological diseases, and as a potential technique to enhance human cognition. Despite its application in a range of brain disorders, it remains unclear how stimulation of discrete brain areas affects memory performance and the underlying electrophysiological activities. Here, we investigated the effect of direct electrical stimulation in four brain regions known to support declarative memory: hippocampus (HP), parahippocampal region (PH) neocortex, prefrontal cortex (PF), and lateral temporal cortex (TC). Intracranial EEG recordings with stimulation were collected from 22 patients during performance of verbal memory tasks. We found that high γ (62-118 Hz) activity induced by word presentation was modulated by electrical stimulation. This modulatory effect was greatest for trials with "poor" memory encoding. The high γ modulation correlated with the behavioral effect of stimulation in a given brain region: it was negative, i.e., the induced high γ activity was decreased, in the regions where stimulation decreased memory performance, and positive in the lateral TC where memory enhancement was observed. Our results suggest that the effect of electrical stimulation on high γ activity induced by word presentation may be a useful biomarker for mapping memory networks and guiding therapeutic brain stimulation.

Evidence for verbal memory enhancement with electrical brain stimulation in the lateral temporal cortex.

Direct electrical stimulation of the human brain can elicit sensory and motor perceptions as well as recall of memories. Stimulating higher order association areas of the lateral temporal cortex in particular was reported to activate visual and auditory memory representations of past experiences (Penfield and Perot, 1963). We hypothesized that this effect could be used to modulate memory processing. Recent attempts at memory enhancement in the human brain have been focused on the hippocampus and other mesial temporal lobe structures, with a few reports of memory improvement in small studies of individual brain regions. Here, we investigated the effect of stimulation in four brain regions known to support declarative memory: hippocampus, parahippocampal neocortex, prefrontal cortex and temporal cortex. Intracranial electrode recordings with stimulation were used to assess verbal memory performance in a group of 22 patients (nine males). We show enhanced performance with electrical stimulation in the lateral temporal cortex (paired t-test, P = 0.0067), but not in the other brain regions tested. This selective enhancement was observed both on the group level, and for two of the four individual subjects stimulated in the temporal cortex. This study shows that electrical stimulation in specific brain areas can enhance verbal memory performance in humans.awx373media15704855796001.

Direct Brain Stimulation Modulates Encoding States and Memory Performance in Humans.

People often forget information because they fail to effectively encode it. Here, we test the hypothesis that targeted electrical stimulation can modulate neural encoding states and subsequent memory outcomes. Using recordings from neurosurgical epilepsy patients with intracranially implanted electrodes, we trained multivariate classifiers to discriminate spectral activity during learning that predicted remembering from forgetting, then decoded neural activity in later sessions in which we applied stimulation during learning. Stimulation increased encoding-state estimates and recall if delivered when the classifier indicated low encoding efficiency but had the reverse effect if stimulation was delivered when the classifier indicated high encoding efficiency. Higher encoding-state estimates from stimulation were associated with greater evidence of neural activity linked to contextual memory encoding. In identifying the conditions under which stimulation modulates memory, the data suggest strategies for therapeutically treating memory dysfunction.

Dissecting gamma frequency activity during human memory processing.

Gamma frequency activity (30-150 Hz) is induced in cognitive tasks and is thought to reflect underlying neural processes. Gamma frequency activity can be recorded directly from the human brain using intracranial electrodes implanted in patients undergoing treatment for drug-resistant epilepsy. Previous studies have independently explored narrowband oscillations in the local field potential and broadband power increases. It is not clear, however, which processes contribute to human brain gamma frequency activity, or their dynamics and roles during memory processing. Here a large dataset of intracranial recordings obtained during encoding of words from 101 patients was used to detect, characterize and compare induced gamma frequency activity events. Individual bursts of gamma frequency activity were isolated in the time-frequency domain to determine their spectral features, including peak frequency, amplitude, frequency span, and duration. We found two distinct types of gamma frequency activity events that showed either narrowband or broadband frequency spans revealing characteristic spectral properties. Narrowband events, the predominant type, were induced by word presentations following an initial induction of broadband events, which were temporally separated and selectively correlated with evoked response potentials, suggesting that they reflect different neural activities and play different roles during memory encoding. The two gamma frequency activity types were differentially modulated during encoding of subsequently recalled and forgotten words. In conclusion, we found evidence for two distinct activity types induced in the gamma frequency range during cognitive processing. Separating these two gamma frequency activity components contributes to the current understanding of electrophysiological biomarkers, and may prove useful for emerging neurotechnologies targeting, mapping and modulating distinct neurophysiological processes in normal and epileptogenic brain.

Behavioral state classification in epileptic brain using intracranial electrophysiology.

OBJECTIVE: Automated behavioral state classification can benefit next generation implantable epilepsy devices. In this study we explored the feasibility of automated awake (AW) and slow wave sleep (SWS) classification using wide bandwidth intracranial EEG (iEEG) in patients undergoing evaluation for epilepsy surgery. APPROACH: Data from seven patients (age [Formula: see text], 4 women) who underwent intracranial depth electrode implantation for iEEG monitoring were included. Spectral power features (0.1-600 Hz) spanning several frequency bands from a single electrode were used to train and test a support vector machine classifier. MAIN RESULTS: Classification accuracy of 97.8 ± 0.3% (normal tissue) and 89.4 ± 0.8% (epileptic tissue) across seven subjects using multiple spectral power features from a single electrode was achieved. Spectral power features from electrodes placed in normal temporal neocortex were found to be more useful (accuracy 90.8 ± 0.8%) for sleep-wake state classification than electrodes located in normal hippocampus (87.1 ± 1.6%). Spectral power in high frequency band features (Ripple (80-250 Hz), Fast Ripple (250-600 Hz)) showed comparable performance for AW and SWS classification as the best performing Berger bands (Alpha, Beta, low Gamma) with accuracy ⩾90% using a single electrode contact and single spectral feature. SIGNIFICANCE: Automated classification of wake and SWS should prove useful for future implantable epilepsy devices with limited computational power, memory, and number of electrodes. Applications include quantifying patient sleep patterns and behavioral state dependent detection, prediction, and electrical stimulation therapies.

Reactivation of seizure-related changes to interictal spike shape and synchrony during postseizure sleep in patients.

OBJECTIVE: Local field potentials (LFPs) arise from synchronous activation of millions of neurons, producing seemingly consistent waveform shapes and relative synchrony across electrodes. Interictal spikes (IISs) are LFPs associated with epilepsy that are commonly used to guide surgical resection. Recently, changes in neuronal firing patterns observed in the minutes preceding seizure onset were found to be reactivated during postseizure sleep, a process called seizure-related consolidation (SRC), due to similarities with learning-related consolidation. Because IISs arise from summed neural activity, we hypothesized that changes in IIS shape and relative synchrony would be observed in the minutes preceding seizure onset and would be reactivated preferentially during postseizure slow-wave sleep (SWS). METHODS: Scalp and intracranial recordings were obtained continuously across multiple days from clinical macroelectrodes implanted in patients undergoing treatment for intractable epilepsy. Data from scalp electrodes were used to stage sleep. Data from intracranial electrodes were used to detect IISs using a previously established algorithm. Partial correlations were computed for sleep and wake periods before and after seizures as a function of correlations observed in the minutes preceding seizures. Magnetic resonance imaging (MRI) and computed tomography (CT) scans were co-registered with electroencephalography (EEG) to determine the location of the seizure-onset zone (SOZ). RESULTS: Changes in IIS shape and relative synchrony were observed on a subset of macroelectrodes minutes before seizure onset, and these changes were reactivated preferentially during postseizure SWS. Changes in synchrony were greatest for pairs of electrodes where at least one electrode was located in the SOZ. SIGNIFICANCE: These data suggest preseizure changes in neural activity and their subsequent reactivation occur across a broad spatiotemporal scale: from single neurons to LFPs, both within and outside the SOZ. The preferential reactivation of seizure-related changes in IISs during postseizure SWS adds to a growing body of literature suggesting that pathologic neural processes may utilize physiologic mechanisms of synaptic plasticity.