In-ear integrated sensor array for the continuous monitoring of brain activity and of lactate in sweat.

Owing to the proximity of the ear canal to the central nervous system, in-ear electrophysiological systems can be used to unobtrusively monitor brain states. Here, by taking advantage of the ear's exocrine sweat glands, we describe an in-ear integrated array of electrochemical and electrophysiological sensors placed on a flexible substrate surrounding a user-generic earphone for the simultaneous monitoring of lactate concentration and brain states via electroencephalography, electrooculography and electrodermal activity. In volunteers performing an acute bout of exercise, the device detected elevated lactate levels in sweat concurrently with the modulation of brain activity across all electroencephalography frequency bands. Simultaneous and continuous unobtrusive in-ear monitoring of metabolic biomarkers and brain electrophysiology may allow for the discovery of dynamic and synergetic interactions between brain and body biomarkers in real-world settings for long-term health monitoring or for the detection or monitoring of neurodegenerative diseases.

A Versatile In-Ear Biosensing System and Body-Area Network for Unobtrusive Continuous Health Monitoring.

To enable continuous, mobile health monitoring, body-worn sensors need to offer comparable performance to clinical devices in a lightweight, unobtrusive package. This work presents a complete versatile wireless electrophysiology data acquisition system (weDAQ) that is demonstrated for in-ear electroencephalography (EEG) and other on-body electrophysiology with user-generic dry-contact electrodes made from standard printed circuit boards (PCBs). Each weDAQ device provides 16 recording channels, driven right leg (DRL), a 3-axis accelerometer, local data storage, and adaptable data transmission modes. The weDAQ wireless interface supports deployment of a body area network (BAN) capable of aggregating various biosignal streams over multiple worn devices simultaneously, on the 802.11n WiFi protocol. Each channel resolves biopotentials ranging over 5 orders of magnitude with a noise level of 0.52 µVrms over a 1000-Hz bandwidth, and a peak SNDR of 119 dB and CMRR of 111 dB at 2 ksps. The device leverages in-band impedance scanning and an input multiplexer to dynamically select good skin contacting electrodes for reference and sensing channels. In-ear and forehead EEG measurements taken from subjects captured modulation of alpha brain activity, electrooculogram (EOG) characteristic eye movements, and electromyogram (EMG) from jaw muscles. Simultaneous ECG and EMG measurements were demonstrated on multiple, freely-moving subjects in their natural office environment during periods of rest and exercise. The small footprint, performance, and configurability of the open-source weDAQ platform and scalable PCB electrodes presented, aim to provide the biosensing community greater experimental flexibility and lower the barrier to entry for new health monitoring research.

A compute-in-memory chip based on resistive random-access memory.

Realizing increasingly complex artificial intelligence (AI) functionalities directly on edge devices calls for unprecedented energy efficiency of edge hardware. Compute-in-memory (CIM) based on resistive random-access memory (RRAM)1 promises to meet such demand by storing AI model weights in dense, analogue and non-volatile RRAM devices, and by performing AI computation directly within RRAM, thus eliminating power-hungry data movement between separate compute and memory2-5. Although recent studies have demonstrated in-memory matrix-vector multiplication on fully integrated RRAM-CIM hardware6-17, it remains a goal for a RRAM-CIM chip to simultaneously deliver high energy efficiency, versatility to support diverse models and software-comparable accuracy. Although efficiency, versatility and accuracy are all indispensable for broad adoption of the technology, the inter-related trade-offs among them cannot be addressed by isolated improvements on any single abstraction level of the design. Here, by co-optimizing across all hierarchies of the design from algorithms and architecture to circuits and devices, we present NeuRRAM-a RRAM-based CIM chip that simultaneously delivers versatility in reconfiguring CIM cores for diverse model architectures, energy efficiency that is two-times better than previous state-of-the-art RRAM-CIM chips across various computational bit-precisions, and inference accuracy comparable to software models quantized to four-bit weights across various AI tasks, including accuracy of 99.0 percent on MNIST18 and 85.7 percent on CIFAR-1019 image classification, 84.7-percent accuracy on Google speech command recognition20, and a 70-percent reduction in image-reconstruction error on a Bayesian image-recovery task.

Hierarchical Network Connectivity and Partitioning for Reconfigurable Large-Scale Neuromorphic Systems.

We present an efficient and scalable partitioning method for mapping large-scale neural network models with locally dense and globally sparse connectivity onto reconfigurable neuromorphic hardware. Scalability in computational efficiency, i.e., amount of time spent in actual computation, remains a huge challenge in very large networks. Most partitioning algorithms also struggle to address the scalability in network workloads in finding a globally optimal partition and efficiently mapping onto hardware. As communication is regarded as the most energy and time-consuming part of such distributed processing, the partitioning framework is optimized for compute-balanced, memory-efficient parallel processing targeting low-latency execution and dense synaptic storage, with minimal routing across various compute cores. We demonstrate highly scalable and efficient partitioning for connectivity-aware and hierarchical address-event routing resource-optimized mapping, significantly reducing the total communication volume recursively when compared to random balanced assignment. We showcase our results working on synthetic networks with varying degrees of sparsity factor and fan-out, small-world networks, feed-forward networks, and a hemibrain connectome reconstruction of the fruit-fly brain. The combination of our method and practical results suggest a promising path toward extending to very large-scale networks and scalable hardware-aware partitioning.

Memory-Efficient Synaptic Connectivity for Spike-Timing- Dependent Plasticity.

Spike-Timing-Dependent Plasticity (STDP) is a bio-inspired local incremental weight update rule commonly used for online learning in spike-based neuromorphic systems. In STDP, the intensity of long-term potentiation and depression in synaptic efficacy (weight) between neurons is expressed as a function of the relative timing between pre- and post-synaptic action potentials (spikes), while the polarity of change is dependent on the order (causality) of the spikes. Online STDP weight updates for causal and acausal relative spike times are activated at the onset of post- and pre-synaptic spike events, respectively, implying access to synaptic connectivity both in forward (pre-to-post) and reverse (post-to-pre) directions. Here we study the impact of different arrangements of synaptic connectivity tables on weight storage and STDP updates for large-scale neuromorphic systems. We analyze the memory efficiency for varying degrees of density in synaptic connectivity, ranging from crossbar arrays for full connectivity to pointer-based lookup for sparse connectivity. The study includes comparison of storage and access costs and efficiencies for each memory arrangement, along with a trade-off analysis of the benefits of each data structure depending on application requirements and budget. Finally, we present an alternative formulation of STDP via a delayed causal update mechanism that permits efficient weight access, requiring no more than forward connectivity lookup. We show functional equivalence of the delayed causal updates to the original STDP formulation, with substantial savings in storage and access costs and efficiencies for networks with sparse synaptic connectivity as typically encountered in large-scale models in computational neuroscience.

Integrated In-Ear Device for Auditory Health Assessment.

Clinical assessment of the human auditory system is an integral part of evaluating the health of a patient's cognitive processes. Conventional tests performed by audiologists include the Auditory Steady State Response (ASSR) and the Auditory Brainstem Response (ABR), both of which present an audio stimulus to the patient in order to elicit a change in brain state measurable by electroencephalography (EEG) techniques. Spatial monitoring of the electrophysiological activity in the auditory cortex, temporal cortex, and brain stem during auditory stimulus evaluation can be used to pinpoint to location of auditory dysfunction along the auditory pathway. However, given the obtrusive nature of conventional auditory evaluation techniques and the lack of information about sound transduction and cochlear dynamics usually irrecoverable by EEG, a better approach is needed to improve its clinical utility. Here, we present an in-ear device for auditory health assessment that integrates a sound engine for stimulation and high-density dry-electrode EEG for real-time simultaneous recording of brain activity. This system provides ease-of-use and patient comfort. We also investigate the auditory transfer function of the hearing system as an intricate convolution of the tympanic membrane, middle ear bones, and the cochlear subsystems.

Synchronization of isolated downstates (K-complexes) may be caused by cortically-induced disruption of thalamic spindling.

Sleep spindles and K-complexes (KCs) define stage 2 NREM sleep (N2) in humans. We recently showed that KCs are isolated downstates characterized by widespread cortical silence. We demonstrate here that KCs can be quasi-synchronous across scalp EEG and across much of the cortex using electrocorticography (ECOG) and localized transcortical recordings (bipolar SEEG). We examine the mechanism of synchronous KC production by creating the first conductance based thalamocortical network model of N2 sleep to generate both spontaneous spindles and KCs. Spontaneous KCs are only observed when the model includes diffuse projections from restricted prefrontal areas to the thalamic reticular nucleus (RE), consistent with recent anatomical findings in rhesus monkeys. Modeled KCs begin with a spontaneous focal depolarization of the prefrontal neurons, followed by depolarization of the RE. Surprisingly, the RE depolarization leads to decreased firing due to disrupted spindling, which in turn is due to depolarization-induced inactivation of the low-threshold Ca2+ current (IT). Further, although the RE inhibits thalamocortical (TC) neurons, decreased RE firing causes decreased TC cell firing, again because of disrupted spindling. The resulting abrupt removal of excitatory input to cortical pyramidal neurons then leads to the downstate. Empirically, KCs may also be evoked by sensory stimuli while maintaining sleep. We reproduce this phenomenon in the model by depolarization of either the RE or the widely-projecting prefrontal neurons. Again, disruption of thalamic spindling plays a key role. Higher levels of RE stimulation also cause downstates, but by directly inhibiting the TC neurons. SEEG recordings from the thalamus and cortex in a single patient demonstrated the model prediction that thalamic spindling significantly decreases before KC onset. In conclusion, we show empirically that KCs can be widespread quasi-synchronous cortical downstates, and demonstrate with the first model of stage 2 NREM sleep a possible mechanism whereby this widespread synchrony may arise.