Optoelectronic Devices for In-Sensor Computing.

The demand for accurate perception of the physical world leads to a dramatic increase in sensory nodes. However, the transmission of massive and unstructured sensory data from sensors to computing units poses great challenges in terms of power-efficiency, transmission bandwidth, data storage, time latency, and security. To efficiently process massive sensory data, it is crucial to achieve data compression and structuring at the sensory terminals. In-sensor computing integrates perception, memory, and processing functions within sensors, enabling sensory terminals to perform data compression and data structuring. Here, vision sensors are adopted as an example and discuss the functions of electronic, optical, and optoelectronic hardware for visual processing. Particularly, hardware implementations of optoelectronic devices for in-sensor visual processing that can compress and structure multidimensional vision information are examined. The underlying resistive switching mechanisms of volatile/nonvolatile optoelectronic devices and their processing operations are explored. Finally, a perspective on the future development of optoelectronic devices for in-sensor computing is provided.

Hydrogen-Bonding Integrated Low-Dimensional Flexible Electronics Beyond the Limitations of van der Waals Contacts.

Van der Waals (vdW) integration enables clean contacts for low-dimensional electronic devices. The limitation remains; however, that an additional tunneling contact resistance occurs owing to the inherent vdW gap between the metal and the semiconductor. Here, it is demonstrated from theoretical calculations that stronger non-covalent hydrogen-bonding interactions facilitate electron tunneling and significantly reduce the contact resistance; thus, promising to break the limitations of the vdW contact. π-plane hydrogen-bonding contacts in surface-engineered MXene/carbon nanotube metal/semiconductor heterojunctions are realized, and an anomalous temperature-dependent tunneling resistance is observed. Low-dimensional flexible thin-film transistors integrated by hydrogen-bonding contacts exhibit both excellent flexibility and carrier mobility orders of magnitude higher than their counterparts with vdW contacts. This strategy demonstrates a scalable solution for realizing high-performance and low-power flexible electronics beyond vdW contacts.

Bioinspired In-Sensor Multimodal Fusion for Enhanced Spatial and Spatiotemporal Association.

Multimodal perception can capture more precise and comprehensive information compared with unimodal approaches. However, current sensory systems typically merge multimodal signals at computing terminals following parallel processing and transmission, which results in the potential loss of spatial association information and requires time stamps to maintain temporal coherence for time-series data. Here we demonstrate bioinspired in-sensor multimodal fusion, which effectively enhances comprehensive perception and reduces the level of data transfer between sensory terminal and computation units. By adopting floating gate phototransistors with reconfigurable photoresponse plasticity, we realize the agile spatial and spatiotemporal fusion under nonvolatile and volatile photoresponse modes. To realize an optimal spatial estimation, we integrate spatial information from visual-tactile signals. For dynamic events, we capture and fuse in real time spatiotemporal information from visual-audio signals, realizing a dance-music synchronization recognition task without a time-stamping process. This in-sensor multimodal fusion approach provides the potential to simplify the multimodal integration system, extending the in-sensor computing paradigm.

Multi-Body Biomarker Entrapment System: An All-Encompassing Tool for Ultrasensitive Disease Diagnosis and Epidemic Screening.

Ultrasensitive identification of biomarkers in biofluids is essential for the precise diagnosis of diseases. For the gold standard approaches, polymerase chain reaction and enzyme-linked immunosorbent assay, cumbersome operational steps hinder their point-of-care applications. Here, a bionic biomarker entrapment system (BioES) is implemented, which employs a multi-body Y-shaped tetrahedral DNA probe immobilized on carbon nanotube transistors. Clinical identification of endometriosis is successfully realized by detecting an estrogen receptor, ERß, from the lesion tissue of endometriosis patients and establishing a standard diagnosis procedure. The multi-body Y-shaped BioES achieves a theoretical limit of detection (LoD) of 6.74 aM and a limit of quantification of 141 aM in a complex protein milieu. Furthermore, the BioES is optimized into a multi-site recognition module for enhanced binding efficiency, realizing the first identification of monkeypox virus antigen A35R and unamplified detection of circulating tumor DNA of breast cancer in serum. The rigid and compact probe framework with synergy effect enables the BioES to target A35R and DNA with a LoD down to 991 and 0.21 aM, respectively. Owing to its versatility for proteins and nucleic acids as well as ease of manipulation and ultra-sensitivity, the BioES can be leveraged as an all-encompassing tool for population-wide screening of epidemics and clinical disease diagnosis.

Bilingual Bidirectional Stretchable Self-Healing Neuristors with Proprioception.

The coexistence and interaction of excitatory and inhibitory neurotransmitters at biological synapses enable bilingual communication, serving as a physiological foundation for organism adaptation, internal stability, and regulation of behavior and emotions in mammals. Neuromorphic electronics are expected to emulate the bilingual functions of the biological nervous system for artificial neurorobotics and neurorehabilitation. Here, we have proposed a bilingual bidirectional artificial neuristor array, which utilizes ion migration and electrostatic coupling properties between intrinsically stretchable and self-healing poly(urea-urethane) elastomer and carbon nanotube electrodes, realized by van der Waals integration. The neuristor exhibits depression or potentiation behaviors in response to the same stimulus in different operational phases and achieves a four-quadrant information-processing capability. These properties make it possible to simulate complex neuromorphic processes, which involve bilingual bidirectional responses, such as withdrawal or addiction responses, and array-based automated refresh. Furthermore, the neuristor array is a self-healing neuromorphic electronic device that can function effectively even under 50% mechanical strain and can recover operation voluntarily within 2 h after experiencing mechanical injury. Additionally, the bilingual bidirectional stretchable self-healing neuristor can emulate coordinated neural signal transmission from the motor cortex to muscles and integrate proprioception through strain modulation, similar to the biological muscle spindle. The properties, structure, operation mechanisms, and neurologically integrated functions of the proposed neuristor signify an advancement in neuromorphic electronics for next-generation neurorehabilitation and neurorobotics.

Stretchable Temperature-Responsive Multimodal Neuromorphic Electronic Skin with Spontaneous Synaptic Plasticity Recovery.

Multimodal electronic skin devices capable of detecting multimodal signals provide the possibility for health monitoring. Sensing and memory for temperature and deformation by human skin are of great significance for the perception and monitoring of physiological changes of the human body. Electronic skin is highly expected to have similar functions as human skin. Here, by implementing intrinsically stretchable neuromorphic transistors with mechanoreceptors and thermoreceptors in an array, we have realized stretchable temperature-responsive multimodal neuromorphic electronic skin (STRM-NES) with both sensory and memory functions, in which synaptic plasticity can be modulated by multiple modalities, in situ temperature variations, and stretching deformations. Temperature-responsive functions, spontaneous recovery, and temperature-dependent multitrial learning are proposed. Furthermore, a stretchable temperature neuromorphic array composed of multiple fully functional subcells is demonstrated to identify temperature distributions and variations at different regions and conditions after various strains of skin. The STRM-NES has temperature- and strain-responsive neuromorphic functions, excellent self-healing, and reusable capability, showing similar abilities as human skin to sense, transmit, memory, and recovery from external stimuli. It is expected to facilitate the development of wearable electronics, intelligent robotics, and prosthetic applications.

Tetrahedral DNA nanostructure based biosensor for high-performance detection of circulating tumor DNA using all-carbon nanotube transistor.

Adopting carbon nanotube (CNT) transistors as biosensors has been developed as a promising method for cancer biomarker detection, which has shown superior sensitivity and selectivity. However, the detection of circulating tumor DNA (ctDNA) by the CNT transistor based biosensors is still a challenge and no work has been reported. Here, direct label-free DNA detection of AKT2 gene related to triple-negative breast cancer by all-CNT thin-film transistor (TFT) biosensors incorporated with tetrahedral DNA nanostructures (TDNs) is proposed and achieved for the first time. The adoption of TDNs enables improved biosensor response for at least 35% and even as high as 98% as compared with single-stranded DNA (ssDNA) probes owing to the enhanced DNA hybridization efficiency. Influence of the TDNs' linker length on the biosensor performance is important and has been investigated. Concentration-dependent DNA detection is achieved by the all-CNT TFT biosensors with a broad linear detection range of six orders of magnitude and a theoretical limit of detection (LOD) of 2 fM. In addition, the all-CNT TFT biosensors exhibit favorable selectivity and repeatability. The platform of all-CNT TFT biosensors incorporated with TDNs has great potential for multiplexed detection of various cancer biomarkers, providing a simple yet high performance universal strategy for low-cost clinical applications.