Your browser doesn't support javascript.
loading
Robotic arm control system based on augmented reality brain-computer interface and computer vision / 生物医学工程学杂志
Journal of Biomedical Engineering ; (6): 483-491, 2021.
Artigo em Chinês | WPRIM | ID: wpr-888204
ABSTRACT
Brain-computer interface (BCI) has great potential to replace lost upper limb function. Thus, there has been great interest in the development of BCI-controlled robotic arm. However, few studies have attempted to use noninvasive electroencephalography (EEG)-based BCI to achieve high-level control of a robotic arm. In this paper, a high-level control architecture combining augmented reality (AR) BCI and computer vision was designed to control a robotic arm for performing a pick and place task. A steady-state visual evoked potential (SSVEP)-based BCI paradigm was adopted to realize the BCI system. Microsoft's HoloLens was used to build an AR environment and served as the visual stimulator for eliciting SSVEPs. The proposed AR-BCI was used to select the objects that need to be operated by the robotic arm. The computer vision was responsible for providing the location, color and shape information of the objects. According to the outputs of the AR-BCI and computer vision, the robotic arm could autonomously pick the object and place it to specific location. Online results of 11 healthy subjects showed that the average classification accuracy of the proposed system was 91.41%. These results verified the feasibility of combing AR, BCI and computer vision to control a robotic arm, and are expected to provide new ideas for innovative robotic arm control approaches.
Assuntos

Texto completo: DisponíveL Índice: WPRIM (Pacífico Ocidental) Assunto principal: Estimulação Luminosa / Computadores / Eletroencefalografia / Potenciais Evocados Visuais / Interfaces Cérebro-Computador / Procedimentos Cirúrgicos Robóticos / Realidade Aumentada Limite: Humanos Idioma: Chinês Revista: Journal of Biomedical Engineering Ano de publicação: 2021 Tipo de documento: Artigo

Similares

MEDLINE

...
LILACS

LIS

Texto completo: DisponíveL Índice: WPRIM (Pacífico Ocidental) Assunto principal: Estimulação Luminosa / Computadores / Eletroencefalografia / Potenciais Evocados Visuais / Interfaces Cérebro-Computador / Procedimentos Cirúrgicos Robóticos / Realidade Aumentada Limite: Humanos Idioma: Chinês Revista: Journal of Biomedical Engineering Ano de publicação: 2021 Tipo de documento: Artigo