基于Dual RSVP的脑眼混合脑机接口在虚拟机械臂控制中的应用

Application of Dual RSVP-Based EEG-EM Hybrid Brain-Computer Interface in Virtual Robotic Arm Control

  • 摘要: Dual RSVP作为RSVP的一种变体范式,具有比传统Single RSVP更优的分类性能。在脑机接口控制系统应用中具有较大的开发潜力。但目前针对Dual RSVP的范式多停留在认知实验层面,未能进一步应用在人机交互系统中。有鉴于此,设计并提出了一种基于Dual RSVP范式的新编码方式,研发了基于此范式的混合脑机接口虚拟机械臂控制系统。为了验证系统的有效性,招募18位大学生参加了单、双窗两种范式的RSVP实验,同步采集了脑电和眼动数据。两种范式的脑眼融合分类结果表明,两种范式的脑眼双模态融合分类性能均高于单一脑电或者眼动模态,相比Single RSVP,Dual RSVP具有更高的信息传输率和分类准确率。这些结果为基于脑电和眼动模态的混合脑机接口控制系统开发提供有价值的参考。

     

    Abstract: As a variant of the RSVP paradigm, Dual RSVP exhibits superior classification performance compared to the traditional Single RSVP, showing considerable potential for the development of brain-computer interface control systems. However, current research on the Dual RSVP paradigm remains largely limited to cognitive experiments and has not been further applied to human-computer interaction systems. In light of this, a novel encoding method based on Dual RSVP was designed and an integrated hybrid BCI virtual robotic arm control system was developed based on Dual RSVP paradigm. To verify the effectiveness of the system, 18 college students were recruited to participate in RSVP experiments under both single-window and dual-window paradigms, with synchronous collection of electroencephalogram (EEG) and eye movement (EM) data. The brain-eye fusion classification results of the two paradigms demonstrate that the dual-modal fusion performance of EEG and eye-tracking outperforms those of either EEG or eye-tracking modalities. Moreover, Dual RSVP achieves a higher information transfer rate and classification accuracy than Single RSVP. These results provide valuable references for the development of hybrid brain-computer interface control systems based on EEG and eye-tracking modalities.

     

/

返回文章
返回