论文标题
基于注意力驱动的卷积神经网络对脑电图信号的对象的视觉识别
Decoding Visual Recognition of Objects from EEG Signals based on Attention-Driven Convolutional Neural Network
论文作者
论文摘要
感知和识别对象的能力对于与外部环境的互动至关重要。研究它们的研究及其与大脑活动变化的关系一直在增加,这是由于可能在直观的脑机界面(BMI)中应用的研究。此外,已经研究了使数据足以分类的不同视觉刺激时的独特模式。但是,报告的分类精度仍然较低或用于获取脑信号的技术不切实际地用于实际环境。在这项研究中,我们的目标是根据提供的视觉刺激来解码脑电图(EEG)信号。向受试者提供了72张属于6种不同语义类别的照片。我们使用EEG信号根据视觉刺激对6个类别和72个示例分类。为了达到高分类的精度,我们提出了一个注意力驱动的卷积神经网络,并将我们的结果与用于分类EEG信号的常规方法进行了比较。我们报告的6级和72级的精度分别为50.37%和26.75%。这些结果在统计上优于其他常规方法。由于使用人类视觉途径应用了注意网络,因此这是可能的。我们的发现表明,当受试者具有不同语义类别的视觉刺激以及具有高分类精度的示例级别时,EEG信号是可以区分的。这表明它可以在现实世界中将其应用于现实的BMI。
The ability to perceive and recognize objects is fundamental for the interaction with the external environment. Studies that investigate them and their relationship with brain activity changes have been increasing due to the possible application in an intuitive brain-machine interface (BMI). In addition, the distinctive patterns when presenting different visual stimuli that make data differentiable enough to be classified have been studied. However, reported classification accuracy still low or employed techniques for obtaining brain signals are impractical to use in real environments. In this study, we aim to decode electroencephalography (EEG) signals depending on the provided visual stimulus. Subjects were presented with 72 photographs belonging to 6 different semantic categories. We classified 6 categories and 72 exemplars according to visual stimuli using EEG signals. In order to achieve a high classification accuracy, we proposed an attention driven convolutional neural network and compared our results with conventional methods used for classifying EEG signals. We reported an accuracy of 50.37% and 26.75% for 6-class and 72-class, respectively. These results statistically outperformed other conventional methods. This was possible because of the application of the attention network using human visual pathways. Our findings showed that EEG signals are possible to differentiate when subjects are presented with visual stimulus of different semantic categories and at an exemplar-level with a high classification accuracy; this demonstrates its viability to be applied it in a real-world BMI.