论文标题

精神分裂症模拟层的表现优于常规神经网络层

Schizophrenia-mimicking layers outperform conventional neural network layers

论文作者

Mizutani, Ryuta, Noguchi, Senta, Saiga, Rino, Yamashita, Yuichi, Miyashita, Mitsuhiro, Arai, Makoto, Itokawa, Masanari

论文摘要

我们报道了精神分裂症病例大脑网络的纳米尺度三维研究,发现与健康对照相比,它们的神经突相比稀薄且曲折。这表明远端神经元之间的连接在精神分裂症病例的微电路中受到抑制。在这项研究中,我们将这些生物学发现应用于模仿精神分裂症的人工神经网络的设计,以模拟该疾病中观察到的连接改变。使用MNIST和CIFAR-10数据集对具有“精神分裂连接层”的神经网络代替完全连接的层进行了图像分类任务。结果表明,精神分裂症连接层耐受性耐配合,并且表现优于完全连接的层。仅对使用频带矩阵作为权重窗口的网络观察到跑性均超过表现,这表明权重矩阵的形状与网络性能有关。还使用VGG配置对精神分裂症卷积层进行了测试,表明可以消除最后三个卷积层的60%的核重量,而不会损失准确性。精神分裂症层可以代替常规层,而没有任何网络配置和培训程序任何变化;因此,神经网络可以轻松地利用这些层。这项研究的结果表明,精神分裂症中发现的联系改变不是大脑的负担,而是在大脑表现中具有功能作用。

We have reported nanometer-scale three-dimensional studies of brain networks of schizophrenia cases and found that their neurites are thin and tortuous compared to healthy controls. This suggests that connections between distal neurons are suppressed in microcircuits of schizophrenia cases. In this study, we applied these biological findings to the design of schizophrenia-mimicking artificial neural network to simulate the observed connection alteration in the disorder. Neural networks having a "schizophrenia connection layer" in place of a fully connected layer were subjected to image classification tasks using the MNIST and CIFAR-10 datasets. The results revealed that the schizophrenia connection layer is tolerant to overfitting and outperforms a fully connected layer. The outperformance was observed only for networks using band matrices as weight windows, indicating that the shape of the weight matrix is relevant to the network performance. A schizophrenia convolution layer was also tested using the VGG configuration, showing that 60% of the kernel weights of the last three convolution layers can be eliminated without loss of accuracy. The schizophrenia layers can be used instead of conventional layers without any change in the network configuration and training procedures; hence, neural networks can easily take advantage of these layers. The results of this study suggest that the connection alteration found in schizophrenia is not a burden to the brain, but has functional roles in brain performance.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源