论文标题

神经网络中的复制对称性破坏:朝着严格结果的几个步骤

Replica symmetry breaking in neural networks: a few steps toward rigorous results

论文作者

Agliari, Elena, Albanese, Linda, Barra, Adriano, Ottaviani, Gabriele

论文摘要

在本文中,我们调整了折断的复制插值技术(由弗朗切斯科·格拉(Francesco Guerra)开发来处理Sherrington-kirkpatrick模型,即是一种成对的均值平均型号旋转玻璃,其耦合是I.I.D.标准高斯变量),以便与Hopfield Model(即,与Hopfield Model”(即,与Hopfield Meaplient whor neural neural neural neur Neur-neur-Nebernews一起工作)规则):这是通过将Guerra的望远镜平均值接纳在运输方程技术上的,该平均值最近是由一些作者开发的。作为序曲,我们应用了该技术来解决使用I.I.D.的Sherrington-Kirkpatrick模型。高斯联轴器以$ j_0 $为中心,有限差异$ j $;平均$ j_0 $扮演的角色是在$ j $调整的嘈杂环境中要检测到的信号的角色,因此在解决Hopfield模型之前,该模型是一个自然测试案例。对于这两种模型,在k-then Step(k任意但有限的)中获得了淬灭自由能的显式表达。特别是,对于Hopfield模型,假设重叠的尊重Parisi的分解(遵循Ziqqurat Ansatz),并且Mattis磁化是自动化的,我们可以通过Amit,Crisanti和Gutfreund(1RSB)以及Stepfffan and Stepffffan and Stepffffan andkühn(2 rssb)恢复了先前的结果。

In this paper we adapt the broken replica interpolation technique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables) in order to work also with the Hopfield model (i.e., a pairwise mean-field neural-network whose couplings are drawn according to Hebb's learning rule): this is accomplished by grafting Guerra's telescopic averages on the transport equation technique, recently developed by some of the Authors. As an overture, we apply the technique to solve the Sherrington-Kirkpatrick model with i.i.d. Gaussian couplings centered at $J_0$ and with finite variance $J$; the mean $J_0$ plays the role of a signal to be detected in a noisy environment tuned by $J$, hence making this model a natural test-case to be investigated before addressing the Hopfield model. For both the models, an explicit expression of their quenched free energy in terms of their natural order parameters is obtained at the K-th step (K arbitrary, but finite) of replica-symmetry-breaking. In particular, for the Hopfield model, by assuming that the overlaps respect Parisi's decomposition (following the ziqqurat ansatz) and that the Mattis magnetization is self-averaging, we recover previous results obtained via replica-trick by Amit, Crisanti and Gutfreund (1RSB) and by Steffan and Kühn (2RSB).

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源