论文标题

迈向无监督的深图结构学习

Towards Unsupervised Deep Graph Structure Learning

论文作者

Liu, Yixin, Zheng, Yu, Zhang, Daokun, Chen, Hongxu, Peng, Hao, Pan, Shirui

论文摘要

近年来,图形神经网络(GNN)已成为各种与图形相关的应用程序中的成功工具。但是,当原始图结构中发生嘈杂的连接时,GNN的性能可能会恶化。此外,对明确结构的依赖性阻止了GNN被应用于一般的非结构化场景。为了解决这些问题,最近出现了深图结构学习(GSL)方法,建议在节点分类任务的监督下共同优化图形结构。但是,这些方法集中在监督的学习方案上,这导致了几个问题,即对标签的依赖,边缘分布的偏见以及对应用程序任务的限制。在本文中,我们提出了一个更实用的GSL范式,无监督的图形结构学习,其中学习的图形拓扑是通过数据本身优化的,而无需任何外部指导(即标签)。为了解决无监督的GSL问题,我们提出了一种新型的结构自举的对比学习框架(缩写的崇高),借助自我监督的对比学习。具体而言,我们从原始数据中生成学习目标作为“锚图”,并使用对比度损失来最大化锚图和学习图之间的一致性。为了提供持续的指导,我们设计了一种新颖的引导机制,该机制在模型学习过程中用学习的结构升级了锚图。我们还设计了一系列的图表学习者和后处理方案,以建模要学习的结构。在八个基准数据集上进行的广泛实验证明了我们提出的崇高和优化图的高质量的显着有效性。

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures; besides, the dependence on explicit structures prevents GNNs from being applied to general unstructured scenarios. To address these issues, recently emerged deep graph structure learning (GSL) methods propose to jointly optimize the graph structure along with GNN under the supervision of a node classification task. Nonetheless, these methods focus on a supervised learning scenario, which leads to several problems, i.e., the reliance on labels, the bias of edge distribution, and the limitation on application tasks. In this paper, we propose a more practical GSL paradigm, unsupervised graph structure learning, where the learned graph topology is optimized by data itself without any external guidance (i.e., labels). To solve the unsupervised GSL problem, we propose a novel StrUcture Bootstrapping contrastive LearnIng fraMEwork (SUBLIME for abbreviation) with the aid of self-supervised contrastive learning. Specifically, we generate a learning target from the original data as an "anchor graph", and use a contrastive loss to maximize the agreement between the anchor graph and the learned graph. To provide persistent guidance, we design a novel bootstrapping mechanism that upgrades the anchor graph with learned structures during model learning. We also design a series of graph learners and post-processing schemes to model the structures to learn. Extensive experiments on eight benchmark datasets demonstrate the significant effectiveness of our proposed SUBLIME and high quality of the optimized graphs.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源