论文标题
图形神经网络的二阶合并
Second-Order Pooling for Graph Neural Networks
论文作者
论文摘要
图形神经网络在学习图表任务(例如节点分类和链接预测)方面取得了巨大成功。图表学习需要图形池以从节点表示中获取图表。由于图的可变大小和同构结构,开发图形合并方法是具有挑战性的。在这项工作中,我们建议将二阶合并用作图形池,这自然可以解决上述挑战。此外,与现有的图形合并方法相比,二阶合并能够使用来自所有节点的信息并收集二阶统计信息,从而使其更强大。我们表明,与图神经网络直接使用二阶合并会导致实际问题。为了克服这些问题,我们提出了两种基于二阶合并的新型全局图合并方法。也就是说,双线性映射和注意力集合。此外,我们将注意力集合扩展到分层图池,以在GNN中更灵活地使用。我们对图形分类任务进行彻底的实验,以证明我们提出的方法的有效性和优势。实验结果表明,我们的方法可显着,一致地改善了性能。
Graph neural networks have achieved great success in learning node representations for graph tasks such as node classification and link prediction. Graph representation learning requires graph pooling to obtain graph representations from node representations. It is challenging to develop graph pooling methods due to the variable sizes and isomorphic structures of graphs. In this work, we propose to use second-order pooling as graph pooling, which naturally solves the above challenges. In addition, compared to existing graph pooling methods, second-order pooling is able to use information from all nodes and collect second-order statistics, making it more powerful. We show that direct use of second-order pooling with graph neural networks leads to practical problems. To overcome these problems, we propose two novel global graph pooling methods based on second-order pooling; namely, bilinear mapping and attentional second-order pooling. In addition, we extend attentional second-order pooling to hierarchical graph pooling for more flexible use in GNNs. We perform thorough experiments on graph classification tasks to demonstrate the effectiveness and superiority of our proposed methods. Experimental results show that our methods improve the performance significantly and consistently.