论文标题
metagl:通过元学习的图形学习模型的无评估选择
MetaGL: Evaluation-Free Selection of Graph Learning Models via Meta-Learning
论文作者
论文摘要
给定图形学习任务,例如链接预测,在新图上,我们如何选择最佳方法及其超参数(统称为模型),而无需在新图上训练或评估任何模型?图形学习的模型选择在很大程度上是临时的。一种典型的方法是将流行方法应用于新数据集,但这通常是次优的。另一方面,系统比较新图上的模型很快变得太成本过高,甚至不切实际。在这项工作中,我们开发了第一种用于评估图形学习模型选择的元学习方法,称为Metagl,该方法利用各种基准图数据集中现有方法的先前性能自动为新图形选择有效的模型,而无需任何模型培训或评估。为了量化各种图形的相似性,我们介绍了捕获图的结构特征的专业元图特征。然后,我们设计了代表图和模型之间关系的G-M网络,并开发了在此G-M网络上运行的基于图的元学习器,该网络估计了每个模型与不同图形的相关性。广泛的实验表明,使用Metagl选择新图的模型极大地优于几种用于图形学习模型选择的现有的元学习技术(最多47%),而在测试时间(〜1 sec)中非常快。
Given a graph learning task, such as link prediction, on a new graph, how can we select the best method as well as its hyperparameters (collectively called a model) without having to train or evaluate any model on the new graph? Model selection for graph learning has been largely ad hoc. A typical approach has been to apply popular methods to new datasets, but this is often suboptimal. On the other hand, systematically comparing models on the new graph quickly becomes too costly, or even impractical. In this work, we develop the first meta-learning approach for evaluation-free graph learning model selection, called MetaGL, which utilizes the prior performances of existing methods on various benchmark graph datasets to automatically select an effective model for the new graph, without any model training or evaluations. To quantify similarities across a wide variety of graphs, we introduce specialized meta-graph features that capture the structural characteristics of a graph. Then we design G-M network, which represents the relations among graphs and models, and develop a graph-based meta-learner operating on this G-M network, which estimates the relevance of each model to different graphs. Extensive experiments show that using MetaGL to select a model for the new graph greatly outperforms several existing meta-learning techniques tailored for graph learning model selection (up to 47% better), while being extremely fast at test time (~1 sec).