论文标题
Zerokbc:零击知识库完成的全面基准
ZeroKBC: A Comprehensive Benchmark for Zero-Shot Knowledge Base Completion
论文作者
论文摘要
知识库完成(KBC)旨在预测知识图中缺少的链接。以前的KBC任务和方法主要集中在培训集中所有测试实体和关系都出现的设置上。但是,对零射的KBC设置的研究有限,我们需要处理在不断增长的知识基础中出现的看不见的实体和关系。在这项工作中,我们系统地检查了零射KBC的不同可能场景,并开发了全面的基准Zerokbc,该基准涵盖了这些情况,具有不同类型的知识源。我们的系统分析揭示了几个丢失但重要的零射击KBC设置。实验结果表明,在这个具有挑战性的基准上,规范和最先进的KBC系统无法实现令人满意的性能。通过分析这些系统在解决Zerokbc方面的优势和劣势,我们进一步提出了一些重要的观察结果和有希望的未来方向。
Knowledge base completion (KBC) aims to predict the missing links in knowledge graphs. Previous KBC tasks and approaches mainly focus on the setting where all test entities and relations have appeared in the training set. However, there has been limited research on the zero-shot KBC settings, where we need to deal with unseen entities and relations that emerge in a constantly growing knowledge base. In this work, we systematically examine different possible scenarios of zero-shot KBC and develop a comprehensive benchmark, ZeroKBC, that covers these scenarios with diverse types of knowledge sources. Our systematic analysis reveals several missing yet important zero-shot KBC settings. Experimental results show that canonical and state-of-the-art KBC systems cannot achieve satisfactory performance on this challenging benchmark. By analyzing the strength and weaknesses of these systems on solving ZeroKBC, we further present several important observations and promising future directions.