论文标题
令人沮丧的硬证据在书籍中检索质量检查
Frustratingly Hard Evidence Retrieval for QA Over Books
论文作者
论文摘要
近年来,已经取得了很多进步来改善问题的回答(QA),但是尚未深入探讨叙事书籍故事的特殊问题。鉴于其对证据检索的类似依赖性,我们将BookQA作为开放域质量检查任务。我们进一步研究了最新的开放域质量检查方法如何帮助BookQA。除了实现叙事QA基准的最先进之外,我们的研究还揭示了有大量实验和分析的书籍中证据检索的困难 - 这需要对新颖的解决方案进行新颖的解决方案,以在BookQa中进行证据检索。
A lot of progress has been made to improve question answering (QA) in recent years, but the special problem of QA over narrative book stories has not been explored in-depth. We formulate BookQA as an open-domain QA task given its similar dependency on evidence retrieval. We further investigate how state-of-the-art open-domain QA approaches can help BookQA. Besides achieving state-of-the-art on the NarrativeQA benchmark, our study also reveals the difficulty of evidence retrieval in books with a wealth of experiments and analysis - which necessitates future effort on novel solutions for evidence retrieval in BookQA.