论文标题
Pirá:双语葡萄牙语 - 英语数据集,用于提问海洋
Pirá: A Bilingual Portuguese-English Dataset for Question-Answering about the Ocean
论文作者
论文摘要
当前在自然语言处理方面的研究高度取决于精心生产的语料库。大多数现有资源都集中在英语上;一些资源专注于中文和法语等语言;很少有资源处理多种语言。本文介绍了Pirá数据集,这是葡萄牙语和英语的有关海洋和巴西海岸的大量问题和答案。据我们所知,Pirá是第一个具有葡萄牙文本支持文本的质量检查数据集,也许更重要的是,第一个包括此语言的双语QA数据集。 PIRá数据集由两种语言的2261个正确策划的问题/答案(QA)组成。质量检查集是根据两个语料库手动创建的:与巴西海岸有关的摘要和《联合国海洋》的摘录。质量检查集已通过数据集贡献者在同行评审过程中验证。我们讨论了Pirá的一些优点和局限性,因为该新资源可以支持NLP中的一组任务,例如提问,信息检索和机器翻译。
Current research in natural language processing is highly dependent on carefully produced corpora. Most existing resources focus on English; some resources focus on languages such as Chinese and French; few resources deal with more than one language. This paper presents the Pirá dataset, a large set of questions and answers about the ocean and the Brazilian coast both in Portuguese and English. Pirá is, to the best of our knowledge, the first QA dataset with supporting texts in Portuguese, and, perhaps more importantly, the first bilingual QA dataset that includes this language. The Pirá dataset consists of 2261 properly curated question/answer (QA) sets in both languages. The QA sets were manually created based on two corpora: abstracts related to the Brazilian coast and excerpts of United Nation reports about the ocean. The QA sets were validated in a peer-review process with the dataset contributors. We discuss some of the advantages as well as limitations of Pirá, as this new resource can support a set of tasks in NLP such as question-answering, information retrieval, and machine translation.