论文标题

Amalgum-免费,平衡,多层英语网络语料库

AMALGUM -- A Free, Balanced, Multilayer English Web Corpus

论文作者

Gessler, Luke, Peng, Siyao, Liu, Yang, Zhu, Yilun, Behzad, Shabnam, Zeldes, Amir

论文摘要

我们提供了一个免费的,流派平衡的英语网络语料库,总计400万令牌,并具有大量高质量的自动注释层,包括依赖树,非命名实体注释,核心指标,核心分辨率和话语树中的话语树理论。通过挖掘打开的在线数据源,语料库旨在为较小的手动创建的带注释的数据集提供更可观的替代方法,同时避免了诸如不平衡或未知构图,许可问题和低质量的自然语言处理之类的陷阱。我们利用多个注释层的知识来实现​​“比NLP更好”的基准,并评估所得资源的准确性。

We present a freely available, genre-balanced English web corpus totaling 4M tokens and featuring a large number of high-quality automatic annotation layers, including dependency trees, non-named entity annotations, coreference resolution, and discourse trees in Rhetorical Structure Theory. By tapping open online data sources the corpus is meant to offer a more sizable alternative to smaller manually created annotated data sets, while avoiding pitfalls such as imbalanced or unknown composition, licensing problems, and low-quality natural language processing. We harness knowledge from multiple annotation layers in order to achieve a "better than NLP" benchmark and evaluate the accuracy of the resulting resource.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源