论文标题
Alphamwe:MWE注释的多语言平行语料库的构建
AlphaMWE: Construction of Multilingual Parallel Corpora with MWE Annotations
论文作者
论文摘要
在这项工作中,我们介绍了多种文字表达式(MWES)的注释的多语言平行语料库的构建。 MWES包括在共享任务中定义的语言MWES(VMWES),该任务具有动词为研究术语的主管。带注释的VMWES也可以手动进行双语和多义对齐。涵盖的语言包括英语,中文,波兰语和德语。我们最初的英语语料库取自2018年的零零件共享任务。我们执行了该来源语料库的机器翻译,然后进行了人类的邮政编辑和目标MWES注释。应用严格的质量控制以进行误差限制,即,每个MT输出句子都收到了第一个手动文章编辑和注释以及第二手动质量重新检查。我们在Corpora准备过程中的发现之一是,MWES的准确翻译对MT系统提出了挑战。为了促进进一步的MT研究,我们介绍了MT Systems在执行MWE相关翻译中遇到的错误类型的分类。为了获得MT问题的更广泛的看法,我们选择了四种流行的最先进的MT模型进行比较:Microsoft Bing Translator,Googlemt,Baidu Fanyi和Deepl MT。由于降噪,人类专业人员的翻译后编辑和MWE注释,我们认为我们的Alphamwe数据集将是跨语性和多语言研究的资产,例如MT和信息提取。我们的多语言语料库可在github.com/poethan/alphamwe上作为开放访问。
In this work, we present the construction of multilingual parallel corpora with annotation of multiword expressions (MWEs). MWEs include verbal MWEs (vMWEs) defined in the PARSEME shared task that have a verb as the head of the studied terms. The annotated vMWEs are also bilingually and multilingually aligned manually. The languages covered include English, Chinese, Polish, and German. Our original English corpus is taken from the PARSEME shared task in 2018. We performed machine translation of this source corpus followed by human post editing and annotation of target MWEs. Strict quality control was applied for error limitation, i.e., each MT output sentence received first manual post editing and annotation plus second manual quality rechecking. One of our findings during corpora preparation is that accurate translation of MWEs presents challenges to MT systems. To facilitate further MT research, we present a categorisation of the error types encountered by MT systems in performing MWE related translation. To acquire a broader view of MT issues, we selected four popular state-of-the-art MT models for comparisons namely: Microsoft Bing Translator, GoogleMT, Baidu Fanyi and DeepL MT. Because of the noise removal, translation post editing and MWE annotation by human professionals, we believe our AlphaMWE dataset will be an asset for cross-lingual and multilingual research, such as MT and information extraction. Our multilingual corpora are available as open access at github.com/poethan/AlphaMWE.