论文标题
SV-Inter 2022的概述在社会科学出版物中的调查变量识别上共享任务
Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications
论文作者
论文摘要
在本文中，我们概述了SV形式的共享任务，这是第三届学术文档处理（SDP）的一部分，在Coling 2022。在共享任务中，为参与者提供了变量的句子和词汇，并要求确定哪些变量（如果有哪些变量（如果有任何变量）中，则在完整文本中的单个句子中提到了任何变量。两支球队总共向共享的任务排行榜提交了9次提交。尽管所有团队都没有改善基线系统，但我们仍然从他们的意见书中获取见解。此外，我们提供详细的评估。我们共享任务的数据和基准可以在https://github.com/vadis-project/sv-inend上免费获得
In this paper, we provide an overview of the SV-Ident shared task as part of the 3rd Workshop on Scholarly Document Processing (SDP) at COLING 2022. In the shared task, participants were provided with a sentence and a vocabulary of variables, and asked to identify which variables, if any, are mentioned in individual sentences from scholarly documents in full text. Two teams made a total of 9 submissions to the shared task leaderboard. While none of the teams improve on the baseline systems, we still draw insights from their submissions. Furthermore, we provide a detailed evaluation. Data and baselines for our shared task are freely available at https://github.com/vadis-project/sv-ident
