论文标题
哪个 *伯特？一项调查组织上下文编码器
Which *BERT? A Survey Organizing Contextualized Encoders
论文作者
论文摘要
验证的上下文化文本编码器现在已成为NLP社区的主要内容。我们介绍了有关语言表示学习的调查，目的是整合一系列在最近的努力中学习的一系列共享课程。尽管显着的进步迅速迅速，但我们发现现在已经发现了足够多的方向，我们可以根据共同的主题开始组织进步。通过这个组织，我们在解释最近的贡献并选择要使用的模型时重点介绍了重要的考虑。
Pretrained contextualized text encoders are now a staple of the NLP community. We present a survey on language representation learning with the aim of consolidating a series of shared lessons learned across a variety of recent efforts. While significant advancements continue at a rapid pace, we find that enough has now been discovered, in different directions, that we can begin to organize advances according to common themes. Through this organization, we highlight important considerations when interpreting recent contributions and choosing which model to use.
