论文标题

火炬结构:深层结构化预测库

Torch-Struct: Deep Structured Prediction Library

论文作者

Rush, Alexander M.

论文摘要

NLP结构化预测的文献描述了序列,分割,比对和树的丰富分布和算法集合;但是,这些算法很难在深度学习框架中使用。我们介绍了Torch结构,这是一个用于结构化预测的库,旨在利用并集成到基于自动差异的框架的框架。火炬结构包括通过简单且灵活的基于分布的API访问的大量概率结构,该结构连接到任何深度学习模型。该库利用批处理,矢量化操作和利用自动差异来生成可读,快速和可测试的代码。在内部,我们还包括许多通用优化,以提供交叉呈叠加效率。实验表明,对快速基线的表现显着增长,案例研究表明了图书馆的好处。火炬结构可在https://github.com/harvardnlp/pytorch-scruct上找到。

The literature on structured prediction for NLP describes a rich collection of distributions and algorithms over sequences, segmentations, alignments, and trees; however, these algorithms are difficult to utilize in deep learning frameworks. We introduce Torch-Struct, a library for structured prediction designed to take advantage of and integrate with vectorized, auto-differentiation based frameworks. Torch-Struct includes a broad collection of probabilistic structures accessed through a simple and flexible distribution-based API that connects to any deep learning model. The library utilizes batched, vectorized operations and exploits auto-differentiation to produce readable, fast, and testable code. Internally, we also include a number of general-purpose optimizations to provide cross-algorithm efficiency. Experiments show significant performance gains over fast baselines and case-studies demonstrate the benefits of the library. Torch-Struct is available at https://github.com/harvardnlp/pytorch-struct.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源