论文标题
复杂NLP和内容策划管道的工作流管理器
A Workflow Manager for Complex NLP and Content Curation Pipelines
论文作者
论文摘要
我们为NLP处理管道的灵活创建和自定义提供了一个工作流管理器。 Workflow Manager解决了各种不同NLP任务和基于硬件的资源使用情况的互操作性挑战。基于一般性,灵活性,可伸缩性和效率的四个关键原则,我们通过提供有关其自定义语言的详细信息,解释通信组件以及一般系统体系结构和设置,介绍工作流管理器的第一个版本。目前,我们实施了该系统,该系统是由现实世界中的几个创新和转移项目中的现实行业用例扎根和激励的。
We present a workflow manager for the flexible creation and customisation of NLP processing pipelines. The workflow manager addresses challenges in interoperability across various different NLP tasks and hardware-based resource usage. Based on the four key principles of generality, flexibility, scalability and efficiency, we present the first version of the workflow manager by providing details on its custom definition language, explaining the communication components and the general system architecture and setup. We currently implement the system, which is grounded and motivated by real-world industry use cases in several innovation and transfer projects.