论文标题
迈向自然语言理解的共同模型。汇集深度学习和深度语义
Towards Coinductive Models for Natural Language Understanding. Bringing together Deep Learning and Deep Semantics
论文作者
论文摘要
本文包含一项建议,以增加自然语言理解的计算机构的共同诱导。我们认为,这将为自然语言对话,语法和语义的更现实,计算和可扩展模型提供基础。鉴于自下而上,归纳构造,语义和句法结构是脆弱的,并且似乎无法充分代表更长的句子或现实对话的含义,因此自然语言理解需要新的基础。使用自上而下约束的共同诱导已成功地用于操作系统和编程语言的设计。此外,它隐含地存在于文本挖掘,机器翻译以及一些尝试建模直觉和方式的尝试中,这提供了证据表明其有效的证据。本文显示了一些此类用途的高级形式化。 由于共同诱导和归纳可以共存,因此可以为自然语言理解中的研究提供通用语言和概念模型。特别是,这种机会似乎在组成性研究中正在出现。本文展示了自然语言处理中诱导和共同诱导共同出现的几个例子。我们认为,通过这两种方法的结合,可以在经验环境中克服已知的诱导和共同诱导的个人局限性。我们看到了一个开放的问题,即提供其共同用途的理论。
This article contains a proposal to add coinduction to the computational apparatus of natural language understanding. This, we argue, will provide a basis for more realistic, computationally sound, and scalable models of natural language dialogue, syntax and semantics. Given that the bottom up, inductively constructed, semantic and syntactic structures are brittle, and seemingly incapable of adequately representing the meaning of longer sentences or realistic dialogues, natural language understanding is in need of a new foundation. Coinduction, which uses top down constraints, has been successfully used in the design of operating systems and programming languages. Moreover, implicitly it has been present in text mining, machine translation, and in some attempts to model intensionality and modalities, which provides evidence that it works. This article shows high level formalizations of some of such uses. Since coinduction and induction can coexist, they can provide a common language and a conceptual model for research in natural language understanding. In particular, such an opportunity seems to be emerging in research on compositionality. This article shows several examples of the joint appearance of induction and coinduction in natural language processing. We argue that the known individual limitations of induction and coinduction can be overcome in empirical settings by a combination of the the two methods. We see an open problem in providing a theory of their joint use.