论文标题
如果我要求您解释什么:解释程序文本中扰动的影响
What-if I ask you to explain: Explaining the effects of perturbations in procedural text
论文作者
论文摘要
我们解决了解释程序文本中扰动的影响的任务,这是过程理解的重要检验。考虑描述兔子生命周期的段落:如果雌性兔子生病了 - 即,雌性兔子不会怀孕,因此,人类可以轻松解释对兔子种群的影响,结果没有婴儿导致兔子种群的减少。我们提出四重奏,该系统是通过将解释任务建模为多任务学习问题来构建段落中解释的系统。与最近的流程理解基准相比,四重奏提供了更好的解释(基于程序文本中的句子)。我们还提出了一个令人惊讶的次要效应:我们的模型还实现了一个新的SOTA,在下游QA任务上具有7%的绝对F1改进。这说明了良好的解释不必以最终任务绩效为代价。
We address the task of explaining the effects of perturbations in procedural text, an important test of process comprehension. Consider a passage describing a rabbit's life-cycle: humans can easily explain the effect on the rabbit population if a female rabbit becomes ill -- i.e., the female rabbit would not become pregnant, and as a result not have babies leading to a decrease in rabbit population. We present QUARTET, a system that constructs such explanations from paragraphs, by modeling the explanation task as a multitask learning problem. QUARTET provides better explanations (based on the sentences in the procedural text) compared to several strong baselines on a recent process comprehension benchmark. We also present a surprising secondary effect: our model also achieves a new SOTA with a 7% absolute F1 improvement on a downstream QA task. This illustrates that good explanations do not have to come at the expense of end task performance.