论文标题

使用深度Q学习从临床医生那里学习医疗分类

Learning medical triage from clinicians using Deep Q-Learning

论文作者

Buchard, Albert, Bouvier, Baptiste, Prando, Giulia, Beard, Rory, Livieratos, Michail, Busbridge, Dan, Thompson, Daniel, Richens, Jonathan, Zhang, Yuanzhao, Baker, Adam, Perov, Yura, Gourgoulias, Kostis, Johri, Saurabh

论文摘要

医疗分类对于医疗保健系统至关重要,允许患者的正确取向和必要资源的分配以充分治疗他们。虽然可靠的决策树方法是根据他们的介绍为分类患者的,但这些树木隐含地需要人类推断,并且不立即适用于完全自动化的环境。另一方面,直接从专家那里学习分类政策可能会纠正硬编码决策的某些局限性。在这项工作中,我们提出了一种使用精选的临床小插曲的分类患者的深钢筋学习方法(深入学习的一种变体)。该数据集由1374个临床小插曲组成,是由医生创建的,以代表现实生活中的病例。每个小插图平均与仅依靠病史的医生做出的3.8个专家分类决定有关。我们表明,这种方法与人类绩效相提并论,在94%的案件中做出了安全的分类决定,并在85%的案件中匹配了专家决定。训练有素的代理商学会了何时停止提出问题,获得优化的决策政策,而不是监督方法,要求更少的证据,并通过要求更多信息来适应情况的新颖性。总体而言,我们证明,深入的强化学习方法可以直接从专家决策中学习有效的医疗分类政策,而无需专家知识工程。这种方法是可扩展的,可以部署在具有不同分类规格的医疗机构或地理区域,或者在训练有素的专家稀缺的地方,以改善护理早期的决策。

Medical Triage is of paramount importance to healthcare systems, allowing for the correct orientation of patients and allocation of the necessary resources to treat them adequately. While reliable decision-tree methods exist to triage patients based on their presentation, those trees implicitly require human inference and are not immediately applicable in a fully automated setting. On the other hand, learning triage policies directly from experts may correct for some of the limitations of hard-coded decision-trees. In this work, we present a Deep Reinforcement Learning approach (a variant of DeepQ-Learning) to triage patients using curated clinical vignettes. The dataset, consisting of 1374 clinical vignettes, was created by medical doctors to represent real-life cases. Each vignette is associated with an average of 3.8 expert triage decisions given by medical doctors relying solely on medical history. We show that this approach is on a par with human performance, yielding safe triage decisions in 94% of cases, and matching expert decisions in 85% of cases. The trained agent learns when to stop asking questions, acquires optimized decision policies requiring less evidence than supervised approaches, and adapts to the novelty of a situation by asking for more information. Overall, we demonstrate that a Deep Reinforcement Learning approach can learn effective medical triage policies directly from expert decisions, without requiring expert knowledge engineering. This approach is scalable and can be deployed in healthcare settings or geographical regions with distinct triage specifications, or where trained experts are scarce, to improve decision making in the early stage of care.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源