论文标题

OpenKBP:开放访问知识的计划大挑战

OpenKBP: The open-access knowledge-based planning grand challenge

论文作者

Babier, Aaron, Zhang, Binghao, Mahmood, Rafid, Moore, Kevin L., Purdie, Thomas G., McNiven, Andrea L., Chan, Timothy C. Y.

论文摘要

这项工作的目的是提高基于知识的计划(KBP)在放射治疗研究中的剂量预测方法的公平和一致的比较。我们主持了2020年AAPM大挑战的OpenKBP,并挑战了参与者,以开发预测轮廓CT图像剂量的最佳方法。根据两个单独的分数对模型进行评估:(1)评估完整3D剂量分布的剂量评分,以及(2)剂量 - 量直方图(DVH)评分,评估了设置DVH指标。为参与者提供了340例接受放射治疗治疗头颈癌的患者的数据。将数据分为培训(n = 200),验证(n = 40)和测试(n = 100)数据集。在挑战的验证阶段,所有参与者都对相应的数据集进行了培训和验证,我们根据样本外的性能在测试阶段对模型进行了排名。这项挑战吸引了来自28个国家的195名参与者,其中73名参与者在验证阶段组成了44个团队,总共收到了1750份。测试阶段获得了28个团队的提交。平均而言,在验证阶段的过程中,参与者的剂量和DVH分数分别提高了2.7和5.7。在测试阶段,第一阶段的剂量和DVH得分明显优于亚军模型。最后,许多表现出色的团队都报告了使用可推广的技术(例如合奏)来取得比竞争更高的性能。这是基于知识的计划研究的首次竞争,它帮助启动了第一个公平,一致地比较KBP预测方法的平台。 OpenKBP数据集可公开使用,以帮助基准未来的KBP研究,这也通过使每个人都可以访问KBP研究使KBP研究民主化。

The purpose of this work is to advance fair and consistent comparisons of dose prediction methods for knowledge-based planning (KBP) in radiation therapy research. We hosted OpenKBP, a 2020 AAPM Grand Challenge, and challenged participants to develop the best method for predicting the dose of contoured CT images. The models were evaluated according to two separate scores: (1) dose score, which evaluates the full 3D dose distributions, and (2) dose-volume histogram (DVH) score, which evaluates a set DVH metrics. Participants were given the data of 340 patients who were treated for head-and-neck cancer with radiation therapy. The data was partitioned into training (n=200), validation (n=40), and testing (n=100) datasets. All participants performed training and validation with the corresponding datasets during the validation phase of the Challenge, and we ranked the models in the testing phase based on out-of-sample performance. The Challenge attracted 195 participants from 28 countries, and 73 of those participants formed 44 teams in the validation phase, which received a total of 1750 submissions. The testing phase garnered submissions from 28 teams. On average, over the course of the validation phase, participants improved the dose and DVH scores of their models by a factor of 2.7 and 5.7, respectively. In the testing phase one model achieved significantly better dose and DVH score than the runner-up models. Lastly, many of the top performing teams reported using generalizable techniques (e.g., ensembles) to achieve higher performance than their competition. This is the first competition for knowledge-based planning research, and it helped launch the first platform for comparing KBP prediction methods fairly and consistently. The OpenKBP datasets are available publicly to help benchmark future KBP research, which has also democratized KBP research by making it accessible to everyone.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源