论文标题
医学成像中的变压器:调查
Transformers in Medical Imaging: A Survey
论文作者
论文摘要
在自然语言任务上取得了前所未有的成功之后,变形金刚已成功地应用于几个计算机视觉问题,实现了最新的结果,并促使研究人员重新考虑卷积神经网络(CNN)的至高无上,为{de facto}操作员。利用这些计算机视觉的进展,医学成像领域也见证了对变压器的兴趣日益增长,与具有当地接收场的CNN相比,可以捕捉全球环境。在此调查中,我们的启发,我们试图对变形金刚在涵盖各个方面的医学成像中的应用进行全面审查,从最近提出的建筑设计到未解决的问题。具体而言,我们调查了变压器在医疗图像分割,检测,分类,重建,合成,注册,临床报告生成和其他任务中的使用。特别是,对于这些应用程序中的每一个,我们都会开发分类法,确定特定于应用程序的挑战,并提供解决方案的见解,并强调最近的趋势。此外,我们对该领域的整个状态进行了批判性讨论,包括确定关键挑战,开放问题以及概述有希望的未来方向。我们希望这项调查能够激发对社区的进一步兴趣,并为研究人员提供有关变压器模型在医学成像中的应用的最新参考。最后,为了应对该领域的快速发展,我们打算在\ url {https://github.com/fahadshamshad/awshamshad/awesome-transformers-in-medical-imimaging}上定期更新相关的最新论文及其开源实现。
Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of convolutional neural networks (CNNs) as {de facto} operators. Capitalizing on these advances in computer vision, the medical imaging field has also witnessed growing interest for Transformers that can capture global context compared to CNNs with local receptive fields. Inspired from this transition, in this survey, we attempt to provide a comprehensive review of the applications of Transformers in medical imaging covering various aspects, ranging from recently proposed architectural designs to unsolved issues. Specifically, we survey the use of Transformers in medical image segmentation, detection, classification, reconstruction, synthesis, registration, clinical report generation, and other tasks. In particular, for each of these applications, we develop taxonomy, identify application-specific challenges as well as provide insights to solve them, and highlight recent trends. Further, we provide a critical discussion of the field's current state as a whole, including the identification of key challenges, open problems, and outlining promising future directions. We hope this survey will ignite further interest in the community and provide researchers with an up-to-date reference regarding applications of Transformer models in medical imaging. Finally, to cope with the rapid development in this field, we intend to regularly update the relevant latest papers and their open-source implementations at \url{https://github.com/fahadshamshad/awesome-transformers-in-medical-imaging}.