论文标题

工作流社区峰会:收紧计算设施与科学工作流程之间的整合

Workflows Community Summit: Tightening the Integration between Computing Facilities and Scientific Workflows

论文作者

da Silva, Rafael Ferreira, Chard, Kyle, Casanova, Henri, Laney, Dan, Ahn, Dong, Jha, Shantenu, Allcock, William E., Bauer, Gregory, Duplyakin, Dmitry, Enders, Bjoern, Heer, Todd M., Lancon, Eric, Sanielevici, Sergiu, Sayers, Kevin

论文摘要

工作流程的重要性得到了以下事实的强调:他们是过去几十年中一些最重要的发现。这些工作流中的许多工作流程都有很大的计算,存储和通信需求,因此必须在一系列大规模的计算机系统上执行,从本地群集到公共云,再到即将到来的Exascale HPC平台。从历史上看,工作流执行的基础架构由复杂的集成系统组成,该系统由工作流从业人员内部开发,这些从业人员对一系列传统技术的依赖性有很强的依赖性。由于越来越需要支持工作流程,因此开发了专用的工作流程系统,以方便,高效地创建,执行和调整工作流程,同时确保可移植性。尽管这些努力都是单独的,但现在有数百个独立的工作流系统。由此产生的工作流程系统技术格局是分散的,由于许多看似可比但通常是互不兼容的系统,这可能会为未来的工作流使用者带来重大障碍。为了应对其中一些挑战,由DOE资助的Exaworks和NSF资助的Workflowsri项目在2021年组织了一系列名为“ Workflows Community Summit”的活动。第三版的``工作流程峰会''从计算中心和设施的角度探索了挑战和机遇。第三次峰会汇集了一小部分设施代表,目的是为了了解每个设施在每个设施中如何使用工作流程,以及如何与工厂开发人员以及设施相互作用,以及如何与设施相互互动,以及如何与设施相互作用,以及在设施中的更多机会,以及如何建立机会,以及在设施中的相互作用,以及如何组建到设施,以及如何将设施融合在一起。 AT:https://workflowsri.org/summits/facilities/

The importance of workflows is highlighted by the fact that they have underpinned some of the most significant discoveries of the past decades. Many of these workflows have significant computational, storage, and communication demands, and thus must execute on a range of large-scale computer systems, from local clusters to public clouds and upcoming exascale HPC platforms. Historically, infrastructures for workflow execution consisted of complex, integrated systems, developed in-house by workflow practitioners with strong dependencies on a range of legacy technologies. Due to the increasing need to support workflows, dedicated workflow systems were developed to provide abstractions for creating, executing, and adapting workflows conveniently and efficiently while ensuring portability. While these efforts are all worthwhile individually, there are now hundreds of independent workflow systems. The resulting workflow system technology landscape is fragmented, which may present significant barriers for future workflow users due to many seemingly comparable, yet usually mutually incompatible, systems that exist. In order to tackle some of these challenges, the DOE-funded ExaWorks and NSF-funded WorkflowsRI projects have organized in 2021 a series of events entitled the "Workflows Community Summit". The third edition of the ``Workflows Community Summit" explored workflows challenges and opportunities from the perspective of computing centers and facilities. The third summit brought together a small group of facilities representatives with the aim to understand how workflows are currently being used at each facility, how facilities would like to interact with workflow developers and users, how workflows fit with facility roadmaps, and what opportunities there are for tighter integration between facilities and workflows. More information at: https://workflowsri.org/summits/facilities/

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源