论文标题
生产自动化的工业适用系统回归测试优先级
Industrially Applicable System Regression Test Prioritization in Production Automation
论文作者
论文摘要
当对自动生产系统(AP)进行更改时,可以在系统中意外引入新故障,称为回归。找到这些故障的一种常见方法是回归测试。在大多数情况下,此回归测试过程是在高时间压力下进行的,在非常不舒服的环境中进行现场。到目前为止,还没有针对适合查找回归的完全集成的AP进行查找和确定系统测试案例的自动支持。因此,测试技术人员必须依靠个人直觉和经验,可能选择不适当的测试用例,并在测试的很晚阶段找到回归。使用合适的优先级,可以简化这种查找和修复回归的迭代过程,并且可以通过执行可能较早识别新回归的测试用例来节省很多时间。因此,本文介绍了一种方法,该方法使用了过去的测试执行中先前获得的运行时数据,并执行更改标识和影响分析,以优先考虑测试用例,这些测试用例具有很高的可能性,该案例具有由系统变更的副作用引起的揭示回归的可能性。该方法是与活跃于APS工程领域的信誉良好的工业合作伙伴合作开发的,从而确保了符合工业需求的发展。进行了工业案例研究和专家评估,显示出令人鼓舞的结果。
When changes are performed on an automated production system (aPS), new faults can be accidentally introduced in the system, which are called regressions. A common method for finding these faults is regression testing. In most cases, this regression testing process is performed under high time pressure and on-site in a very uncomfortable environment. Until now, there is no automated support for finding and prioritizing system test cases regarding the fully integrated aPS that are suitable for finding regressions. Thus, the testing technician has to rely on personal intuition and experience, possibly choosing an inappropriate order of test cases, finding regressions at a very late stage of the test run. Using a suitable prioritization, this iterative process of finding and fixing regressions can be streamlined and a lot of time can be saved by executing test cases likely to identify new regressions earlier. Thus, an approach is presented in this paper that uses previously acquired runtime data from past test executions and performs a change identification and impact analysis to prioritize test cases that have a high probability to unveil regressions caused by side effects of a system change. The approach was developed in cooperation with reputable industrial partners active in the field of aPS engineering, ensuring a development in line with industrial requirements. An industrial case study and an expert evaluation were performed, showing promising results.