You are required to read and agree to the below before accessing a full-text version of an article in the IDE article repository.
The full-text document you are about to access is subject to national and international copyright laws. In most cases (but not necessarily all) the consequence is that personal use is allowed given that the copyright owner is duly acknowledged and respected. All other use (typically) require an explicit permission (often in writing) by the copyright owner.
For the reports in this repository we specifically note that
- the use of articles under IEEE copyright is governed by the IEEE copyright policy (available at http://www.ieee.org/web/publications/rights/copyrightpolicy.html)
- the use of articles under ACM copyright is governed by the ACM copyright policy (available at http://www.acm.org/pubs/copyright_policy/)
- technical reports and other articles issued by M‰lardalen University is free for personal use. For other use, the explicit consent of the authors is required
- in other cases, please contact the copyright owner for detailed information
By accepting I agree to acknowledge and respect the rights of the copyright owner of the document I am about to access.
If you are in doubt, feel free to contact webmaster@ide.mdh.se
Quality assuring the quality assurance tool: Applying safety-critical concepts to test framework development
Publication Type:
Journal article
Venue:
PeerJ Computer Science
Abstract
Quality of embedded systems is demonstrated by the performed tests. The quality of such tests is often
dependent on the quality of one or more testing tools, especially in automated testing. Test automation is
also central to the success of agile development. It is thus critical to ensure the quality of testing tools.
This work explores how industries with agile processes can learn from safety-critical system development
with regards to the quality assurance of the test framework development. Safety-critical systems typically
need adherence to safety standards that often suggests substantial upfront documentation, plans and
a long-term perspective on several development aspects. In contrast, agile approaches focus on quick
adaptation, evolving software and incremental deliveries. This paper identifies several approaches of
quality assurance of software development tools in functional safety development and agile development.
The extracted approaches are further analyzed and processed into candidate solutions, i.e., principles
and practices for the test framework quality assurance applicable in an industrial context. An industrial
focus group with experienced practitioners further validated the candidate solutions through moderated
group discussions. The two main contributions from this study are: (i) 48 approaches and 25 derived
candidate solutions for test framework quality assurance in four categories (development, analysis,
run-time measures, and validation and verification) with related insights, e.g., a test framework should
be perceived as a tool-chain and not a single tool, (ii) the perceived value of the candidate solutions in
industry as collected from the focus group.
Bibtex
@article{Thorn6556,
author = {Jonathan Th{\"o}rn and Per Erik Strandberg and Daniel Sundmark and Wasif Afzal},
title = {Quality assuring the quality assurance tool: Applying safety-critical concepts to test framework development},
volume = {8},
number = {8:e1131},
pages = {1--25},
month = {October},
year = {2022},
journal = {PeerJ Computer Science},
url = {http://www.es.mdu.se/publications/6556-}
}