Conference Paper

Proteum/FSM: A Tool to Support Finite State Machine Validation Based on Mutation Testing.

Dept. de Comput., Univ. Fed. de Sao Carlos
DOI: 10.1109/SCCC.1999.810159 Conference: 19th International Conference of the Chilean Computer Science Society (SCCC '99), 11-13 November 1999, Talca, Chile
Source: DBLP

ABSTRACT The quality of the VV&T-Verification, Validation and
Testing-activity is extremely relevant to the software development
process. Testing techniques and criteria have been investigated in the
context of VV&T of reactive systems specifications, providing
mechanisms to the VV&T activity quality assessment. The
establishment of a low-cost, effective testing and validation strategy
and the development of supporting tools have been pursued by many
researchers for coding and specification as well. This paper discusses
the main architectural and operational aspects of a tool, named
Proteum/FSM, that supports the application of mutation testing for
validating reactive systems specifications based on finite state
machines (FSM). Further improvements and research issues are briefly

  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Mutation testing is an effective technique for either improving or generating fault-finding test suites. It creates defective or incorrect program artifacts of the program under test and evaluates the ability of test suites to reveal them. Despite being effective, mutation is costly since it requires assessing the test cases with a large number of defective artifacts. Even worse, some of these artifacts are behaviourally "equivalent" to the original one and hence, they unnecessarily increase the testing effort. We adopt a variability perspective on mutation analysis. We model a defective artifact as a transition system with a specific feature selected and consider it as a member of a mutant family. The mutant family is encoded as a Featured Transition System, a compact formalism initially dedicated to model-checking of software product lines. We show how to evaluate a test suite against the set of all candidate defects by using mutant families. We can evaluate all the considered defects at the same time and isolate some equivalent mutants. We can also assist the test generation process and eciently consider higher-order mutants.
    22nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering, Hong Kong; 11/2014
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Since the inception of Software Product Line (SPL) engi-neering, concerns about testing SPLs emerged. The large number of possible products that may be derived from a SPL induces an even larger set of test-cases, which make SPL testing a very challenging activity. Some individual solutions have been proposed, but few are integrated in a complete testing process. In this paper, we summarize our research addressing variability-aware behavioural model-based test-ing. So far we developed a statistical prioritization technique and we have defined behavioural coverage criteria dedicated to behavioural model of a SPL. Our overall goal is to form an end-to-end model-driven approach, relying on Featured Transition System (FTS), a compact formalism to represent the behaviour of a SPL, where test-cases selection techniques are automated and made practical to the engineers. The for-mality of the envisioned models also makes them amenable to model-checking, yielding innovative combinations of qual-ity assurance activities. The evaluation will be performed in two phases: using standard approaches (fault seeding and mutation testing); using the approach on an industrial case-study.
    Doctoral Symposium of the 18th International Software Product Line Conference, Florence, Italy; 09/2014
  • Source