Search

International audience; To improve software quality, it is necessary to introduce new metrics with the required detail and increased expressive power, in order to provide valuable information to the different actors of software development. In this paper we present two approaches based on metrics that contribute to improve software quality development. Both approaches are complementary and are focused on the combination, reuse and correlation of metrics. They suggest to the user indications of how to reuse metrics and provide recommendations after the application of metrics correlation. They have been applied to selected metrics on software maintainability, safety, security etc. The approaches have been implemented in two tools, Metrics Suggester and MINT. Both approaches and tools are part of the ITEA3 MEASURE project and they have been integrated into the project platform. To illustrate its application we have created different scenarios on which both approaches are applied. Results show that both approaches are complementary and can be used to improve the software process

International audience; The paper presents a Finite State Machine (FSM) based approach for deriving tests with reduced complexity, under the White Box testing assumption where all the faulty implementations are explicitly enumerated. The specification and implementation FSMs are assumed to be initialized, i.e., each possibly partial and (non-observable) nondeterministic FSM has a reliable reset. The proposed technique is illustrated by the application to a communication protocol

Most of the work related to QoE maps objective variables (QoS-related) into a single one that predicts the quality the user perceives. In this paper we present a new approach to model multimedia OTT services, integrating not only the functional aspects of the service but also non-functional variables, which are classified into objective, subjective and business-related. Non-functional metrics might affect the Quality of Service (QoS), Quality of Experience (QoE) and Quality of Business (QoBiz) correspondingly. We also discuss how all these variables can be taken into account to predict the QoE of the service being studied. The functional requirements are modeled into a Timed Extended Finite State Machine (TEFSM), which is augmented with context variables (and their updating functions) representing non-functional requirements related to QoS, QoE and QoBiz. We use these parameters to evaluate the QoE using a trace model derived from the TEFSM previously built.

This paper presents the work developed by the joint ISO/ITU-T working group on “Formal Methods in Conformance Testing” (FMCT) in order to obtain a future standard. It concerns several areas of conformance testing: terminology, testing concepts, test architecture, specification languages for tests and test generation methods. The influence of FMCT on testing methodology is also analysed and future trends in the area are addressed.

The aim of this tutorial is to present an overview of conformance testing methods for SDL systems. These methods can be classified into two main groups: those whose intent is the totally automated test generation from the SDL system specification and those that provide interactive test generation methods. We present some of the more representative methods illustrating their application by a common example. This example, the Inres protocol and service, will facilitate the comparison of the methods with respect to SDL and test notations, restrictions on the language, results of the application to the protocol and the tools supporting the methods.

The development of test cases is an important issue for testing software, communication protocols and other reactive systems. A number of methods are known for the development of a test suite based on a formal specification given in the form of a finite state machine. Well-known methods are called the W, Wp, UIO, UIOv, DS, H and HIS test derivation methods. These methods have been extensively used by research community in the last years; however no proper comparison has been made between them. In this paper, we experiment with these methods to assess their complexity, applicability, completeness, fault detection capability, length and derivation time of their test suites. The experiments are conducted on randomly generated specifications and on a realistic protocol called the simple connection protocol.

This paper presents an overview of the work we have developed at INT on different approaches to protocol and service testing. It is related to performing tests of communication protocols and telecommunication services based on techniques, such as, active test generation, passive testing, embedded testing and test execution.

This paper presents a summary of some issues that appear to be relevant to testing theory and its applications. These issues are linked to formal methods used for test derivation, to the semantic models chosen to represent these specifications, and to the appropriate techniques needed for selecting a reasonable test effort. A discussion is presented in a polemical fashion trying to illustrate the problems related to the translation of one model into another, to non deterministic and partially specified systems, to the size of the specifications and test suites and the ways to reduce them.