Search

This thesis addresses Verification and Validation (V&V) efforts for the Naval Air Warfare Center Air Division (NAWCAD) FA-18 sustainment model to ensure the model can make predictions regarding Tier One mission needs of the Air Division. For the development of the model, the Institute for Defense Analytics (IDA) used SIMLOX as the software tool and developed a data pre-processing pipeline using historical supply data as the inputs for the pipeline. Once the data is pre-processed, the data is used as inputs to the model. This thesis verified the model for correctness using a structured walkthrough. Model validation was performed to ensure the model can predict the number of expenditures using a t-test and percent error between historical and projected expenditures. Using a t-test, the model failed to produce a confidence level of 0.95 to use the model for sustainment decisions in the future. Additionally, the model under-predicted the total number of expenditures required by 66 percent and 70 percent for all depot-level repairable items. These findings will be used to improve the model for the purpose of receiving accreditation as a performance and pricing model. Lieutenant, United States Navy Approved for public release. Distribution is unlimited.

In this paper, cyclic shear-bending analysis of concrete-filled-tube (CFT) column using E-Simulator, which is a large-scale detailed finite element analysis system developed by NIED, is verified and validated. The solid element mesh is verified by varying types and sizes of solid elements. The effects of element types and sizes on analytical results are discussed. Two cases of experiment under variable axial load are simulated for validation. By comparing analytical and experimental results, it is shown that, the cyclic shear-bending behaviors are reproduced by E-Simulator. The computed internal damage of filled concrete is visualized and discussed.

As our dependence on automated systems grows, so does the need for guaranteeing their safety, cybersecurity, and privacy (SCP). Dedicated methods for verification and validation (V&V) must be used to this end and it is necessary that the methods and their characteristics can be clearly differentiated. This can be achieved via method classifications. However, we have experienced that existing classifications are not suitable to categorise V&V methods for SCP of automated systems. They do not pay enough attention to the distinguishing characteristics of this system type and of these quality concerns. As a solution, we present a new classification developed in the scope of a large-scale industry-academia project. The classification considers both the method type, e.g., testing, and the concern addressed, e.g., safety. Over 70 people have successfully used the classification on 53 methods. We argue that the classification is a more suitable means to categorise V&V methods for SCP of automated systems and that it can help other researchers and practitioners.

International audience; Model-Based System engineering (MBSE) promotes Verification and Validation (V&V) as crucial activities to demonstrate, during the system design stage and based on models, that a system meets requirements defined by stakeholders and that it fulfills its intended purpose. Model V&V activities are defined through the following strategies: Model Appraisal, Guided Modelling, Simulation and Formal Proof. Regarding the objectives of each individual strategy, they are considered as complementary, therefore mutually beneficial when combined, for reaching the overall V&V objectives. Various techniques and tools permit nowadays the implementation of each strategy. However, the successful combination and implementation of all four strategies remains still difficult (difference of concepts), time consuming (transformation and dedicated modelling are often requested) and generally expensive. This paper introduces a tool-equipped method for the successful and eased combination and implementation of all four V&V strategies to provide stakeholders with a high level of confidence in decision-making based on models.

Requirements crosscutting in software development and maintenance have gradually become an important issue in software engineering with a growing need of traceability support to better understand the requirements crosscutting processes to comply with industrial standards. However, many recent works focusing on identification, modularization, composition and conflict dissolution of requirements crosscutting are mostly saturated at requirements level. Hence, these works fail to specify crosscutting properties for functional and non-functional requirements at other phases leading to insufficient support for software engineers. Recently, a new approach called the Identification, Modularization, Design Composition Rules and Conflict Dissolutions (IM-DeCRuD) was proposed to provide a special traceability to facilitate better understanding and reasoning towards requirements crosscutting implementation, along with a tool as a proof-of-concept. In this paper, the tool was evaluated and the results were verified by some experts in the industries. The feedbacks on applicability aspect were then gathered and analyzed using DESMET qualitative method. The outcome showed that the IM-DeCRuD was applicable to cope with the tedious engineering processes in handling crosscutting properties at requirements, analysis and design phases for system development and evolution.

The benefits of effective verification and validation activities in the medical device domain include increased usability and reliability, decreased failure rate and recalls and reduced risks to patients and users. Though there is guidance on verification and validation in multiple standards in the medical device domain, these are difficult for the manufacturer to implement, as there is no consolidated information on how they can be successfully achieved. The paper is intended to highlight three major areas for improvement in the medical device software development domain. This research is based on an analysis of available literature in the field of verification and validation in generic software development, safety-critical and medical device software domains. Additionally, we also performed a review of the standards and process improvement models available in these domains.