Soft systems analysis of the unification of test and evaluation and program management: A study of a Federal Aviation Administration's strategy.

The strategic objective of a test and evaluation (T&E) organization is to detect defects, which must be fixed prior to system deployment in order to meet the operational needs and achieve customer satisfaction. Numerous process improvement models have been developed and applied to address the issue of preventing “critical” defects getting to the field. However, the escalating costs of system deployment (especially in government programs), due to critical defects found in the field, continues to be a major quality issue affecting customer satisfaction. The failure of programs to meet quality and performance objectives has been shown to be related to inadequate planning and an ineffective program management strategy. Thus, for a T&E organization, the program management strategy can greatly influence overall performance goals. While current literature on T&E quality improvement focuses primarily on T&E technical tools, equipment, and processes, little to no attention has been paid to integrating program management into the T&E organization's strategy. We intend to demonstrate in this paper that taking a holistic view of both T&E and program management (PM) activities using the tools of systems thinking can provide new insights to understand and create a more effective T&E execution strategy. Using Boardman's Soft Systems Methodology and Systemigrams (systemic diagrams), we evaluate the unification of a Federal Aviation Administration's T&E program management into its T&E strategy. The resultant Systemigram model represents the alignment of T&E with program management. We conclude with recommendations on how other organizations may modify their T&E execution strategy to achieve better customer satisfaction. © 2009 Wiley Periodicals, Inc. Syst Eng [ABSTRACT FROM AUTHOR]