1. Adaptive Test & Evaluation via Bayesian Decision Theory.
- Author
-
Ferry, Jim, Crookston, Nate, and Ahmed, Adam
- Subjects
ADAPTIVE testing ,DECISION making ,STAKEHOLDERS - Abstract
Bayesian decision theory is a framework for making decisions that are expected to have the best outcomes based on available data. Dynamo is a paradigm that applies Bayesian decision theory to Test & Evaluation (T&E). It provides capabilities to visualize how knowledge of a system under test is updated as test results arrive, to assess the ways in which this knowledge could be refined under various test plans, and to recommend the test decisions with the best potential for furthering stakeholder priorities. Dynamo stands for Dynamic knowledge + Moneyball. Dynamic knowledge refers to the management of the various forms of uncertainty associated with T&E. This knowledge is updated in real time and is leveraged to provide various analytic capabilities. Moneyball refers to optimization criteria that express stakeholder priorities and testing costs in a common currency to facilitate testing decisions that provide the most “bang for the buck.†This article discusses the principles behind the Dynamo paradigm and the progression of capabilities it provides for T&E as it is deployed in three phases. It ends with a simple example that illustrates how the impetus to test is generated at decision boundaries in knowledge space. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF