RSS feed LinkedIn Watch us on Youtube

Activity title

M&S Use Risk Identification and Management

Activity Reference



NATO Modelling and Simulation Group

Security Classification



Awaiting Publication

Activity type


Start date


End date



Cost-Benefit, M&S data, Quality Assurance, Re-usability, Use Risk


The general issue of Verification and Validation (V&V) and Acceptance (VV&A) of Models, Simulations, and Data has been already addressed in several working groups inside NATO (such as by NMSG-019 “VV&A of Federations”, NMSG-054/TG-037 “Risk-Based Tailoring of the Verification, Validation, and Accreditation/Acceptance Processes”, NMSG-073 “ GM-VV”) or outside (e.g. SISO-PDG “GM-VV”) and significant progress has been achieved over the past two decades. But still missing are internationally accepted methods, guidelines and tools which allow to determine kind and amount of quality assurance measures and associated level of effort required to limit use risk to a certain, acceptable level. While there is general consensus on the importance of this topic, and some internationally accepted guidelines or standards on VV&A are available, no commonly accepted methodology for M&S use risk calculation or for balancing use risk versus level of effort needed to establish confidence in the M&S.. As the application of increasingly complex and often interoperable M&S and associated data inherits the risk of using erroneous, invalid or unsuitable models, simulations and data, there is a need for an internationally accepted technical framework that enables the identification and management of M&S use risk. This generic technical framework could be applied in future NATO and national projects.


• Define the collection and application of V&V evidence that supports the identification of M&S use risk, • Define and document parameters and methods for M&S use risk calculation • Develop and document measures and guidelines for M&S use risk and associated efforts evaluation • Develop a generic technical framework for M&S use risk identification and management, • Assemble confidence in the proposed methodology on the basis of ‘real’ case studies, • Provide education and training based on an established methodology.


Main outputs of the TG will provide approaches for M&S use risk versus cost-benefit analyses and a technical framework for application of a wide range of quality assurance measures.

Contact Panel Office