A case study of verification, validation, and accreditation for advanced distributed simula

Cost Due to

V&V

ModelValuetoUser

100%

Model Confidence

100%

Model Confidence

CINCResponse CellsEchelons not simulated and notpart of training environmentWhite Cell(Referee)

ArmyCorpsPlayers (Training Audience)DivisionReal world tactical commsto echelons above and belowBrigadeBattalionPlayers/ControllersCompanySimulation Environment[A0] Develop ALSP Joint Training Confederation

[A1] Develop Concepts

[A11] Create Concepts

[A12] Review Concepts[A13] Approve Concepts[A2] Implement Concepts

[A21] Refine Concepts[A22] Develop OPSPEC[A23] Develop ICDs[A24] Develop AIDs[A25] Modify Software

[A26] Develop Test Plans, Enumerations[A261] Develop Component Tests[A262] Develop Functional Tests[A263] Develop Operational Tests[A264] Develop Load Tests[A265] Develop Enumerations[A265] Develop Technical Tests

[A3] Test Concepts

[A31] Develop Test Tools

[A32] Conduct Component Testing

[A33] Conduct Functional Interface Integration[A34] Conduct All-Actor Integration (AAI)[A35] Conduct Confederation Test (CT)

[A4] Deploy Confederation

[A41] Create Accreditation Report[A42] Accredit Confederation[A43] Post-CT Corrections

CINC/Service

Requirements

ALSP Master Plan

ALSP TechnicalSpecificationExercise SiteRequirements

Accredited

Confederation Software

Existing Simulations,AIS and test tools

Develop ALSPJoint TrainingConfederation

A0

()System SpecificationsReports: Test, AccreditationKnown Deficienciesand WorkaroundsTest Tools

Test EventHostsJTC UserCommunitySystems Engineer,Executive AgentALSP

Review Panel

Simulation Proponents,Developers

CINC/Service

RequirementsALSP TechnicalSpecificationExercise SiteRequirementsALSP Master PlanExistingCapabilitiesDevelopConceptsApprovedConceptsSystem

Specifications

ModifiedSoftwareExistingSimulations,AIS andTest ToolsA1ImplementConceptsA2Test Tools

TestConceptsA3DeployConfederationA4ExistingSoftwareTest PlansRevisionsReports: Test,AccreditationKnown

Deficienciesand

WorkaroundsAccreditedConfederationSoftware

ExistingTest ToolsTestedSoftwareJTC UserCommunity

Simulation Proponents,Developers

Test EventHostsALSPReview Panel

Exercise SiteRequirementsCINC/ServiceRequirementsALSP Master PlanExistingCapabilitiesCreateConceptsA11ConceptPapersDecisionPapersReviewConceptsA12ConceptChangesApproveConceptsA13Approved Concepts

Simulation Proponents,Developers

JTC UserCommunityALSPReview Panel

ALSP Master PlanSimulations,AISApprovedConceptsRevisionsRefineConceptsA21ALSP TechnicalSpecificationExercise SiteRequirementsCINC/ServiceRequirementsRefinedConceptsICDs,Tech. Spec.DevelopICDsA23DevelopAIDsA24AIDsSystemSpecificationsModifiedSoftwareDevelopTest Plans,EnumerationsA26DevelopOPSPECA22EnumerationsOPSPECModifySoftwareA25Test PlansJTC UserCommunitySimulation

Proponents, Developers

AIDsICDsALSP Technical

SpecificationExercise SiteRequirementsRevisionsDevelopComponentTestsA261DevelopFunctionalTestsA262DevelopOperationalTestsA263DomainExpertsTest Plans

DevelopTechnicalTestsA266DevelopLoadTestsA264DevelopEnumerationsA265EnumerationsSimulation

Proponents, DevelopersJTC UserCommunity

Test PlansSystem SpecificationsExercise SiteRequirementsLoad TestInputComponentTestsA32FunctionalInterfaceIntegrationsA33All-ActorIntegrationA34ConfederationTestRevisionsTestedSoftwareModifiedSoftwareTestReports

ExistingTestTools

DevelopTestToolsA31A35TestTools

Subject MatterExpertsSimulation

Proponents, DevelopersTest EventHostsJTC UserCommunity

ALSP Master Plan

Test ReportsCreateAccreditationReportA41DraftAccreditationReportCorrectableDeficienciesKnown

Deficienciesand

WorkaroundsAccreditationReport

AccreditConfederationA42Post CTCorrectionsA43TestedSoftware

AccreditedConfederationSoftware

ALSP

Review Panel

Simulation Proponents,Developers