• Shuffle
    Toggle On
    Toggle Off
  • Alphabetize
    Toggle On
    Toggle Off
  • Front First
    Toggle On
    Toggle Off
  • Both Sides
    Toggle On
    Toggle Off
  • Read
    Toggle On
    Toggle Off
Reading...
Front

Card Range To Study

through

image

Play button

image

Play button

image

Progress

1/48

Click to flip

Use LEFT and RIGHT arrow keys to navigate between flashcards;

Use UP and DOWN arrow keys to flip the card;

H to show hint;

A reads text to speech;

48 Cards in this Set

  • Front
  • Back

primary purpose of test and evaluation (T&E) in a defense system’s development and acquisition program

reduce or manage risks in DEVELOPMENT, ACQUISITION, and UTILIZATION

the customers of T&E

DEVELOPERS/ACQUISITION MANAGERS



DESIGNERS AND ENGINEERS



END-USERS


DOD test agencies

ARMY TEST & EVALUATION COMMAND (ATEC)



ARMY EVALUATION CENTER (AEC)



DIRECTOR, OPERATIONAL TEST & EVALUATION(DOT&E)
theprincipal staff assistant and senior advisor to the Secretary of Defense on operational test and evaluation (OT&E) in theDoD

DIRECTOR, OPERATIONAL TEST & EVALUATION (DOT&E) is responsible for...

OT&E and LFT&E POLICY and GUIDANCE, APPROVING TEST PLANS, REPORTING to CONGRESS,



MEMBER of DAB and ITAB

ARMY TEST & EVALUATION COMMAND (ATEC)

developmental testing, independent operational testing, independent evaluations, assessments,and experiments

ARMY EVALUATION CENTER (AEC) plan, support, conduct and


provide _________, __________, and __________inorder to provide essential information todecision-makers

independent evaluations, assessments, and experiments
OPERATIONAL TESTCOMMAND (OTC) plans, conducts, and reports rigorous _________, __________, and __________ inorder to provide essential information for the ____________ and ________________ of Warfighting systems

operational tests, assessments, and experiments




acquisition and fielding

2 types of T&E testing

Developmental Test & Evaluation (DT&E)




Operational Test & Evaluation (OT&E)

Developmental Test & Evaluation (DT&E)

conducted in a CONTROLLED ENVIRONMENT




emphasis on REPEATABILITY OF TEST RESULTS.




PM RESPONSIBILITY




provides SYSTEM SAFETY AND READINESS for OT&E

______________________________ is conductedin a CONTROLLED ENVIRONMENT such aslabs, facilities, proving ground, test beds with emphasis on REPEATABILITY OF TEST RESULTS. Its PM RESPONSIBILITY and provides SYSTEM SAFETY AND READINESS forOT&E
Developmental Test & Evaluation (DT&E)
8 Types of Developmental Test & Evaluation

ResearchEffort/Test


TechnicalFeasibility Test (TFT)


Engineering Development Test (EDT)


ProductionQualification Test (PQT)


ProductionVerification Test (PVT)


FirstArticle Test (FAT)


ProductionAcceptance Test & Evaluation (PAT&E)


Logistics Demonstration (LD)

_______________________test is conductedduring pre-systems acquisition to determine early technical characteristics, tosupport the research of these items, and to provide fundamental knowledge forsolutions of identified military problems




DEVELOPMENTAL TEST & EVALUATION (DT&E)



ResearchEffort Test (RET)

___________________ test providesdata to assist in determining safety and health hazards and establishing systemperformance specifications and feasibility




DEVELOPMENTAL TEST & EVALUATION (DT&E)



Technical Feasibility Test (TFT)

______________________ test providesdata on performance, safety, NBC survivability, the achievability of a system’s critical technicalparameters, refinement and ruggedization of hardware configurations, anddetermination of technical risks




DEVELOPMENTAL TEST & EVALUATION (DT&E)



EngineeringDevelopment Test (EDT)

__________________ test is a system-level DT conducted post-MS C that ensures design integrity over thespecified operational and environmental range. It must be completed usinglow-rate initial production (LRIP) assets, when available, prior to the FRPdecision review




DEVELOPMENTAL TEST & EVALUATION (DT&E)



ProductionQualification Test (PQT)

_______________ test is asystem-level test conducted post-FRP decision review to verify that theproduction item meets critical technical parameters and contractspecifications, to determine the adequacy and timeliness of any correctiveaction indicated by previous (pre-FRP) tests, and to validate manufacturer’sfacilities, procedures, and processes.




DEVELOPMENTAL TEST & EVALUATION (DT&E)



ProductionVerification Test (PVT)

___________________ test is a series of formal contractual tests conducted to ensure the effectiveness of themanufacturing process, equipment, and procedures. FAT is conducted on a randomsample from the first production lot. Repeated if the manufacturing process, equipment, or procedure ischanged significantly and when a second or alternative source of manufacturingis brought online.




DEVELOPMENTAL TEST & EVALUATION (DT&E)



FirstArticle Test (FAT)

___________________ T&Eused to verify that each production unit meets contract requirements. It isusually conducted at the contractor's facility. The Defense Contract ManagementAgency (DCMA) may provide oversight. Other Government personnel representingthe developer and/or the User may also observe this testing.




DEVELOPMENTAL TEST & EVALUATION (DT&E)



ProductionAcceptance Test & Evaluation (PAT&E)

______________________ validatesSUPPORTABILITY, adequacy of MAINTENANCE PLANNING, System SupportPlan (SSP) to include INTERFACE COMPATIBILITY.Conducted on an ENGINEERING PROTOTYPE




DEVELOPMENTAL TEST & EVALUATION (DT&E)



Logistics Demonstration (LD)
The____________________ is normally conductedon those tasks performed at field level and somesustainment level by User representatives
Logistics Demonstration (LD)
OPERATIONAL TEST & EVALUATION (OT&E)
verifies that a system is operationally effective,suitable, and survivable for its intended use. OPERATIONAL EFFECTIVENESS(OE) & OPERATIONAL SUITABILITY (OS)
______________ verifies that a system is operationally effective, suitable, and survivable for its intended use. OPERATIONAL EFFECTIVENESS (OE) & OPERATIONAL SUITABILITY (OS)

FOUR BASIC TYPES of Operational Testing (OT&E)


Early Operational Assessment (EOA) - Performed on prototypes tohelp decision makers assess the proposed concepts.


Pre/Post MS B - Early UserTest (EUT)


Operational Assessment (OA) - Conducted to assess the system'spotential to meet mission requirements. Supports a Low Rate Initial Production(LRIP) decision.


Pre MS C/LRIP – Limited User Test (LUT)


Initial Operational Test and Evaluation (IOT&) - Conducted onproduction or production representative articles to support a Full RateProduction Decision Review.


Pre FRP – Initial Operational Test (IOT)


Follow-on Operational Test and Evaluation (FOT&E) - Conductedafter the system is in production and may continue throughout the lifecycle.


Post FRP – Follow-on Operational Test (FOT) and User AcceptanceTest (UAT)


As Required: Customer Testand Supplemental Site Test (C4/IT only)

Performedon prototypes to help decision makers assess the proposed concepts.




OPERATIONAL TEST & EVALUATION (OT&E)



Early Operational Assessment (EOA)



Pre/Post MS B - Early UserTest (EUT)







Conductedto assess the system's potential to meet mission requirements. Supports a LowRate Initial Production (LRIP) decision




OPERATIONAL TEST & EVALUATION (OT&E)

Operational Assessment (OA)



Pre MS C/LRIP – Limited User Test (LUT)







Conductedon production or production representative articles to support a Full RateProduction Decision Review




OPERATIONAL TEST & EVALUATION (OT&E)

Initial Operational Test and Evaluation(IOT&)




Pre FRP –Initial Operational Test (IOT)

Conductedafter the system is in production and may continue throughout the lifecycle




OPERATIONAL TEST & EVALUATION (OT&E)

Follow-on Operational Test and Evaluation(FOT&E)




Post FRP –Follow-on Operational Test (FOT) and User Acceptance Test (UAT)

CustomerTest and Supplemental Site Test (C4/IT only) are conducted
As Required
_______________________ is the ability of systems, units, or forces to providedata, information, materiel, and services to and accept the same from othersystems, units, or forces and to use the data, information, materiel, andservices so exchanged to enable them to operate effectively together
INTEROPERABILITY
Interoperability Certification is performed by
Joint Interoperability Test Command (JITC)
Definetest and evaluation

Testing: program, procedure or process to obtain,verify, or provide data to determine the degree to which a system or systemsmeet, exceed or fail to meet stated objectivesObtains raw data, Measures specific, individual performancefactors, Is resource intensive


Evaluation: Independent process to review, analyze, and assessdata obtained from testing or other sources(Produces analyzed information from test data,modeling and simulation, or other sources,

Draws conclusions by looking at how thefactors interact, Is intellectually intensive)
Howwell it does the job?
OPERATIONAL EFFECTIVENESS
Howwell it can be supported?
OPERATIONAL SUITABILITY
PURPOSE OF LIVE FIRE TESTING and when it applies

Determines CREW SURVIVABILITY and/or SYSTEM VULNERABILITY


Confirms LETHALITYof munitions/missiles against intended target set


Mandated by FY87 Defense Authorization Bill




Applies to all:ACAT Iand II major vehicles and weapons platforms, Conventional weapons that providesome degree of protection, Major munitions greater than 1M rounds

&Eplanning and its function as the essential feedback mechanism for the SystemsEngineering Process

The VERIFICATION LOOP FEEBACK mechanismencompasses both VERIFICATION AND VALIDATION requirements




T&E data feedback ENHANCES developmentprocess and system design updates and improvement

VERIFICATION
thesystem meets the performance specifications accomplished through DevelopmentalTesting. (Didyou build it right?)
VALIDATION
the system fulfills the user’srequired capabilities accomplished through Operational Testing. (Did you buildthe right thing?)

TheT&E ______________________________must be UPDATED


PERIODICALLY toensure that it stays current and integrates the various disciplines as theprogram evolves through its life cycle.

Test and Evaluation Master Plan (TEMP)

Providesan overall test management plan and framework within which detailed T&Eplans are contained


Test and Evaluation Master Plan (TEMP)
________________________________essentialin determining a system’s readinessfor Initial Operational Test andEvaluation (IOT&E)
Developmental Test and Evaluation (DT&E)
________________________helpsdetermine system operational suitabilityand effectiveness, and it addresses CriticalOperational Issues (COIs) that are definedby the User
Operational Test and Evaluation (OT&E)
ConcurrentDT/OT:
Circumstancesin which developmental testing and operational testing take place at the sametime as two parallel, but separate and distinct, activities
CombinedDT/OT:
Singletest program conducted to support developmental test and operational testobjectives
Integrated Testing:
Thecollaborative planning and collaborative execution of test phases and events toprovide shared data in support of independent analysis, evaluation, andreporting by all stakeholders, particularly the development (both contractorand government) and operational test and evaluation communities
theTest and Evaluation Master Plan (TEMP)is prepared by
Program Manager (PM) in conjunction with principal TestIntegration Working Group (TIWG) members
The____________ provides a single forum for the PM, and PMO members, for all T&Eissues, develops and maintains/manages T&ESTRATEGY, integrated TEST PROGRAM,integrated TEST SCHEDULE, and RESOLVE ISSUES
T&E WIPT
are any previously developed items regardless of the source of development-used exclusively for governmental purposesby federal, state, local, or allied governments.
NDIs (Non-Developmental Items)