Use LEFT and RIGHT arrow keys to navigate between flashcards;
Use UP and DOWN arrow keys to flip the card;
H to show hint;
A reads text to speech;
48 Cards in this Set
- Front
- Back
primary purpose of test and evaluation (T&E) in a defense system’s development and acquisition program |
reduce or manage risks in DEVELOPMENT, ACQUISITION, and UTILIZATION |
|
the customers of T&E |
DEVELOPERS/ACQUISITION MANAGERS
DESIGNERS AND ENGINEERS
END-USERS
|
|
DOD test agencies |
ARMY TEST & EVALUATION COMMAND (ATEC)
ARMY EVALUATION CENTER (AEC)
|
|
DIRECTOR, OPERATIONAL TEST & EVALUATION(DOT&E)
|
theprincipal staff assistant and senior advisor to the Secretary of Defense on operational test and evaluation (OT&E) in theDoD
|
|
DIRECTOR, OPERATIONAL TEST & EVALUATION (DOT&E) is responsible for... |
OT&E and LFT&E POLICY and GUIDANCE, APPROVING TEST PLANS, REPORTING to CONGRESS,
MEMBER of DAB and ITAB |
|
ARMY TEST & EVALUATION COMMAND (ATEC) |
developmental testing, independent operational testing, independent evaluations, assessments,and experiments |
|
ARMY EVALUATION CENTER (AEC) plan, support, conduct and provide _________, __________, and __________inorder to provide essential information todecision-makers |
independent evaluations, assessments, and experiments
|
|
OPERATIONAL TESTCOMMAND (OTC) plans, conducts, and reports rigorous _________, __________, and __________ inorder to provide essential information for the ____________ and ________________ of Warfighting systems
|
operational tests, assessments, and experiments acquisition and fielding |
|
2 types of T&E testing
|
Developmental Test & Evaluation (DT&E) Operational Test & Evaluation (OT&E) |
|
Developmental Test & Evaluation (DT&E)
|
conducted in a CONTROLLED ENVIRONMENT emphasis on REPEATABILITY OF TEST RESULTS. PM RESPONSIBILITY provides SYSTEM SAFETY AND READINESS for OT&E |
|
______________________________ is conductedin a CONTROLLED ENVIRONMENT such aslabs, facilities, proving ground, test beds with emphasis on REPEATABILITY OF TEST RESULTS. Its PM RESPONSIBILITY and provides SYSTEM SAFETY AND READINESS forOT&E
|
Developmental Test & Evaluation (DT&E)
|
|
8 Types of Developmental Test & Evaluation
|
ResearchEffort/Test TechnicalFeasibility Test (TFT) Engineering Development Test (EDT) ProductionQualification Test (PQT) ProductionVerification Test (PVT) FirstArticle Test (FAT) ProductionAcceptance Test & Evaluation (PAT&E) Logistics Demonstration (LD) |
|
_______________________test is conductedduring pre-systems acquisition to determine early technical characteristics, tosupport the research of these items, and to provide fundamental knowledge forsolutions of identified military problems DEVELOPMENTAL TEST & EVALUATION (DT&E) |
ResearchEffort Test (RET)
|
|
___________________ test providesdata to assist in determining safety and health hazards and establishing systemperformance specifications and feasibility DEVELOPMENTAL TEST & EVALUATION (DT&E) |
Technical Feasibility Test (TFT)
|
|
______________________ test providesdata on performance, safety, NBC survivability, the achievability of a system’s critical technicalparameters, refinement and ruggedization of hardware configurations, anddetermination of technical risks DEVELOPMENTAL TEST & EVALUATION (DT&E) |
EngineeringDevelopment Test (EDT)
|
|
__________________ test is a system-level DT conducted post-MS C that ensures design integrity over thespecified operational and environmental range. It must be completed usinglow-rate initial production (LRIP) assets, when available, prior to the FRPdecision review DEVELOPMENTAL TEST & EVALUATION (DT&E) |
ProductionQualification Test (PQT)
|
|
_______________ test is asystem-level test conducted post-FRP decision review to verify that theproduction item meets critical technical parameters and contractspecifications, to determine the adequacy and timeliness of any correctiveaction indicated by previous (pre-FRP) tests, and to validate manufacturer’sfacilities, procedures, and processes. DEVELOPMENTAL TEST & EVALUATION (DT&E) |
ProductionVerification Test (PVT)
|
|
___________________ test is a series of formal contractual tests conducted to ensure the effectiveness of themanufacturing process, equipment, and procedures. FAT is conducted on a randomsample from the first production lot. Repeated if the manufacturing process, equipment, or procedure ischanged significantly and when a second or alternative source of manufacturingis brought online. DEVELOPMENTAL TEST & EVALUATION (DT&E) |
FirstArticle Test (FAT)
|
|
___________________ T&Eused to verify that each production unit meets contract requirements. It isusually conducted at the contractor's facility. The Defense Contract ManagementAgency (DCMA) may provide oversight. Other Government personnel representingthe developer and/or the User may also observe this testing. DEVELOPMENTAL TEST & EVALUATION (DT&E) |
ProductionAcceptance Test & Evaluation (PAT&E)
|
|
______________________ validatesSUPPORTABILITY, adequacy of MAINTENANCE PLANNING, System SupportPlan (SSP) to include INTERFACE COMPATIBILITY.Conducted on an ENGINEERING PROTOTYPE DEVELOPMENTAL TEST & EVALUATION (DT&E) |
Logistics Demonstration (LD)
|
|
The____________________ is normally conductedon those tasks performed at field level and somesustainment level by User representatives
|
Logistics Demonstration (LD)
|
|
OPERATIONAL TEST & EVALUATION (OT&E)
|
verifies that a system is operationally effective,suitable, and survivable for its intended use. OPERATIONAL EFFECTIVENESS(OE) & OPERATIONAL SUITABILITY (OS)
|
|
______________ verifies that a system is operationally effective, suitable, and survivable for its intended use. OPERATIONAL EFFECTIVENESS (OE) & OPERATIONAL SUITABILITY (OS)
|
|
|
FOUR BASIC TYPES of Operational Testing (OT&E) |
Early Operational Assessment (EOA) - Performed on prototypes tohelp decision makers assess the proposed concepts. Pre/Post MS B - Early UserTest (EUT) Operational Assessment (OA) - Conducted to assess the system'spotential to meet mission requirements. Supports a Low Rate Initial Production(LRIP) decision. Pre MS C/LRIP – Limited User Test (LUT) Initial Operational Test and Evaluation (IOT&) - Conducted onproduction or production representative articles to support a Full RateProduction Decision Review. Pre FRP – Initial Operational Test (IOT) Follow-on Operational Test and Evaluation (FOT&E) - Conductedafter the system is in production and may continue throughout the lifecycle. Post FRP – Follow-on Operational Test (FOT) and User AcceptanceTest (UAT) As Required: Customer Testand Supplemental Site Test (C4/IT only) |
|
Performedon prototypes to help decision makers assess the proposed concepts. OPERATIONAL TEST & EVALUATION (OT&E) |
Early Operational Assessment (EOA) Pre/Post MS B - Early UserTest (EUT) |
|
Conductedto assess the system's potential to meet mission requirements. Supports a LowRate Initial Production (LRIP) decision OPERATIONAL TEST & EVALUATION (OT&E) |
Operational Assessment (OA) Pre MS C/LRIP – Limited User Test (LUT) |
|
Conductedon production or production representative articles to support a Full RateProduction Decision Review OPERATIONAL TEST & EVALUATION (OT&E) |
Initial Operational Test and Evaluation(IOT&) Pre FRP –Initial Operational Test (IOT) |
|
Conductedafter the system is in production and may continue throughout the lifecycle OPERATIONAL TEST & EVALUATION (OT&E) |
Follow-on Operational Test and Evaluation(FOT&E) Post FRP –Follow-on Operational Test (FOT) and User Acceptance Test (UAT) |
|
CustomerTest and Supplemental Site Test (C4/IT only) are conducted
|
As Required
|
|
_______________________ is the ability of systems, units, or forces to providedata, information, materiel, and services to and accept the same from othersystems, units, or forces and to use the data, information, materiel, andservices so exchanged to enable them to operate effectively together
|
INTEROPERABILITY
|
|
Interoperability Certification is performed by
|
Joint Interoperability Test Command (JITC)
|
|
Definetest and evaluation
|
Testing: program, procedure or process to obtain,verify, or provide data to determine the degree to which a system or systemsmeet, exceed or fail to meet stated objectivesObtains raw data, Measures specific, individual performancefactors, Is resource intensive Evaluation: Independent process to review, analyze, and assessdata obtained from testing or other sources(Produces analyzed information from test data,modeling and simulation, or other sources, Draws conclusions by looking at how thefactors interact, Is intellectually intensive) |
|
Howwell it does the job?
|
OPERATIONAL EFFECTIVENESS
|
|
Howwell it can be supported?
|
OPERATIONAL SUITABILITY
|
|
PURPOSE OF LIVE FIRE TESTING and when it applies
|
Determines CREW SURVIVABILITY and/or SYSTEM VULNERABILITY Confirms LETHALITYof munitions/missiles against intended target set Mandated by FY87 Defense Authorization Bill Applies to all:ACAT Iand II major vehicles and weapons platforms, Conventional weapons that providesome degree of protection, Major munitions greater than 1M rounds |
|
&Eplanning and its function as the essential feedback mechanism for the SystemsEngineering Process
|
The VERIFICATION LOOP FEEBACK mechanismencompasses both VERIFICATION AND VALIDATION requirements T&E data feedback ENHANCES developmentprocess and system design updates and improvement |
|
VERIFICATION
|
thesystem meets the performance specifications accomplished through DevelopmentalTesting. (Didyou build it right?)
|
|
VALIDATION
|
the system fulfills the user’srequired capabilities accomplished through Operational Testing. (Did you buildthe right thing?)
|
|
TheT&E ______________________________must be UPDATED PERIODICALLY toensure that it stays current and integrates the various disciplines as theprogram evolves through its life cycle. |
Test and Evaluation Master Plan (TEMP)
|
|
Providesan overall test management plan and framework within which detailed T&Eplans are contained |
Test and Evaluation Master Plan (TEMP)
|
|
________________________________essentialin determining a system’s readinessfor Initial Operational Test andEvaluation (IOT&E)
|
Developmental Test and Evaluation (DT&E)
|
|
________________________helpsdetermine system operational suitabilityand effectiveness, and it addresses CriticalOperational Issues (COIs) that are definedby the User
|
Operational Test and Evaluation (OT&E)
|
|
ConcurrentDT/OT:
|
Circumstancesin which developmental testing and operational testing take place at the sametime as two parallel, but separate and distinct, activities
|
|
CombinedDT/OT:
|
Singletest program conducted to support developmental test and operational testobjectives
|
|
Integrated Testing:
|
Thecollaborative planning and collaborative execution of test phases and events toprovide shared data in support of independent analysis, evaluation, andreporting by all stakeholders, particularly the development (both contractorand government) and operational test and evaluation communities
|
|
theTest and Evaluation Master Plan (TEMP)is prepared by
|
Program Manager (PM) in conjunction with principal TestIntegration Working Group (TIWG) members
|
|
The____________ provides a single forum for the PM, and PMO members, for all T&Eissues, develops and maintains/manages T&ESTRATEGY, integrated TEST PROGRAM,integrated TEST SCHEDULE, and RESOLVE ISSUES
|
T&E WIPT
|
|
are any previously developed items regardless of the source of development-used exclusively for governmental purposesby federal, state, local, or allied governments.
|
NDIs (Non-Developmental Items)
|