• Shuffle
    Toggle On
    Toggle Off
  • Alphabetize
    Toggle On
    Toggle Off
  • Front First
    Toggle On
    Toggle Off
  • Both Sides
    Toggle On
    Toggle Off
  • Read
    Toggle On
    Toggle Off
Reading...
Front

Card Range To Study

through

image

Play button

image

Play button

image

Progress

1/149

Click to flip

Use LEFT and RIGHT arrow keys to navigate between flashcards;

Use UP and DOWN arrow keys to flip the card;

H to show hint;

A reads text to speech;

149 Cards in this Set

  • Front
  • Back
Earned Value Management (EVM) is an ________ process in the management and oversight of acquisition programs

integrating

The PM's approach to satisfying EVM requirements should be documented in the program _________

acquisition strategy (AS)

__________ is one of the Department's most powerful program management tools since it integrates the cost, schedule, and technical performance of a program

Earned Value Management (EVM)

The _______ combines the Contract Performance Report (CPR) and Integrated Master Schedule (IMS) into a single integrated report to be consistent with good, disciplined program management

Integrated Program Management Report (IPMR) Data Item Description (DID)

Represents the value of work planned to be accomplished; portrayed over the contract period equates to the Performance Measurement Baseline (PMB), the time-phased budget plan against which contract performance will be measured

Budgeted Cost of Work Scheduled (BCWS)

This EVM term represents "Earned Value" or the value of the work accomplished in relation to the PMB

Budgeted Cost of Work Performed (BCWP)

This EVM term represents the actual cost of the work accomplished

Actual Cost of Work Performed (ACWP)

BCWP – ACWP

Cost Variance (CV)

BCWP – BCWS

Schedule Variance (SV)

Indicates how much over or under budget the project is

Cost Variance (CV)
Calculated as: BCWP - ACWP
Positive CV, project under budget
Negative CV, project over budget

BCWP / ACWP

Cost Performance Index (CPI)

BCWP / BCWS

Schedule Performance Index (SPI)

Actuals to date + Work Remaining / Efficiency Factor

Estimate at Complete (EAC)

This EAC formula tends to be the optimistic estimate

Cumulative CPI method

This EAC formula tends to be the pessimistic estimate

Composite CPI method (CPI x SPI)

Management Reserve (MR) is not part of the PMB until _______

it is "used"

An Integrated Baseline Review (IBR) should be conducted within ___ months of contract award

6

You should conduct one of these within 6 months of contract award to identify and quantify cost, schedule, and technical risks

Integrated Baseline Review (IBR)

The PM should obtain integrated _________ and ________ performance data at an appropriate level of summarization to monitor program execution

cost and schedule

The program manager should require contractors and government activities to use internal management control systems that accomplish the following:

1) Relate time-phased budgets to specific tasks identified in the statement of work;
2) Produce data that indicate work progress;
3) Properly relate cost, schedule, and technical accomplishment; and
4) Produce data that is valid, timely, and auditable

The primary tool for measuring performance and identifying risk

The Performance Measurement Baseline (PMB)

The PMB is represented by which EVM term?

BCWS = Budgeted Cost of Work Schedule

Technical assessment activities would be used to measure which EVM term?

BCWP = Budgeted Cost of Work Performed

The object of the review is the _____ . . . not the Contractor

Performance Measurement Baseline (PMB)

The IBR is intended to provide _______ with a mutual understanding of the project PMB and to attain agreement on a plan of action to handle the identified risks

both Government and Contractor PMs

The IBR should confirm compliance with the following business rules:

1) Technical scope = consistent with authorizing documents
2) Key schedule milestones are identified; Supporting schedules reflect a logical flow to accomplish the technical work scope
3) Resources (budgets, facilities, personnel, skills, etc.) are adequate and available for the assigned tasks
4) Tasks are planned & can be measured objectively
5) Management processes

When discussing the concept of EAC, there are at least three
different perspectives that can be taken:

1) Contractor EAC - sometimes referred to as the
Latest Revised Estimate (LRE)
2) Government Program Office
3) OSD/Higher HQ

This EAC is based on detailed information; "bottoms-up" from the Control Account level

Contractor EAC; also called Latest Revised Estimate (LRE)

This EAC is based on analysis and incorporation of all program data and includes the PM perspective

Government Program Office EAC

This EAC is usually top-level and based on formulas; lacks program details; may be related to historical program data

OSD/Higher HQ EAC

The basic EAC formula:

EAC = ACWP + ([BAC - BCWP]/Performance Factor)

How does the program office choose a performance factor to use in EAC calculations?

Based on information that the program office has regarding what is happening technically, combined with risk assessment and other programmatic information, the program office determines which factor is the best predictor of contractor performance from "now" until contract completion

Post Implementation Review (PIR) is often associated with _______ efforts, while the term Post Deployment Review (PDR) is more often associated with ______ efforts

software intensive; hardware
(Note: The Interim 5000.02 uses "PIR" for both MDAP and MAIS systems)

The important "take away" of the _________ review is that the Agency, Service, Component, and the Program Manager must ensure that end-users receive what was promised (and what was contracted for)

Post Deployment Review (PDR)

The program manager uses post-implementation/deployment reviews (PIRs/PDRs) of the system, typically beginning at _________

Initial Operational Capability (IOC)

Post-implementation/deployment reviews (PIRs/PDRs) occur nominally every ______ years after IOC or when precipitated by changes in requirements/design or performance problems

3 to 5 years

Post-implementation/deployment reviews (PIRs/PDRs) should include, at a minimum:

• Customer Satisfaction: Is the warfighter satisfied that the .... investment meets their needs?
• Mission/Program Impact: Did the implemented capability achieve its intended impact?
• Confirmation that the validated need has not changed; or if it has, include as part of the course of action provided in the PIR report.
• A measure of the measures of effectiveness found in the Initial Capabilities Document.
• Benefits such as return on investment calculations found in the business plan. Compare actual project costs, benefits, risks, and return information against earlier projections. Determine the causes of any differences between planned and actual results

The ________ act requires that Federal Agencies compare actual program results with established performance objectives

Government Performance and Results Act (GPRA)

During integration and test, procedures called out in the program's ________ should verify compliance with the build specification

Systems Engineering Plan (SEP)

The program's _____________ and associated test products describe verification of compliance with the contract specification during developmental test and evaluation (DT&E) and verification of compliance with the CPD during OT&E

Test and Evaluation Master Plan (TEMP)

Who is responsible for planning the PIR, gathering data, analyzing the data, and assessing the results?

The Sponsor
Note: The PM is responsible for maintaining an integrated program schedule that includes the PIR on behalf of the Sponsor

What are some potential sources of data to evaluate the degree to which a capability has been achieved?

FOT&E Results
Platform Readiness Assessments
COCOM Exercises
User Satisfaction Surveys
Information Assurance Assessments
Annual Chief Financial Officer Report
Mission Readiness Reviews
Return on Investment Assessment
War Games
Lessons Learned

______ provide important user feedback and consequently are a fundamental element of evolutionary acquisition

Post-Implementation Reviews (PIRs)

The analysis portion of the PIR should answer the question:

"Did we get what we needed?"

Primary recipient of the PIR report

The Sponsor who articulated the original objectives and outcome-based performance measures on which the program or investment was based

Users are required, by DoD Directive, to track ____ and ____ rates and to report capability status quarterly so that joint force commanders have an accurate assessment of the readiness and capability of the forces provided by the Services to execute assigned missions

Mission Capable (MC) and Non-Mission Capable (NMC)

The list of "critical, discrete, externally-focused tasks that directly enables the execution of the organizational mission."

Mission Essential Task Lists (METLs)

A ____ is an activity (task) deemed as absolutely necessary, indispensable, and critical (essential) to mission accomplishment

mission essential task (MET)

____ is the single readiness reporting system and requires all service units to use a METs/METLs construct

Department of Defense Readiness Reporting System (DRRS)

DoDI 3110.05 5.3. prescribes "Condition Status Measurement" codes to describe the capability of weapon systems (other than ships and submarines) to perform mission(s). These codes are:

Mission Capable (MC)
Not Mission Capable (NMC)
-- Not Mission Capable Maintenance (NMCM)
-- Not Mission Capable Supply (NMCS)

Each Military Department shall have a program or process for the continuous identification of maintenance and materiel problems that adversely affect the readiness-based materiel condition of its weapon systems. This is called:

Problem Identification and Correction (PIAC)

A materiel condition indicating that weapon systems are capable of performing an identified mission

Mission Capable (MC)

A materiel condition indicating that weapon systems are not capable of performing an identified mission

Not Mission Capable (NMC)

A materiel condition indicating that weapon systems are not capable of performing an identified mission because of unit level maintenance requirements

Not Mission Capable Maintenance (NMCM)

A materiel condition indicating that weapon systems are not capable of performing an identified mission because of maintenance work stoppage due to a supply shortage

Not Mission Capable Supply (NMCS)

Mission Capable rate is the sum of ______ and ______

Full Mission Capable (FMC) + Partial Mission Capable (PMC)
Note: terminology varies by service

The three overarching and fundamental requirements inherent to the materiel fielding process:

1) The need to develop comprehensive and coherent materiel fielding plans
2) The need to coordinate materiel fielding issues, action plans, responsibilities, and schedules with the materiel's intended user(s)
3) The need to conduct a thorough assessment and review of the materiel'sreadiness for delivery to the user(s)

________ is a review event that precedes delivery of the materiel to the operational user

a Materiel Release Review (MRR)

During the production and deployment phase, PM's should focus on meeting the materiel delivery and acceptance requirements contained in the ______________

Life Cycle Management Plan (LCMP)

When deciding to release materiel to field units, the MDA may consider authorizing materiel releases according to the following criteria:

Full Release
Limited/Conditional Release
Interim/Training Release
Incremental Materiel Releases
Special Cases (e.g. JUONs, etc.)

This type of materiel release is warranted when the materiel delivery and acceptance criteria contained in the MFP/LCMP and PMA can be met unconditionally, or with risk mitigation procedures that are acceptable to the using command(s).

Full Release

This type of materiel release is warranted when the materiel delivery and acceptance criteria contained in the MFP/LCMP and PMA can only be partially met, or met with restrictions that would prevent or limit some aspect of the user's operations and/or maintenance concept

Limited/Conditional Release

In this type of material release the MDA will authorize materiel deliveries to begin, but may limit the quantity of materiel to be delivered or slow down the planned materiel delivery schedule to accommodate materiel get well plans

Limited/Conditional Release

This type of materiel release authorizes materiel deliveries for the purpose of conducting initial training only

Interim/Training Release

PMs may choose to employ an incremental materiel review concept for programs following an ________ strategy

evolutionary acquisition

________ signs the Materiel Fielding Decision memorandum which formally documents the decision to authorize the materiel to be fielded

MDA (SAE for ACAT ID and IAM)

DPAS __________ (can/cannot) force a contractor to produce an item they no longer produce or for one that they want to cease production indefinately.

cannot

A D.O. rating is approved by

Under Secretary of Defense, AT & L

A D.X. rating is approved by

SECDEF or DEPSECDEF via the recommendation of the Under Secretary of Defense, AT & L

With regards to DoD Priorities and Allocations, a DO rating is

given a production preference over unrated, commercial, orders

With regards to DoD Priorities and Allocations, a DX rating is

given a production preference over D.O. rated orders and unrated, commercial, orders

Privity of Contract is defined as:

the legal relationship and responsibilities between parties of the same contract

Requests for Special Priorities Assistance, SPA, are submitted to the DoD using form

BIS-999

Who is the proponent for enforcing DPAS regulation?

Department of Commerce

__________ is a measure of the degree to which an item is in the operable state

Availability

The probability that an item is operable at the start of a mission, usually expressed as a percentage

Availability

A measure of reliability that includes time between corrective maintenance actions only

Mean Time Between Failure (MTBF)

A measure of reliability that includes time between both corrective and preventative maintenance actions

Mean Time Between Maintenance (MTBM)

A measure of maintainability that includes the time to ACCOMPLISH corrective and preventative maintenance actions

Mean Maintenance Time (MMT)

An indicator of the average time a system is awaiting maintenance and is largely dependent upon the logistics support structure and environment

Mean Logistics Delay Time (MLDT)

Integrated Government-Contractor Approach to contracting is also known as _______

Alpha Contracting

This contracting approach uses the principles of concurrent and integrated, rather than serial, processing in a sole source environment to reduce acquisition cycle time

Alpha Contracting

Some characteristics of Alpha Contracting that represent a cultural change in the way the government and industry now work together

Open communication, partnership agreements, early Defense Contract Audit Agency/Defense Contract Management Command involvement, and reaching agreement on labor hours/mix

A major advantage of Alpha Contracting

Requirements can be put on contract in days or weeks rather than months or years

Some critical elements that are required for Alpha Contracting to be successful

• Specific management buy-in
• Willingness to trust exists on both sides
• Honesty is evident
• The team is empowered

The ______ theory states that as the quantity of a product produced doubles, the recurring cost per unit decreases at a fixed rate or constant percentage

unit learning curve

Learning Curve Theory is most straightforwardly applied in situations where the following conditions exist:

1. Uninterrupted serial production (i.e., no production breaks),
2. Consistent product design
3. Management emphasis on productivity improvement

_______ should be applied to the production portion of a system's cost estimate

Learning curve theory

Some examples of production conditions that can affect a system's learning curve:

1) Manufacturing methods and processes
2) Item complexity (more complexity = more opportunity for improvement)
3) Workforce stability
4) Production breaks

Two methods of deriving the learning curve are:

1) actual observation of the production line
2) by analogy to similar systems that have previously been produced

_________ analyzes the results of Service conducted Initial Operational Test and Evaluation (IOT&E) for each Major Defense Acquisition Program (MDAP) or designated oversight program

Director, Operational Test and Evaluation (DOT&E)

Beyond LRIP Report (BLRIP) is called _________ in the Interim DoDI 5000.02

DOT&E Report on IOT&E

A final decision to proceed beyond LRIP or Limited Deployment may not be made until the ______ has submitted the ______ Report to the Secretary of Defense and the congressional defense committees have received that report

DOT&E; DOT&E Report on IOT&E (also called BLRIP Report)

Whom is the BLRIP / IOT&E report submitted to?

Secretary of Defense [& USD(AT&L)], and
the congressional defense committees

The BLRIP (aka DOT&E Report on IOT&E) report is due before which milestone or decision point?

FRP/FD Decision Review (FRPDR)

The BLRIP Report states the opinion of the DOT&E as to the following questions:

• Whether the test and evaluation (T&E) performed were adequate
• Whether the results of such T&E confirm that the items or components actually tested are effective and suitable for combat
• Additional information on the operational capabilities of the items or components that the Director considers appropriate based on the testing conducted

Can a program proceed to operational use (fielding or IOC) before the FRP Decision Review is completed?

Yes, in which case the DOT&E issues an Interim BLRIP report

Considerations for evaluation of operational test & evaluation adequacy include:

• Realistic combat-like conditions
• Production representative system for Initial Operational Test and Evaluation
• Adequate resources
• Representative typical users

The overall degree of mission accomplishment of a system when used by representative personnel in the environment planned or expected for operational employment of the system considering organization, training, doctrine, tactics, survivability, vulnerability, and threat

Operational effectiveness (OE)

The degree to which a system can be satisfactorily placed in field use, with consideration given to reliability, availability, compatibility, transportability, interoperability, wartime usage rates, maintainability, safety, human factors, manpower supportability, logistics supportability, documentation, environmental effects, and training requirements

Operational suitability (OS)

Per 10 USC 2399, an MDAP may not proceed beyond LRIP until ______

Initial operational test and evaluation (IOT&E) of the program is completed & IOT&E Report (BLRIP report) is submitted to SecDef & received by Congressional defense committees

Per 10 USC 2399, operational testing of a major defense acquisition program may not be conducted until _________

The Director of Operational Test and Evaluation (DOT&E) approves (in writing) the adequacy of the plans (including the projected level of funding) for operational test and evaluation to be conducted in connection with the program

According to the DFARS, whose responsibility is it to conduct production surveillance?

cognizant contract administration office (CAO)

On which contracts is production surveillance required?

Criticality Designator A or B contracts

A skill, facility, process, or technology needed to design, develop, produce, repair, or maintain products used by the Department of Defense.

defense industrial capability

For all ACAT programs, defense industrial capability actions or investments of less than $10 million annually to preserve a capability are approved by the _____

Component Acquisition Executive (CAE) or Defense Acquisition Executive (DAE)

Defense industrial capability actions or investments to preserve a capability with an anticipated cost of $10 million or more annually requires the approval of the ____

USD (AT&L)) and coordination with the Deputy Under Secretary of Defense for Industrial Affairs and Installations (DUSD (IA&I))

DoD decisions to preserve an industrial capability will be based on _______ considering defense needs and all possible alternatives

a case-by-case analysis

You should initiate a Defense Industrial Capabilities Analysis only when _____

you become aware of a potential problem

Three scenarios that call for an industrial capabilities analysis:

1) DoD managers are faced with a problem in getting a needed
product or service that they cannot resolve within their routine
authorities and that may require special action or investment to resolve
2) individual firms, industry associations,
or other responsible sources warn DoD managers that an industrial
capability is endangered
3) product development or manufacturing is terminating either permanently or temporarily

The Department of Defense will only consider preserving an industrial capability that is needed ______

to support national security

The objective of industrial capability analysis is to determine those capabilities that are _____ and _____ for providing a product or service required for national security

truly unique and irreplaceable

Possible alternatives for addressing a loss of industrial capability include:

1) No Action
2) Foreign Sources
3) Substitutes
4) Buy-out To Meet Future DoD Needs
5) Technology Solution
6) Smart Shutdown
7) Maintain the Current Capability

Under this statute, the President is authorized to require preferential acceptance and performance of contracts or orders (other than contracts of employment) supporting certain approved national defense and energy programs, and to allocate materials, services, and facilities in such a manner as to promote these approved programs

Defense Production Act (DPA)

This Defense Priorities and Allocation System (DPAS) rating is "Highest national defense urgency"

DX

This Defense Priorities and Allocation System (DPAS) rating is "Critical to national defense"

DO

Special Priorities Assistance (SPA) requests should not be used to:

- Secure a price advantage
- Obtain delivery prior to the time required to fill a rated order
- Gain competitive advantage
- Overcome a supplier's regularly established terms of sale or conditions of doing business

Do you need privity of contract to request SPA?

No. A request for SPA can be submitted on behalf of another interested party.

Type of funding for O&M, MILPERS

Annual funding

Type of funding for RDT&E

Incremental funding

Type of funding for Procurement, MILCON

Full funding

Exceptions to full funding policy for procurement:

Advance procurement
Multiyear procurement (MYP)

In preparing your program's RDT&E budget request, you should request the amount required to cover ____

only those costs expected to be incurred for work to be done during a given fiscal year

In preparing your program's procurement budget request, you should request the amount required to cover ____

total estimated cost for a specific quantity of militarily usable end items deliverable in a 12 month funded delivery period

Under DODI 5000.02, "full funding" for your program requires:

that program funding and manpower be included both in the budget and in the out-years of the Future Years Defense Program (FYDP) sufficient to cover the current and future efforts described in the acquisition strategy

Full funding for a procurement program means:

funding for each fiscal year shall be sufficient to procure complete, usable end items (i.e., the item cannot depend on funding in a future year to make it usable for its intended purpose)

In terms of procurement programs, does the "full funding" policy require the total procurement quantity desired over the entire life of the program to be budgeted in any one single fiscal year?

No. Requires full funding for quantities on a year-to-year basis that can be delivered during a future 12 month period (as a maximum period)

What is the advance procurement exception to full funding policy used for?

Related to Long Lead-time Items in procurement appropriations. Exception needed because procurement action is not for a usable end item

What is the Multiyear Procurement (MYP) exception used for?

Associated with Economic Order Quantity (EOC) of components, parts or materials of the end item. Exception needed because contracted deliveries will exceed the 12 month funded delivery period

What are circumstances that justify use of the Advance Procurement exception?

- When necessary to maintain (protect) planned production schedule
- Lead-time of component greater than life of the appropriation
- Lead-time of component significantly longer than remainder of end item

What are some advantages of multiyear procurement?

Lower costs.
Stabilizing contractor plans and work forces.
Continuity of production, avoiding annual startup and phase out costs, etc.
Provides incentives for contractors to improve productivity.
Reduced administrative burden.
Broaden competitive bases - firms not otherwise willing or able to compete for lesser quantities, especially if high startup costs.

What are some potential problems with multiyear procurement?

Government liable for a penalty (in a decreasing amount) for early cancellation of contract
Can not budget for that cancellation/termination liability
Controversial concept (both in Congress & OSD)

What is the proper appropriation to use for LRIP items?

It depends. If purpose of items is to permit orderly increase in production ramp-up or to establish initial production base, use Procurement appropriation. If purpose is to provide production configured or representative articles for operational test and
- articles destroyed or not going into inventory, use RDT&E
- articles schedule to go into operational inventory, Procurement also appropriate

What is the appropriate type of funding for developing product improvements?

It depends. Can be RDT&E, Procurement, or O&M depending on following factors:
Does mod increase performance? Yes: RDT&E; No, next question:
Is independent DT or IOT&E required? Yes, RDT&E; No, next question:
Is system in production?
Yes, Procurement; No: O&M

Note: In all cases, mod kits for end items and installation of kits funded with Procurement

Only funds ____________ can be "reprogrammed."

"currently available" for obligation

A "Transfer" occurs when a reprogramming action results in

movement of budget authority from one appropriation to another (e.g. Aircraft procurement to RDT&E)

Types of reprogramming actions:

Below Threshold Reprogramming (BTR) (DD 1416)
Internal (DD 1415-3)
Congressional Notification (letter)
Congressional Prior Approval (DD 1415-1)

Congressional prior approval is required for reprogramming actions where:

-Procurement quantity increase
-Affects item of "special Congressional interest"
- Exceeds specific $$ thresholds (i.e., SECDEF general transfer authority or BTR threshold)
-Establishes a new program - or
-Involves the termination of an approved program
-Usually done by Services as part of an annual omnibus reprogramming submission

"Internal" reprogramming:

- Requires approval of USD (C)
-No change in purpose
-Documents realignment of funds to a different line item or appropriation
-May be used to correct mistakes in appropriations
-Does "not" mean "internal to a program", means internal to DoD
-Use DD Form 1415-3
-Also documents transfers of funds from the congressionally appropriated "transfer accounts"

Congressional Notification required for reprogramming actions:

- Requires 30-day notification to Defense Committee
- No action until 30 days after such notification
- Establishes a new program
- Est. new "procurement" program, including mods costing <$20M for the entire effort
- Est. new development effort costing <$10M for the entire effort
- Initiation of safety modifications of <$20M
- Termination of programs falling below BTR amounts

The quality management process shall:

- Establish capable processes
- Continuously improve processes
- Monitor and control critical processes and product variation
- Establish mechanisms for field product performance feedback
- Implement an effective root cause analysis and corrective action system

What are the manufacturing Key Characteristics to focus on to effectively monitor and control products and processes?

- Features Determined to Be Most Important to User [Product]
- Situations With High Probability of Defects Occurring, And/Or Going Undetected if they occur [Process]
- Consequences of Failure are Unacceptable:
-- Business loss (loss of business, warranty work) [Product]
-- Major Environment, Safety, or Health Impacts [Product and/or Process]
-- High "Re-Do" costs [Process]

Manufacturing "Key Characteristics" are:

Features whose variability has the greatest impact on fit, performance, or service life (one of several definitions)

May be defined as any unwanted condition or as the difference between a current and a desired end-state

Variation

To manage and reduce variation, the variation must be _______

traced back to its source

There are four major sources of variability in technical processes:

1. Insufficient design margins resulting from poor design practice, unrealistic requirements, and requirements creep
2. The inherent variability of any manufacturing process
3. Measurement systems all possess inherent variability, even if properly calibrated
4. Variable products provided by subcontractors and vendors, for the above reasons

Counters to variability in product performance and in manufacturing processes include:

1. Stable, realistic requirements, which include well-defined operating environments and accurate design reference mission profiles
2. A design process that includes producibility as a major requirement
3. The use of proven, mature manufacturing processes whose capabilities are well documented
4. The use of statistic tools such as Designed Experiments, Statistical Process Control and Analysis of Variance, on the manufacturing shop floor

Ensures sustainment considerations are integrated into all planning, implementation, management, and oversight activities associated with the acquisition, development, production, fielding, support, and disposal of a system across its life cycle

Life-cycle sustainment

______ is the application of the package of integrated product support elements and support functions necessary to sustain the readiness and operational capability of the system

Product Support