Use LEFT and RIGHT arrow keys to navigate between flashcards;
Use UP and DOWN arrow keys to flip the card;
H to show hint;
A reads text to speech;
140 Cards in this Set
- Front
- Back
|
_____ assesses the degree to which the offeror's proposed technical approach for the requirements of the solicitation may cause disruption of schedule, increased cost, degradation of performance, the need for increased oversight, or the likelihood of unsuccessful contract performance.
|
Technical RIsk
|
|
|
_____ or _____ should not be used for source selection because it can open you up to protest.
|
Numerical Scales or Percentage Weightin
|
|
|
What is a benefit to Oral proposal?
|
Reduces government and contractors solicitation and proposal costs
|
|
|
Requirements for Oral proposal are communication in what Section of the RFP?
|
L
|
|
|
Evaluation Factors are communicated in what Section of the RFP?
|
M
|
|
|
_____ evaluates proposals against Section M criteria and proposals are evaluated independently of each other. |
Source Selection Evaluation Board |
|
|
_______ compares and rank orders proposals based on SSEB evaluations, provides recommendation to SSA (Does not select winning contractor)
|
Source Selection Advisory Council
|
|
|
______ approves Source Selection Plan and selects winning contractor.
|
Source Selection Authority
|
|
|
_____ means the expected outcome of an acquisition that, in the government's estimation, provides the greatest overall benefit in response to the requirement.
|
Best Value
|
|
|
Defense Contract Management Agency Source Selection process input includes: |
1. Past Performance Evaluations 2. Contractor Software Capability Maturity Evaluation 3. Validating contractors EVMS 4. Assist as a member of the SSEB |
|
|
When is full funding required? |
MS B
|
|
|
______ and ______ are evaluated at LFT&E.
|
Lethality and Survivability
|
|
|
A LFT&E waiver must be submitted and approved at _____.
|
MS B
|
|
|
______ is designated oversight for a LFT&E covered system.
|
Director, OT&E
|
|
|
______ testing supports the systems engineering process and certify readiness for initial operational testing (IOT&E).
|
DT
|
|
|
______ is the field test, under realistic conditions, of any item (or key component) of weapons, equipment, or munitions for the purpose of determining the operational effectiveness and operational suitability of the weapons, equipment, or munitions for use in combat by typical military users; and the evaluation of the results of such tests.
|
OT
|
|
|
_____ is to provide a timely assessment of the vulnerability/lethality of a system as it progresses through its design and development prior to FRP.
|
LFT&E
|
|
|
LFT&E Waiver only excuses the program from what?
|
Full Up System Level Testing
|
|
|
What constitutes a "covered system" when referring LFT&E?
|
1) User occupied and design to provide some degree of protection to its occupants in combat 2) A conventional munitions program or missile program; or a conventional munitions program for which more than 1,000,000 rounds are planned to be acquired. |
|
|
Approval of _______ allows release of formal RFP for EMD phase prior to the milestone review as well as proposal evaluation and source selection, as time permits.
|
Acquisition Strategy |
|
|
What is the 4 step process for FMS?
|
1. Letter of request 2. Letter of offer and acceptance 3. Implementation of sale 4. Follow-on support |
|
|
In FMS a signed letter of acceptance constitutes a _______.
|
Formal Agreement
|
|
|
The signed letter of offer and acceptance constitutes a formal agreement between the US and the purchasing country and would signify what?
|
Implementation of sale
|
|
|
______ is designed to manage manufacturing risk in acquisition while increasing the ability of the technology development projects to transition new technology to weapon system application.
|
Manufacturing Readiness Levels
|
|
|
Using the manufacturing readiness level definitions, an assessment of manufacturing readiness is a structured evaluation of technology, component, manufacturing process, weapon system or subsystem. It is performed to what?
|
1. Define current level of manufacturing maturity 2. Identify maturity shortfalls and associated costs and risks 3. Provide the basis for manufacturing maturation and risk management |
|
|
How do we encourage contractors to properly manage MRLs and manufacturing risk in acquisition while increasing the ability of the technology development projects to transition new technology weapon system applications.
|
Incentive contract
|
|
|
What are the DoD Manufacturing & Production Risk Reducers & Techniques?
|
1. IPTs 2. Production Readiness Reviews 3. DoD Manufacturing Technology 4. Supply Chain Management 5. Lean manufacturing |
|
|
What organizations might be of assistance of the PMO in assessing manufacturing and production risk?
|
1. DCMA 2. DoD Manufacturing Technology |
|
|
_______ is an organized/systematic approach that analyzes the functions of systems, equipment, facilities, services, and supplies to ensure they achieve their essential functions at the lowest life-cycle cost consistent with required performance, reliability, quality, and safety.
|
Value Engineering
|
|
|
______ attempts to eliminate, without impairing essential functions or characteristics, anything that increases acquisition, operation, or support costs.
|
Value Engineering
|
|
|
What role should value engineering play in the EMD phase?
|
1. ID individual high-cost subsystems or items to stimulate early detection of unnecessary costs in time to take corrective action 2. Develop alternative ways of providing required function w/ lower production and sustainment costs. 3. Analyze how suppliers can help reduce costs 4. Help lower production and sustainment 5. Seek opportunities to make the system easier to operate and maintain |
|
|
What are the five Ms of Manufacturing and Production risks?
|
Manpower, materials, machinery, methods, measurements
|
|
|
How goes congress gather information?
|
1. Informal inquiries 2. Formal inquiries 3. hearings 4. Fact-finding mission/visits |
|
|
Congress wants the MDA to sign that he/she is approving the process and will ensure the program is ______ and ______.
|
Affordable and executable
|
|
|
______ is the probability that a system, when in an actual operating environment, will be ready for commitment to system mission operations at any point in time. |
Operational availability |
|
|
A significant Nunn-McCurdy breach is an increase of ______% current baseline and _____% original baseline.
|
15, 30
|
|
|
A critical Nunn_McCurdy Breach is an increase of ____% current baseline and ____% original baseline.
|
25, 50
|
|
|
APB breach is ____% over program acquisition unit cost or average procurement unit cost.
|
10
|
|
|
Critical cost nunn-mccurdy breach requires _____.
|
Recertification
|
|
|
If the PMO has an APB breach, you have to notify the MDA of the breach and ____ the program.
|
Re-baseline
|
|
|
If the PMO has a change in their requirement, ______ must be updated.
|
APB
|
|
|
What is the greatest Life Cycle Cost to a program?
|
O&S Costs
|
|
|
The degree to which the LCC of an acquisition program is in consonance with the long-range modernization, force structure, and manpower plans of the individual DoD components, as well as for the Department as a whole.
|
Affordability Assessment
|
|
|
Two approaches to assess affordability:
|
1. Projected annual funding 2. Unit cost comparision |
|
|
Which affordability assessment addresses program funding and manpower requirements over the six-year programming period, and several years?
|
Projected annual funding
|
|
|
Which affordability assessment compares unit cost of a proposed program to that of an earlier program with a similar mission?
|
Unit cost comparision
|
|
|
_____ is assigned life cycle management responsibility and is accountable for the implementation, management, and oversight of all activities associated with development, production, sustainment, and disposal of a system across its lifecycle.
|
PM
|
|
|
_____ develops and implements a comprehensive product support strategy for the weapon system and conducts appropriate cost analyses to validate the product support strategy, including cost benefit analyses as outlines in the Office of Management
|
Product Support Manager
|
|
|
_____ is responsible for the activities and output of one or more product support providers and responsible for the activities and output of one or more product support providers within a specific product support element or across product support elements.
|
Product Support Integrator
|
|
|
_________ are assigned responsibilities to perform and accomplish the functions represented by the IPS elements which, per the Business Case Analysis (BCA) process and consistent with statute and policy, comprise the range of best value or statutorily assigned workloads that achieve the Warfighter support outcomes. |
Product Support Provider
|
|
|
_________ require defined outcomes and differ from a "best effort" approach typical of some DoD organic support processes. Provide clear delineation of performance outcomes, corresponding support requirements, and the resources required to achieve both. |
Product Support Arrangements
|
|
|
_____ is recognizing the fiscal constraints and treats cost as equally important to schedule and performance when making decisions across the program's life cycle.
|
Cost as an independent variable
|
|
|
PM should incorporate cost as an independent variable plan into the AS to support _____ and _____ trade-off by using objective and threshold tradespace. |
Schedule and performance |
|
|
MS B approval requires the MDA to approve what?
|
1. Program initiation 2. Entry into EMD 3. AS 4. APB 5. LRIP quantities 6. Exit criteria for EMD phase 7. Type of contract 8. MS B certification 9. ADM |
|
|
Supportability analyses and activities to mitigate during post MS B R&D contract:
|
1. Failure Modes and effects criticality analysis (FMECA) 2. reliability centered maintenance analysis 3. Repair Analysis 4. Maintenance Planning Analysis 4. Test, Analyze, Fix, test |
|
|
Which supportability analyses and activities mitigates each potential failure mode in a system is analyzed to determine its results or effects on the entire system. |
Failure Modes and Effects Criticality Analysis
|
|
|
Which supportability analyses and activities mitigates the used to develop a scheduled maintenance program with the goal of increasing system availability by identifying failures or potential failures before they degrade system effectiveness. |
reliability centered maintenance analysis
|
|
|
Who needs to be coordinated with when responding to a formal congressional inquiry?
|
MAJCOM Legislative Affairs, SAF/LL (Legislative Liaison), SAF/LLI (Legislative Affairs Inquiry Division), Civil Affairs, and Chain of Command
|
|
|
When are replies required for congressional inquiries?
|
4 days when sent to SECDEF. 5 days otherwise |
|
|
What are the risks to manufacturing and production?
|
- Unstable Requirements and Engineering Changes - Unstable production quantities and rates - Inadequate process proofing -Insufficient Materials Characterization - Changes to proven processes, materials, subs, components, etc. -Lack of producibility - Inadequate configuration management - Subcontractors Management Challenges - Special Tooling - Special Test Equipment |
|
|
Coordinate configuration management with manufacturing resources and aggregate design changes into blocks vs progressive changes align to what manufacturing and production risk?
|
Unstable requirements and engineering changes
|
|
|
One-time costs amortized over production-quantity decrease can lead to exorbitant per unit cost; PM should assure initial quantity projects are realist. What manufacturing and production risk is described here?
|
Unstable production quantities and rates
|
|
|
Assures functional products can be made in a real world factory. Design with manufacturing in mind and limit production of early items. What manufacturing and production risk is described here?
|
Inadequate process proofing
|
|
|
Changes with unintended consequences or compounded design variations. Strict control for manufacturing tolerances and operator/maintainer training is required. What manufacturing and production risk is described here?
|
Changes to proven processes, materials, subs, components, etc.
|
|
|
Product/system requires excessive technical skill or funds to reproduce. Design a system with recognition of realistic manufacturing capabilities. What manufacturing and production risk is described here?
|
Lack of producibility
|
|
|
Baselining then consistently tracking changes to functional and physical system. establish clear practices at all levels to maintain CM for the system. What manufacturing and production risk is described here?
|
Inadequate Config Management
|
|
|
70% executed by subcontractors with whom DoD has no direct legal agreement. Adequate communication and visibility between government, prime, and sub is required. What manufacturing and production risk is described here?
|
Subcontractor Management Challenges
|
|
|
Unique equipment to hold or position items for manufacturing. Minimize use as much as practicable since costs cannot be recouped. What manufacturing and production risk is described here?
|
Special Tooling
|
|
|
Unique equipment to test and evaluate functional and physical characteristics. Minimize use as much as practicable, since costs cannot be recouped. What manufacturing and production risk is described here?
|
Special Test Equipment
|
|
|
What are the emerging manufacturing risk areas?
|
- Re-manufacturing - ESOH concerns - Modeling and Sim - Civil-Military Integration - E-Commerce |
|
|
Sustainment of aging systems has lead to remanufacture requirements. Typically requires complete disassembly of systems along with repair and replacement of components. Design system components with potential for upgrade and replaceability. Which Emerging Manufacturing Risk is described here? |
Re-manufacturing
|
|
|
Concerned with the safety of environment, users, and workers. Designs must be stringently reviewed to minimize impacts. |
ESOH Concerns |
|
|
Tools to model the manufacturing process and ID risks and efficiencies. Potential to save substantial costs, but requires funding to implement. Which Emerging Manufacturing Risk is described here?
|
Modeling and Sim
|
|
|
Effort to avoid military specific manufacturing when civilian variants exists. Costs associated with developing military capability will be much lower if spread across commercial development costs. Which Emerging Manufacturing Risk is described here?
|
Civil-Military Integration
|
|
|
Electronic, internet-connected systems that enable real-time technical ops. Implementation risks allowing these systems to override traditional org focus. Which Emerging Manufacturing Risk is described here?
|
E-Commerce
|
|
|
What MRL should be achieved by the post-CDR assessment?
|
MRL 7
|
|
|
What MRL should be achieved by MS C?
|
MRL 8
|
|
|
How does a program address supportability issues?
|
- Baseline the system, reliability centered maintenance analysis, level of repair analysis, maintenance task analysis, trend analysis, root cause analysis
|
|
|
_______ can take many forms at many levels, leveraging the capabilities of a variety of product support providers. They can be established and implemented at the system, subsystem, or component level; they can more heavily leverage industry capabilities of the commercial sector, organic government capabilities or an integrated best value mix of commercial and organic sector competencies, capabilities, and expertise.
|
Product Support Strategy
|
|
|
_____ provide a structured and integrated framework for managing product support and scope the development of the product support strategy.
|
Integrated Product Support Elements
|
|
|
What are the 12 Integrated Product Support Elements?
|
- Product support management - Design interface - Sustaining Engineering - Supply support - Maintenance planning and management - Planning, handling, storage, and transportation - technical data - Support Equipment - Training and Training Support - Manpower/personnel - Facilities and infrastructure - Computer resources |
|
|
What are the PM's program support responsibilities?
|
- Assigned life cycle management responsibility and is accountable for the implementation, management, and oversight of all activities associated with development, production, sustainment, and disposal of a system across its lifecycle - Responsible for the development of an appropriate sustainment strategy to achieve effective and affordable operational readiness consistent with the warfighter resources allocated to that objective |
|
|
What are the PSM's program support responsibilities? |
- Assures achievement of desired product support outcomes through development and implementation of appropriate product support arrangements. - Adjusts performance requirements and resource allocations across product support integrators and product support providers as necessary to optimize implementation of the support strategy |
|
|
What are the responsibilities of the PSI?
|
- Assigned a role within the scope, direction and oversight of the PMS - Accomplish their product support role through the use of one or more product support providers - Responsible for the activities and output of one or more product support providers within a specific product support element or across support elements. - May be government or commercial |
|
|
What is a product support arrangement?
|
- A document that enacts and implements the relationships - It starts with the user defined performance requirements which are identified through the JCIDS - Are used to ensure performance expectations of all product support entities are clearly articulated - Require defined outcomes and differ from a best effort approach - Provide clear delineation of performance outcomes, corresponding support requirements, and the resources required to achieve both - Create a clear understanding of the outcomes and the commitments required to achieve those outcomes among all stakeholders |
|
|
Where is the DoD's manufacturing policy addressed? |
DoDI 5000.02
|
|
|
This MRL acts as an exit criterion for the MSA phase approaching a MS A decision. Technology should have matured to a TRL 4 and indicates it is ready for TMRR. Processes to ensure manufacturability, producibility, and quality are in place,
|
MRL 4: Capability to produce the technology in a laboratory environment
|
|
|
This MRL is typical of the mid-point in TMRR acquisition. Technologies should have matured to a TRL 5. The industrial base has been assessed to identify potential manufacturing sources and a manufacturing strategy has been refined and integrated with the risk management plan.
|
MRL 5: Capability to produce prototype components in a production relevant environment
|
|
|
This MRL is associated with the readiness for a MS B decision to initiate an acquisition program by entering EMD. Technologies should have matured to a TRL 6.
|
MRL 6: Capability to produce a prototype system or subsystem in a production relevant environment
|
|
|
This MRL is typical for the mid-point of the EMD phase leading to post-CDR assessment.
|
MRL 7: Capability to produce systems, subsystems, or components in a production representative environment
|
|
|
This MRL is associated with readiness for a MS C decision and entry into LRIP, Technologies should have matured to at least TRL 7. Detailed system design is complete and sufficiently stable to enter LRIP.
|
MRL 8: Pilot line capability demo; ready to begin LRIP
|
|
|
At this MRL, the system, component or item has been previously produced, is in production, or has successfully achieved LRIP. Technologies should have achieved TRL 9. This level is normally associated with readiness to enter FRP.
|
MRL 9: LRIP demonstrated; capability to begin FRP
|
|
|
_______ and ______ must be designed into the system and demonstrated prior to production decision. |
Supportability and affordability |
|
|
A certification of accomplishments to enter MS B must be submitted to congressional defense committees by the MDA with the first ______. |
Selected Acquisition Report |
|
|
What are the entrance criteria for production and deployment? |
- No significant manufacturing risk - Manufacturing processes under control |
|
|
FRP criteria includes demonstrated control of what? |
manufacturing process and acceptable reliability. |
|
|
The measure of the relative ease of manufacturing. |
Producibility |
|
|
Is tied to the design and to the producibility of the design. |
Manufacturing readiness |
|
|
Identify two concepts associated with MRL Assessments. |
- Ask a series of questions derived from the MRL definitions and threads to guide the assessment process and determine the MRL.
- Should include the actions necessary to bring readiness up to the target level in time to transition technology or support a milestone decision with manageable risk |
|
|
What are the MRL threads to be assessed? |
1. Technology and the industrial base 2. design 3. materials 4. cost and funding 5. process control and capability 6. quality management 7. manufacturing personnel 8. facilities 9. manufacturing management |
|
|
What provides a mitigation plan for each risk area throughout the duration of the program including part supplier and sub-tier applied risk management shortfalls? Every manufacturing readiness assessment should have one where an MRL has not achieved its target. |
Manufacturing Management Plan |
|
|
A measure of the degree to which proposed critical technology elements meet objectives and is a principal element of program risk. |
Technical Maturity |
|
|
A TRA should be conducted concurrently with which other reviews? |
Alternative System Review, SRR, PRR |
|
|
From a manufacturing perspective, the purpose of what is to ready the acquisition program for production by implementing manufacturing risk reduction activities that are reflected in the acquisition strategy. |
EMD phase |
|
|
What is the target MRL for LRIP? |
MRL 8 |
|
|
What is the target MRL for FRP? |
MRL 9 |
|
|
When should assessments of manufacturing readiness be conducted? |
In concert with the CDR and no later in EMD just prior to the MS C decision. |
|
|
What is a systems engineering technical review at the end of EMD that determines if a program is ready for production? |
Program level production readiness review |
|
|
Who acts as a buffer between the PM and Congress by responding to questions beyond the PM's reach or expertise, like policy or the latest DoD position? |
Service or Defense Agency Legislative Liaison |
|
|
This form of inquiry usual comes from congressional staff who routinely telephone DoD with inquiries year around, the bulk coming during peak periods in the budget enactment process. |
Informal Inquiries |
|
|
This form of inquiry arrives as congressional mail or transmittal sheets and are handled with the highest priority. |
Formal Inquiry |
|
|
Information the Air Force is required by statute to deliver to congress, or a proactive dissemination of information to Congress. |
Notification |
|
|
A measure of reliability that includes time between both corrective and preventative maintenance actions. |
Mean Time Between Maintenance |
|
|
A measure of maintainability that includes time to accomplish corrective and preventative maintenance actions. |
Mean Maintenance Time |
|
|
An indicator of the average time a system is awaiting maintenance and general includes time for locating parts and tools, locations equipment, dispatching personnel, reviewing technical manuals, complying with supply procedures, and awaiting transportation. |
Mean Logistics Delay Time |
|
|
______ may be difficult to accurately measure in a test environment. |
MLDT |
|
|
What is the formula for Operational Availability? |
MTBM/(MTBM+MMT+MLDT) |
|
|
The ability to allocate resources out of a future total budget projection to individual activities. |
Affordability |
|
|
Who determines affordability |
Component leadership |
|
|
What sets priorities and determines what a program can a component can afford for each acquisition? |
affordability analysis |
|
|
How long does affordability analysis remain valid? |
Typically 30 to 40 years but may be 15 years for components whose acquisitions all have planned life cycle costs of fifteen years or less. |
|
|
What design factors are included in supportability? |
Reliability, maintainability, support features |
|
|
An analysis procedures whereby each potential failure mode in a system is analyzed to determined its results or effects on the entire system. |
Failure Modes and Effects Criticality Analysis (FMECA) |
|
|
What uses information from FMECA to identify items most critical to system availability? Its purpose is to develop a scheduled maintenance program with the goal of increasing system availability by identifying failures or potential fails before they degrade system effectiveness? |
Reliability Centered Maintenance Analysis |
|
|
All failures and faults of both hardware and software are formally reported. Analyses are performed to determine the causes of failure, and positive corrective actions are taken. |
Failure Reporting, Analysis, and Corrective Action System (FRACAS) |
|
|
Under these conditions, the resources required to perform a function are increasing, or are about o increase significantly. |
Diminishing Manufacturing Sources and Material Shortages (DMSMS) |
|
|
______ should support the system engineering process by helping to develop alternative ways of providing the required functions with lower production and sustainment costs. |
Value Engineering |
|
|
What are the basic steps of a six sigma improvement program? |
Define, Measure, Analyze, Improve, Control |
|
|
A structured approach to understanding customer requirements and translating them into products that satisfy those needs. |
Quality Function Deployment |
|
|
When is the APB required? |
MS B, subsequent milestones and FRP decision |
|
|
The designated PM's implementation, management, and oversight of all activities associated with the acquisition, development, production, fielding, sustainment, and disposal of a DoD system across its life cycle. |
Life Cycle Management |
|
|
The package of support functions required to deploy and maintain readiness and operational capability of major weapon systems, sub systems, and components, including all functions related to weapon systems readiness. |
Product Support |
|
|
Provide structures and integrated framework for management product support |
Integrated Product Support Elements |
|
|
Assigned LCM responsibility and is accountable for the implementation, management, and overseeing of all activities associated with development, production, sustainment, and disposal of a system across its life cycle |
PM |
|
|
Develops and implements a comprehensive product support strategy for the weapon system |
PSM |
|
|
Assigned within the scope, direction, and oversight of the PSM and are responsible for the activities and output of one or more product support providers within a specific support element or across multiple elements |
PSI |
|
|
Assigned responsibilities to perform and accomplish the functions represented by the IPS elements which comprise the range of best value or statutorily assigned workloads that achieve war fighter support outcomes. |
PSP |
|
|
The foundational documents that enact and implement the relationships across the product support framework. Require defined outcomes and differ from a best effort approach typical of some DoD organic support processes. |
product support arrangements |
|
|
What are three life cycle sustainment measures? |
Material availability, material reliability, and O&S Cost |
|
|
When is a Yockey Waiver required? |
If a foreign customer requests a letter of offer and acceptance for a system that has not satisfactorily completed OT&E prior to FRP. |
