Reading...
Play button
Play button
Use LEFT and RIGHT arrow keys to navigate between flashcards;
Use UP and DOWN arrow keys to flip the card;
H to show hint;
A reads text to speech;
146 Cards in this Set
- Front
- Back
|
What is Evaluation?
|
The tasks, tools, and techniques used to determine that the solution satisfies the requirements and meets the business need
|
|
|
What is the goal of conducting Evaluation?
|
To assess the solutions' ability to satisfy requirements and meet the business need
|
|
|
What are the major themes in the Evaluation domain?
|
Quality Control, Deployed Solution, Evaluate early and often
|
|
|
What are the tasks of the Evaluation domain?
|
Validate Test results, Analyze Solution Gaps, Get Solution Sign-off, Evaluate Solution Results
|
|
|
What is the mnemonic for the tasks in Evaluation?
|
VASE (Validate, Analyze, Signoff, Evaluate)
|
|
|
What is the definition of the task "Validate Test Results"?
|
Validate the solution's test results, reports, and other test evidence against the requirements acceptance criteria in order to determine whether the solution satisfies the requirements
|
|
|
What is the definition of the task "Analyze Solution Gaps"?
|
Analyze and communicate the solution's identified gaps and deltas using quality assurance tools and methods in order to enable stakeholders to resolve discrepancies between solution scope, requirements, and developed solution
|
|
|
What is the definition of the task "Get Solution Signoff"?
|
Obtain stakeholder sign-off on the developed solution using decision-making techniques in order to proceed with deployment
|
|
|
What is the definition of the task "Evaluate Solution Results"?
|
Evaluate the deployed solution using valuation techniques in order to determine how well the solution meets the business case and value proposition.
|
|
|
True or False: Solution testing is a business analysis activity
|
FALSE. Solution testing is not a BA activity, but validating test results is a large responsibility of the BA.
|
|
|
The BA works very close with the __ __ team in validating testing activities during Evaluation.
|
Quality Assurance
|
|
|
During Evaluation, the BA is responsible for reviewing the test __ and ___.
|
Plans and Cases
|
|
|
The __ __ provides a foundation for Evaluation.
|
Traceability Matrix
|
|
|
What is the main goal of the BA in Evaluation?
|
To determine whether the solution will be usable, adds value to the business, and is meeting project goals and objectives
|
|
|
What is the best tool to delineate the roles between BA and QA during Evaluation?
|
RACI
|
|
|
What are some of testing considerations to look at during Evaluation?
|
Integration, Data Migration, Access, Issue Tracking
|
|
|
What is the "Cost of Quality"
|
Includes all costs to a solution throughout its life.
|
|
|
What are the two types of Cost of Conformance?
|
Prevention Costs, Appraisal Costs
|
|
|
What are the two types of Cost of Non-Conformance?
|
Internal failure costs, External failure costs
|
|
|
What is the "Cost of Conformance"?
|
The money spent to avoid failure
|
|
|
What is the "Cost of Non-Conformance?"
|
Money spent because of failures during and after the project
|
|
|
Training and Equipment are examples of what type of Cost of Conformance?
|
Prevention Costs
|
|
|
Testing and Inspections are examples of what type of Cost of Conformance?
|
Appraisal Costs
|
|
|
What are "Prevention Costs"?
|
The cost of building a quality product
|
|
|
What are "Appraisal Costs"?
|
Assessing the quality of a solution
|
|
|
How does traceability factor into Evaluation?
|
Should be leveraged when validating test results by: 1) Verifying all requirements are tested and traced to test docs2) Track changes in requirements status as tests are executed
|
|
|
When should test results be validated in a Predictive project?
|
At the end of the project life cycle, either immediately before a release, or at an agreed-upon time after a release
|
|
|
when should test results be validated in an Adaptive project?
|
At the end of every iteration, sprint or release, when production-ready functional is available for the stakeholders to evaluate
|
|
|
What are the types of techniques used in Evaluating Test Results?
|
Validation, Verification
|
|
|
What is the difference between validating and verifying?
|
Validation checks for the effectiveness of a solution, and ensuring that it meets the business need. Verification is about the correctness of the solution, or the quality of it.
|
|
|
What are the tools used to validate test results?
|
- Day in the Life- Exploratory- Given-when-then- Integration testing- UAT
|
|
|
What are the tools used to verify the test results?
|
- Desk checking- Inspection- Peer review- Test- Walk-through
|
|
|
What is the output of the Validate Test Results task?
|
Validate Test REsults
|
|
|
What is a "Defect"?
|
A flaw in a deliverable that either lessens its quality, or causes it to vary from its preferred characteristics
|
|
|
What are some examples of types of defects?
|
Incorrect, incomplete, or missing requirements
|
|
|
What is the goal of the task "Analyze Solution Gaps"?
|
Analysis of test results to determine the level of conformance with the solution scope and requirements
|
|
|
Why is the task "Analyze Solution Gaps" performed?
|
To aid in making a decision on if the solution is ready for implementation
|
|
|
What are the considerations for "Analyze Solution Gaps"?
|
Solutions Gaps, Quality Management, Communicating
|
|
|
What are solution gaps?
|
Gaps between the state required functionality and performance and the results from the developed solution
|
|
|
Features or functions that do not meet acceptance criteria are best described as what?
|
Solution Gaps
|
|
|
True or False: Not all gaps are created equal
|
TRUE. Each gap should includes understanding of the overall impact
|
|
|
What are the three approaches to managing defects?
|
Resolve, Moderate, Accept
|
|
|
Defects that will not have a significant impact to the business value may be ___ for implementation
|
Acceptable
|
|
|
What type of matrix might be used to evaluate defects?
|
Defect Probability and Impact Matrix
|
|
|
What do quality management tools help to identify?
|
Trends in defects that are pertinent to understanding the overall causes and effects of solution quality
|
|
|
How does a Checksheet help in evaluating quality?
|
Identifies and counts the main contributing factor to each defect
|
|
|
How does a Pareto diagram help in evaluating quality?
|
Helps bring the overall quality of the solution up faster
|
|
|
How does Root Cause Analysis help in evaluating quality?
|
Identifies correction action that will have the biggest impact on quality improvement
|
|
|
How do Control Charts help in evaluating quality?
|
Provide big picture on variances in quality measures for better understanding of impact to stakeholders
|
|
|
What types of techniques are used in Analyzing Solution Gaps?
|
Analytic, Quality Management
|
|
|
What are some of the analytics tools used in Analyzing Solution Gaps?
|
Decomposition, Gap Analysis, Impact Analysis
|
|
|
What are some of the quality management techniques used in Analyzing Solution Gaps?
|
Control Charts, Interrelationship Diagram, Pareto Diagram, Ishikawa
|
|
|
Special attention needs to be given to providing the right __ of information about defects, so that they can make an informed decision without extraneous information that may cloud or confuse judgment
|
Level
|
|
|
What is the output of the task "Analyze Solution Gaps"?
|
Gap Analysis, REsolved Discrepancies
|
|
|
What is the goal of the task "Get Solution Signoff"?
|
To get formal signoff before a solution is implemented
|
|
|
Who is responsible for facilitating approval and sign-off?
|
Business Analyst
|
|
|
What are the considerations for "Get Solution Signoff"?
|
Go/No-Go Decision, Sign-off
|
|
|
Who is responsible for facilitating a go/go-no decision for solution implementation?
|
Business Analyst
|
|
|
True or False: the BA should make a recommendation on a go/no-go decision
|
TRUE. The BA should including rationale and anticipated impacts of not following the recommended solution.
|
|
|
What types of alternatives might be considered in the go/no-go decision?
|
- Implementing- Implementing w/ planning corrective action- Delaying implementation- Canceling (Do not implement)
|
|
|
What is "Sunk Cost"?
|
The cost already invested in a project or solution. Sunk costs often unduly influence stakeholders to proceed with solution implementation in order to not "waste" the investment.
|
|
|
True or False: Sunk Cost should be considered in your go/no-go decision
|
FALSE. They cannot be recovered, and the solution should only be evaluated based on future value to be achieved
|
|
|
What governs the sign-off process?
|
Requirements Management Plan
|
|
|
What types of projects are more likely to required formal sign-off?
|
Complex, Far-reaching
|
|
|
What is a "wet signature"?
|
A handwritten signature
|
|
|
What type of techniques are needed for the task "Get Solution Signoff"?
|
Decision Making
|
|
|
what are some examples of decision making techniques?
|
Delphi, Multi-voting, nominal group, options, weighted criteria
|
|
|
What is the output of the task "Get Solution Signoff"?
|
Official, documented approval
|
|
|
What is the purpose of the task " Evaluate Solution Results"?
|
The evaluate the deployed solution using valuation techniques in order to determine how well the solution meets the business case and value proposition
|
|
|
What area is often neglected in business analysis?
|
Evaluating Solution Results
|
|
|
When the "Evaluating Solution Results" happen?
|
After a solution is deployed/implemented
|
|
|
The project goals, objectives, and solution acceptance criteria serve as a __ for evaluation.
|
Basis
|
|
|
What is a residual benefit of performing the task "Evaluate Solution Results"?
|
Insights can be applied to future projects
|
|
|
What are the considerations for Evaluating Solution Results?
|
Measuring Results, Understanding Solution Options, Future Projects
|
|
|
What does it mean to evaluate a deployed solution?
|
Conducting an assessment after the project is closed and the project team is dispersed
|
|
|
What are the main elements used as the basis of evaluation?
|
KPIs and Assessment Criteria
|
|
|
Long-term analysis requires capturing both __ and __ metrics over time to identify trends that will inform future product decision
|
Individual, Cumulative
|
|
|
What are some likely outcomes of understanding solution options?
|
- Continue maintenance and operation of the solution- Enhance the solution- Update business processes- Replace solution or phase out
|
|
|
What types of techniques are used to "Evaluate Solution Results"?
|
Evaluation, Measurement, Valuation
|
|
|
What are the evaluation techniques used in Evaluat Solution Results?
|
- Lessons Learned- Retrospectives
|
|
|
What are the measurement techniques used in Evaluat Solution?
|
- KPIs- SLAs- Planguage
|
|
|
What are the valuation techniques used in Evaluat Solution Results?
|
- Cost-Benefit Analysis- Force field Analysis- Kano Model- NPS- Purpose Alignment Model- SWOT Analysis- Value Stream Map
|
|
|
What is the output of the task "Evaluate Solution Results"?
|
Solution Assessment
|
|
|
What does a solution assessment include?
|
Recommendations for specific actions to increase overall value, including potential enhancement or recommendations to replace or phase out solution
|
|
|
What is a Checksheet?
|
A tool used to collect sampling results information about defects which then may be further analyzed using a Pareto Diagram
|
|
|
What is a Control Chart?
|
A chart used to determine whether a process is stable or has predictable performance over time
|
|
|
What is measured in a control chart?
|
Output variables representing repetitive activities
|
|
|
What can control charts be used for?
|
Both project and product life cycle processes
|
|
|
What do UCL and LCLs represent?
|
The voice of the customer
|
|
|
In a Control Chart, what does the middle line represent?
|
The mean, or average of the data
|
|
|
In a control chart, what is it called when six points in a row are all increasing or decreasing?
|
A Trend
|
|
|
In a control chart, what does it mean when seven points in a row are on the same side of center?
|
Rule of 7
|
|
|
What represents "Out of Control" on a control chart?
|
One point or more than 3 sigma from the center line (outside of control limits)
|
|
|
What does it mean when a process is out of control?
|
It's unstable
|
|
|
What does it mean when a process is in control?
|
It's stable
|
|
|
When a data point falls within control limits that do not follow stated rules, it is called what?
|
Common or random cause variation
|
|
|
What is a "Design of Experiments"?
|
A statistical "what-if" scenario to determine which combination of variables produce the best or desired quality outcome
|
|
|
What unique things does Design of Experiments provide?
|
A tool for modifying multiple factors at the same time rather than just one at a time
|
|
|
True or False: Design of Experiments is typically used on a project
|
FALSE. This technique is typically used on products, rather than projects.
|
|
|
What is a Flow Chart?
|
A graphical depiction of how the process flows from beginning to end gto show components are related
|
|
|
What is a Histogram?
|
A bar chart showing how often something occurs
|
|
|
What do histograms identify?
|
Root cause of problems by the shape and width of the distribution
|
|
|
What element do histograms typically not include?
|
Time and how variations occur over time
|
|
|
What is a Matrix Diagram?
|
A series of columns and rows to map factors, causes, and objectives that are related
|
|
|
What is a Pareto Diagram?
|
A diagram that represents the 80/20 rule,showing how many results were generated by type or category of identified causes
|
|
|
What are the "Vital Few" in a Pareto Diagram?
|
The problems that, if fixed, will eliminate 75-80% of the problems
|
|
|
What are the "Trivial Many" in a Pareto Diagram?
|
The remainder of the problems, that represent the other 20% of problems besides the vital few
|
|
|
What is a Process Decision Program Chart (PDPC)?
|
A tool where process steps are identified and mapped in order to identify any potential issues and needed contingency plans
|
|
|
What is a "Scatter diagram"?
|
A diagram that shows the relationships or correlations between independent and dependent variables
|
|
|
What does the X axis on a Scatter diagram represent?
|
Dependent variables (aka "Outputs" or "effects")
|
|
|
What does the Y axis on a Scatter diagram represent?
|
Independent variables (aka "inputs" or "potential causes")
|
|
|
Which axis on a scatter diagram represents the Dependent variables?
|
X axis
|
|
|
Which axis on a scatter diagram represents the Independent variables?
|
Y axis
|
|
|
True or False: Scatter diagrams show cause and effect
|
FALSE. They show correlation, not cause and effect. Additional analysis will be needed.
|
|
|
What is "Statistical Sampling"?
|
A technique where a small number of items representing a sample of the entire quantity are chosen for inspection.
|
|
|
Why might Statistical Sampling be used?
|
To reduce the cost and quantity rather than inspecting every item
|
|
|
What are the two types of Statistical Sampling?
|
Attribute, Variable
|
|
|
What is Attribute Sampling?
|
The result is rated by whether or not the product conforms
|
|
|
What is Variable Sampling?
|
The result is rates by the degree of conformity
|
|
|
What is "Day in the Life" Testing?
|
Testing conducted by someone knowledgeable in the business that focuses specific scenarios in order to verify the expected results are realized
|
|
|
What is "Exploratory Testing"?
|
Testing conducted by someone with knowledge of the business and testing without a script.
|
|
|
Out of the Box testing is also know as what?
|
Exploratory testing
|
|
|
___ testing supplements formal testing methods, but should not be done in place of them
|
Exploratory
|
|
|
What is "Given-when-then" testing?
|
A tool used to articulate acceptance criteria using a prescribed format
|
|
|
What is "Integration Testing"?
|
Testing conducted to ensure that requirements for the complete business process have been satisfied
|
|
|
What type of testing focuses on end-to-end business and includes all of the system and integration points within scope of the solution?
|
Integration testing
|
|
|
What is "User Acceptance Testing"?
|
Testing conducted by someone with in-depth business knowledge at the direction of the project business analyst and QA professionals in order to validate the solution meets the defined acceptance criteria.
|
|
|
True or False: UAT testing is often scripted and observed by the BA and/or QA
|
TRUE. BAs and/or QAs may observe to ensure full coverage
|
|
|
What is "Desk Checking"?
|
A technique in which the person who creates the deliverable reviews their own work prior to representing it from formal quality control review
|
|
|
What is "Inspection"?
|
A rigorous form of peer review
|
|
|
What does "inspection" ensure?
|
That the requirements are acceptable in their current form
|
|
|
What is a "Peer Review"?
|
A process involving peers of the BA to ensure that the documented BA deliverables comply with the standards of the organization
|
|
|
Who might participate in a peer review?
|
BACOE, QA, Quality Testing
|
|
|
What is another name for a formal peer review?
|
Walk-through
|
|
|
What is the purpose of a peer review?
|
To catch errors, oversights, and incorrect assumptions (early in the project)
|
|
|
When is the cost higher to discover errors or oversights in a project?
|
At the beginning
|
|
|
What is a "Test"?
|
Examination of a work product or deliverable to determine the level of quality
|
|
|
What is a "walk-through"?
|
An activity t review require,ments with stakehoders to confirm that requirements are valid as stated.
|
|
|
What are the steps of a "walk-through"?
|
Pre-requisites, Process, Rules
|
|
|
Walk-throughs provide the business what?
|
The opportunity to analyze and address issues before obtaining final approval
|
|
|
What are the elements of a walk-through?
|
- Complete requirements package- List of appropriate reviewers- Meeting vehicle- Review Scope- Organize and schedule review- Conduct the review- Compile notes and results of the review- Re-review if necessary- Rules to be followed during the review
|
|
|
what is the process of a walk-through?
|
a) Review Scopeb) Organize and schedule the reviewc) Conduct the reviewd) Compile notes and resutls of the reviewe) Re-review, if necessary
|
|
|
Who should particpate in a walk-through?
|
Author, scribe, moderator, peer, reviewer, approver
|
|
|
Who show NOT participate in a walk-through?
|
The author's supervisor
|
|
|
What are some common walk-through rules?
|
- Leave titles at the door- Disagree with ideas, not people- Come prepare
|
|
|
What is the expected output of a walk-through?
|
List of questions, comments, concerns, and suggestions
|
