Quality Metrics Quiz
Validate your knowledge of quality metrics and reporting strategies.
What is Defect Detection Effectiveness (DDE) and what is a good target percentage?
DDE measures defect fix time; target: 50%
DDE = (Defects found in testing / Total defects) × 100%; target: >85%
DDE measures test execution speed; target: 100%
DDE = Number of testers / Number of defects; target: <1
What is the industry benchmark for defect density per KLOC (thousand lines of code)?
Which metric should you prioritize for an executive dashboard?
Number of test cases executed
Individual tester productivity
Release readiness score with business impact
Lines of code tested per day
What is defect leakage and what is an acceptable target?
Defect leakage = bugs fixed; target: 100%
Defect leakage = (Production defects / Total defects) × 100%; target: <10%
Defect leakage = test coverage; target: >90%
Defect leakage = automation %; target: 50%
For Mean Time to Resolve (MTTR), what is an appropriate target for P0 (blocker) bugs?
What is a vanity metric?
A metric tracked by executives only
A metric that looks impressive but doesn’t drive actionable insights
A metric related to visual testing
A metric that measures team morale
How should you calculate test automation coverage?
(Automated tests / Total developers) × 100%
(Time saved / Time invested) × 100%
(Automated tests / Total test cases) × 100%
(LOC automated / Total LOC) × 100%
What is the recommended number of key metrics for an executive dashboard?
Which statement about metrics is INCORRECT?
Metrics should align with business objectives
Trends are more valuable than snapshots
More metrics always mean better decision making
Metrics should drive actionable insights
What should a quality health score include?
Only test coverage percentage
Weighted average of multiple quality indicators (coverage, defects, automation, etc.)
Number of test cases only
Quiz Results Guide
9-10 correct: Excellent! You understand quality metrics deeply.
7-8 correct: Good knowledge. Review missed concepts.
5-6 correct: Fair understanding. Revisit the lesson.
Below 5: Study the lesson material again.
Defect Metrics
DDE = (Defects Found in Testing / Total Defects) × 100%
Defect Leakage = (Production Defects / Total Defects) × 100%
Defect Density = Total Defects / Size (KLOC/FP/SP)
Coverage Metrics
Code Coverage = (Lines Executed / Total Lines) × 100%
Requirements Coverage = (Req Tested / Total Req) × 100%
Automation Coverage = (Automated Tests / Total Tests) × 100%
Time Metrics
MTTD = Time Bug Introduced → Time Bug Detected
MTTR = Time Bug Reported → Time Bug Fixed
Quality Gates
Release Readiness = Weighted score of:
- Test Coverage (30%)
- Defect Density (25%)
- P0/P1 Status (25%)
- Automation % (20%)
Reporting Best Practices
- Focus on Trends - Show progression over time
- Provide Context - Compare against targets/benchmarks
- Be Actionable - Every metric should drive decisions
- Keep It Simple - 5-7 key metrics maximum
- Tell a Story - Use data to communicate quality narrative