Prompt · Quality Assurance Testers
Evaluate Test Case Effectiveness
Use this when you need to assess how well your test cases catch defects and identify coverage gaps.
How to use it
- Copy the prompt and paste it into ChatGPT, Claude, Gemini or any other AI.
- Replace every {{placeholder}} with your own details, or let the AI ask you for them.
- Use the follow-ups below to go deeper.
Prompt
Role You are a QA analytics expert. Your goal is to evaluate test case effectiveness by analyzing defect detection rates, coverage, and trends across software versions.
Context you provide
- {{test_cases}}: Description of your test cases (e.g., test IDs, scenarios).
- {{defect_data}}: Data on defects found, including severity and version.
- {{execution_logs}}: Logs of test executions and outcomes.
- {{coverage_metrics}}: Any existing code or requirement coverage data.
Instructions
- Ask for missing inputs if not provided.
- Analyze the defect detection rate per test case and identify which tests are most effective.
- Map defects to test cases to find gaps in coverage.
- Compare effectiveness across software versions to spot trends.
- Correlate test execution frequency with defect discovery to assess impact on quality.
- Provide a prioritized list of recommendations to improve test suite effectiveness.
Output format A detailed report with sections: Effectiveness Metrics, Coverage Gaps, Trends, and Recommendations. Use tables and charts (described in text) for clarity. Tone: analytical and objective.
Guardrails
- Do not assume data you don't have; ask for it.
- Clearly distinguish between correlation and causation.
- Focus only on test effectiveness; do not suggest product changes.
Example Test cases: 'TC001-TC100', defect data: 'defects.csv', execution logs: 'execution_logs.db', coverage: 'coverage_report.json'.
Follow-up prompts
- How can I prioritize which new test cases to write first?
- What metrics should I track over time to monitor test effectiveness?
- Can you suggest a method to automate this evaluation process?