Regression Analysis
Detect test regressions and failure trends over time.
What It Does
Regression Analysis monitors your test results over time to detect when something breaks. It identifies newly failing tests, tracks flaky tests (those that alternate between pass and fail), and spots performance degradation (response time P50/P95/P99 increases). The system compares each execution against the historical baseline for that test pack and environment. When a regression is detected — whether a new failure, a response time spike, or an intermittent flake — the team is notified instantly via email with a link to the detailed regression report. Over time, the analytics engine builds a quality score that reflects your API health.
Overview
Automatically detect when previously passing tests start failing. Trend analysis shows failure patterns over time, identifies flaky tests (tests that flip between pass and fail), and catches performance degradation before it impacts users. The platform compares each execution against historical baselines and highlights regressions immediately — whether it is a status code change, a response time spike, or a newly missing field. Combined with the Test Scheduler, regression analysis runs continuously so you catch problems within hours, not days.
Key Capabilities
How It Works
- 1
Tests run on a schedule or in CI/CD pipelines, building historical baselines
- 2
Platform compares each execution against historical pass rates and response times
- 3
Newly failing tests, flaky tests, and performance regressions are flagged automatically
- 4
Alerts are sent to the team with failure details, trends, and direct report links
- 5
Quality score reflects overall API health based on regression patterns over time
Available on
business Plan & Above
Upgrade to the business plan to unlock this feature.
Try Regression Today
Start your 15-day free trial — no credit card required.