Coverage Tracking

See Exactly Which API Endpoints Are Tested — and Which Aren't

Most teams can't answer "what percentage of our API is tested?" Total Shift Left shows you coverage by endpoint, method, status code, and parameter.

The coverage visibility problem

Blind spots everywhere

You have tests, but you can't tell which endpoints are covered and which have zero test cases.

Code coverage misses the point

Server-side code coverage tells you lines executed, not which API operations are tested.

New endpoints go untested

New API endpoints ship without tests. Nobody tracks what was added vs. what was tested.

Status codes are ignored

Tests cover the 200 response but skip 400, 401, 403, 404, and 500 scenarios.

Parameter coverage is unknown

Query parameters, headers, and request body fields — you don't know which combinations are tested.

Coverage trends are invisible

Is coverage improving or degrading across releases? Without tracking, you're guessing.

Why existing tools don't track API coverage

Most API testing tools tell you if tests passed. They don't tell you what isn't tested.

!
Postman: No coverage tracking at all. You can see which requests exist in collections but not what's tested vs. untested.
!
Code coverage tools: Istanbul, JaCoCo, and similar tools measure server-side code lines — not API endpoint coverage.
!
SoapUI / ReadyAPI: Basic request-level tracking. No endpoint, method, or parameter coverage visualization.
!
Manual tracking: Spreadsheets and wiki pages go stale immediately. Nobody updates them after the initial audit.

How API coverage tracking works in Total Shift Left

1

Import your OpenAPI spec

The platform maps every endpoint, method, status code, and parameter from your specification.

2

Generate tests and see coverage

AI generates tests and the coverage dashboard immediately shows what's covered and what's not.

3

Fill gaps with one click

Click on uncovered endpoints or status codes to generate targeted tests. Reach comprehensive coverage without manual work.

4

Track trends in CI/CD

Coverage metrics are reported on every pipeline run. Set quality gates to prevent coverage regressions.

4 levels

Endpoint, method, status, parameter

1 click

Generate tests for gaps

Per build

Coverage in CI/CD reports

Trends

Coverage over time

Enterprise readiness

What procurement, security, and platform-engineering ask for when coverage tracking is part of an audit-ready release process.

Role-based access

Five built-in roles with project-scoped assignment. Coverage data and gap-fill actions gated per role; every action captured in the audit log.

Audit-ready evidence

Per-release coverage reports retained and exportable in standard formats (JUnit, JSON). Auditable chain from change ticket → coverage delta → release approval.

On-prem & air-gapped

Coverage tracking runs entirely inside your infrastructure on the self-hosted edition. No outbound calls; AI-driven gap-fill uses your self-hosted LLM.

Quality gate enforcement

CI/CD plugins fail builds when coverage drops below the floor or when in-scope APIs miss required coverage categories. Encoded as policy, not human review.

Data residency

Coverage metrics, captured payloads, and run reports stay in the region your deployment runs in. Self-hosted keeps data with you; SaaS regions on the roadmap.

Regulated industries fit

Coverage evidence maps to SOC 2 CC7/CC8, PCI-DSS Requirement 11, FedRAMP CA-7, and HIPAA evaluation controls. See the regulated-industries pages for sector-specific framing.

For deployment topology see the deployment page; for the data-flow and access-control posture see platform security.

Frequently asked questions

  • What types of API coverage does Total Shift Left track?
    Four levels: endpoint coverage (which endpoints have tests), method coverage (GET, POST, PUT, DELETE per endpoint), status code coverage (2xx, 4xx, 5xx responses), and parameter coverage (query params, headers, body fields).
  • How is this different from code coverage?
    Code coverage (Istanbul, JaCoCo) measures which lines of server code are executed. API coverage measures which API operations — endpoints, methods, status codes, and parameters — have test cases. You need both for complete quality visibility.
  • Can I generate tests for uncovered areas?
    Yes. Click on any uncovered endpoint, method, or status code in the dashboard, and the AI generates targeted tests to fill the gap. One click, no scripting.
  • Does coverage integrate with CI/CD?
    Yes. Coverage metrics are included in pipeline reports. You can set quality gates to fail builds if coverage drops below a threshold — preventing coverage regressions.
  • Can I track coverage across multiple services?
    Yes. Each microservice has its own project and coverage dashboard. You can view coverage per service or across all services from a unified dashboard.
  • What does 85% coverage from first import mean?
    When you import an OpenAPI spec, the AI generates tests covering approximately 85% of your endpoints and methods. The remaining gaps (edge cases, specific parameter combinations) can be filled with one-click generation.

Generate your first API test suite in minutes

Import your OpenAPI spec. Get CI-ready tests. Track coverage. No code, no credit card, 15-day free trial.