professional plan

Test Packs

Group and batch-execute tests for focused regression runs.
Updated
Try It FreeSee a Demo

What It Does

Test Packs let you organize your test suite into logical groups for batch execution. Instead of running your entire suite every time, create focused packs for smoke tests, regression or feature-specific validation. Each pack maintains its own execution history and pass-rate trend, making it easy to spot which area of your API is degrading. Packs are the primary unit of execution: they run on demand, on the scheduler and from CI/CD on the Shift-Left Engine. Turn a whole pack on or off, and change its contents by ticking tests or editing its tag rule. Workflow packs can span projects, with an environment chosen for each project they touch.

Five Orders API tests are ticked into a Smoke pack that targets staging with parallelism 4 and can run on demand, from CI/CD or on a schedule; the pack runs, all five tests pass, and the pack pass-rate trend for the last eight runs grows

Overview

Bundle related tests into packs for batch execution. Create smoke packs for quick CI checks, full regression packs for nightly runs, or feature-specific packs for sprint validation. Pick a pack's tests by hand or by tag rule; a tag rule is re-evaluated at every run, so newly tagged tests join automatically. Functional packs run tests, and Workflow packs run end-to-end workflows, across projects if needed. Each pack tracks its own pass-rate history, can be assigned to schedules, triggered from CI/CD or run on demand, and carries its own target environment and parallelism. A run already in progress is refused, so a pack never runs twice at once.

Key Capabilities

Pick tests by hand or by tag rule, re-evaluated at every run
Functional packs for tests and Workflow packs for end-to-end journeys, across projects
Run sequentially or in parallel, with the concurrency you choose
Assign packs to schedules or CI/CD triggers
Track pack-level pass rates, trends and history over time
One target environment per pack: dev, staging or production

How It Works

  1. 1

    Select tests from your project and group them into a named pack

  2. 2

    Configure execution settings: target environment, parallelism, and test ordering

  3. 3

    Run the pack on-demand from the UI, via CI/CD triggers, or on a cron schedule

  4. 4

    View pack-level results with pass/fail breakdown and compare across runs

  5. 5

    Track pack-level trends in the analytics dashboard over time

Available on

professional Plan & Above

Upgrade to the professional plan to unlock this feature.

Start Free TrialView Pricing
Available on Professional plan and above
See pricing →

Documentation

Step-by-step guides for setting up and using Test Packs.

Go deeper

Guides and playbooks that show this capability in practice.

Risk-Based Test Selection for Enterprise CI/CD Pipelines

Read the guide

Smoke Testing vs Regression Testing: Key Differences

Read the guide

Related Features

Scheduler

Run test packs automatically, from every few minutes to monthly, in your time zone.

Learn more

CI/CD

First-party GitHub Action, Jenkins plugin and Azure DevOps task, plus a REST API for any other CI/CD tool.

Learn more

Shift-Left Agent

Run API tests from your own machine, against APIs only your network can reach.

Learn more

Try Test Packs Today

Start your 15-day free trial — no credit card required.

Start Free TrialBook a Demo