01
Start with the evidence path
QaCockpit does not execute customer test code. Your CI/CD provider runs the tests, the framework writes JUnit XML, and the pipeline retains that file as an artifact. QaCockpit then imports the exact run evidence into a Test Source.
- Make the test runner create one or more non-empty JUnit XML files.
- Retain those files on every completed run, including runs with failed tests.
- Connect GitHub Actions or Azure DevOps and create a Test Source.
- Run the source or let QaCockpit observe the provider run and import its evidence.
02
Copy a provider or framework example
GitHub Actions
Add workflow_dispatch, create JUnit XML, and retain it with upload-artifact.
Azure DevOps
Publish the JUnit directory as a Pipeline artifact and keep result publishing separate.
Evidence contractJUnit XML
Understand the portable result format, file discovery, failures, and multi-file reports.
FrameworkPlaywright
Configure the JUnit reporter and retain screenshots, videos, traces, and HTML evidence.
FrameworkREST Assured
Retain Maven Surefire XML and API diagnostics from a JUnit 5 test suite.
Quality signalTest Scope
Detect missing, added, and changed test identities instead of trusting counts alone.
03
From a Test Source to a release report
Connect CI/CD
Open Integrations in the authenticated application. Connect the QaCockpit GitHub App or the Azure DevOps organization, then refresh the provider inventory.
Configure a Test Source
A Test Source is one configured automation and result stream—not an entire repository. Select its repository, workflow or pipeline, default ref, framework, and result context.
Run and review evidence
A Test Execution keeps pipeline lifecycle, result intake, and test outcome separate. Combine several sources in a Campaign, compare expected and reported scope, review failures in the Failure Inbox, and share a versioned release report.
