Verdicts & exit codes
Every run resolves to exactly one verdict, and each verdict maps to a stable process exit code — the contract that lets scout report --check gate a pipeline without parsing output.
Every run resolves to exactly one verdict, and each verdict maps to a stable process exit code. That mapping is the contract: it lets scout report --check gate a pipeline without anyone grepping markdown for emojis, and it stays fixed across versions so dashboards and CI rules don’t break under you.
| Verdict | Exit | What it means |
|---|---|---|
| verified | 0 | The flow held. A deterministic script was recorded or replayed. |
| partial | 0 | Scout healed a broken step on its own — review the new path before you trust it. |
| failed | 1 | A step no longer holds and could not be healed. The diff tells you which one. |
| blocked | 2 | Scout never got to observe — the app wouldn't start or the page wouldn't load. |
Reading the verdicts
verified— the flow held. A deterministic script was recorded (first run) or replayed (every run after). This is the only status that passes--check.partial— Scout healed a broken step on its own and re-recorded the path. The run is reported aspartialon purpose: the heal is automatic, but you sign off on the new path before trusting it. See self-healing.failed— a step no longer holds and could not be healed. The diff tells you which one.blocked— Scout never got to observe: the app wouldn’t start, the page wouldn’t load, or an AI run died for an infrastructure reason. It is never a judgment about your app — see a runner failure is never an app verdict.
The --check gate
scout report --check # exit 1 if ANY scenario is not `verified`, exit 0 otherwise
--check is the gate primitive. A scenario passes only with status verified; failed, partial, blocked, and pending all fail the check — so a self-healed partial deliberately blocks the pipeline until a human reviews the new path. An empty suite passes vacuously; test summary.total from --json if you require scenarios to exist. Wiring it into GitHub Actions is covered in Environments & CI.