Install
// changelog

v1.12.0

Sandbox-rerun confirmation for the flaky-test detector. The static rules infer flakiness from anti-patterns; sandbox-rerun raises confidence by re-running a flagged test in isolation N times and classifying it by the observed pass/fail mix — mixed confirms flaky, all-fail is a real failure, all-pass is transient (demoted to info). Opt-in and off by default, behind a runner seam that ships no language-specific runner yet.

Released June 21, 2026

Added

  • Sandbox-rerun confirmation for the flaky detector (ADR-0022). The static flaky rules infer flakiness from anti-patterns; sandbox-rerun raises confidence by actually re-running a flagged test in isolation N times and classifying it by the observed pass/fail mix:
    • a mixed pass + fail confirms the test is flaky (the finding is kept, with the empirical confirmation noted);
    • all fails is a real failure — genuinely red, not quarantined as a flake;
    • all passes is transient — the flake did not reproduce, so the finding is demoted to info and won’t trip a commit-stage --fail-on.
  • CommitBrief ships the orchestration — the N-rerun loop, the classification, and an early exit once a mixed result is proven (a flaky test usually confirms in two runs) — behind an executor seam so the core stays pure and testable. No language-specific test runner is embedded, so the feature is a transparent no-op until a runner is bound: existing behaviour is byte-identical.
  • Opt-in and off by default via --sandbox-rerun[=N] (bare flag uses N=5; precedence: flag > review.sandbox_rerun config > 0). The verdict rides the existing finding (suggestion text + a possible demotion) — no JSON-schema change (schema stays 1). New surface is additive: the --sandbox-rerun flag and the review.sandbox_rerun config key. No new dependency.