Skip to content

ci: stop running the Bats suites in the test gate - #1050

Merged
tbhb-agent merged 1 commit into
mainfrom
chore/stop-bats-gate-20261101
Nov 1, 2026
Merged

tbhb-agent merged 1 commit into
mainfrom
chore/stop-bats-gate-20261101

Conversation

@tbhb-agent

Copy link
Copy Markdown
Contributor

Summary

Commits and pull requests can pass the test gate without running the shell regression suites. Those suites remain available for manual runs.

Why

The Bats suites take minutes on every run, and each commit and pull request waits on them in CI and in the local publish path. That wait slows delivery more than the shell regressions they catch justify.

mise run test-hooks and mise run test-leaks still work for anyone who wants to run the shell suites directly. A later change can restore the check or delete the suites.

The main branch ruleset must stop requiring the test-bats contexts before merging, because deleted jobs never report.

Verification

Criterion Command Result
Lint mise run lint passes
Generated skills mise run check-generated-skills passes
Go suite mise run test-go passes
Python suite mise run test-py passes
Workflow lint mise run devtools:lint-workflows passes

Risk

Changes to the hook and leak scripts lose the coverage the Bats suites gave them. A defect in those scripts, such as a leak scan that stops matching a secret or a guard that stops refusing a command, now reaches the default branch without a failing check. Reverting the change restores the job and the task entries.

Compatibility: none

Loosens: yes

Related

Removes the gate for the suites tracked under #588.

The Bats suites take minutes on every run, and each commit and pull
request waits on them in CI and in the local publish path. That wait
slows delivery more than the shell regressions they catch justify.

This loosens a check: changes to hook and leak scripts lose the
coverage those suites gave them until someone restores it.

Assisted-by: claude-code:claude-sonnet-5-5
Signed-off-by: Tony Burns <tony@tonyburns.net>
@tbhb-agent tbhb-agent added change:chore PR with no user-facing change (chore, refactor, build, ci, test, style, perf) provenance:agent-assisted PR contains commits authored with AI assistance (see Assisted-by trailers) labels Nov 1, 2026
@tbhb-agent
tbhb-agent requested a review from tbhb as a code owner November 1, 2026 15:54
@tbhb-agent
tbhb-agent merged commit 7287ec8 into main Nov 1, 2026
32 of 33 checks passed
@tbhb-agent
tbhb-agent deleted the chore/stop-bats-gate-20261101 branch November 1, 2026 16:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

change:chore PR with no user-facing change (chore, refactor, build, ci, test, style, perf) provenance:agent-assisted PR contains commits authored with AI assistance (see Assisted-by trailers)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants