docs(runbooks): add test-strategy.md (RAN-46 AC #5)#89
Merged
Conversation
Closes the last missing runbook from the RAN-46 acceptance list: test-strategy.md per engineering-standards.md §4. Scope: - Test layers (unit / integration / e2e quality) with discriminators matching the codeiq codebase (Spring profile rule, @tempdir rule) - Coverage targets aligned to engineering-standards.md §1 (project-wide ≥85% floor, new-code ≥80%, critical paths 100%) - Detector test contract: positive + negative + determinism (per CLAUDE.md "Adding a New Detector") - Flake policy: same-PR resolution, no retry-loops in CI - Regression suite scope: mvn verify is the gate; E2E quality tests are nightly + on-demand, not per-PR Independent of the (A) ratify-Sonar-stack vs (B) revert-to-OSS-CLI ruling pending on RAN-46 — content references only the testing tiers, coverage targets, and flake policy that hold either way.
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Lands the last missing runbook from the RAN-46 acceptance criteria:
shared/runbooks/test-strategy.md. The other three (release.md,rollback.md,first-time-setup.md) shipped in #74;test-strategy.mdwas not included in that PR and is the only AC item I can land without the board's pending (A)/(B) security-stack ruling.What's in scope
@TempDirrule) calibrated to the codeiq codebaseengineering-standards.md§1: project-wide ≥85% (JaCoCo BUNDLE LINE COVEREDRATIO), new-code ≥80% (Sonar gate), critical paths 100% line+branchCLAUDE.md§ "Adding a New Detector"), with explicit two-negatives rule for discriminator-guard detectors (Quarkus, Fastify, etc.)@Disabled("flaky — RAN-XXX")with tracked issue; no CI retry-loopsmvn verifyis the gate (< 7 min wall-clock target); E2E quality runs nightly + on-demand, not per-PRWhat's intentionally out of scope
~/.claude/rules/build.md)first-time-setup.md§3)Independence from board ruling
This file references only test layers, coverage targets, and flake policy — all of which hold under both (A) ratify-Sonar-stack and (B) revert-to-OSS-CLI on RAN-46. No edits needed downstream regardless of which path is picked.
Test plan
🤖 Generated with Claude Code