Skip to content

Verify the skill against CLI v0.2.35 and correct the detection boundary - #15

Merged
DeliriumPulse merged 2 commits into
mainfrom
chore/cli-0.2.35
Aug 7, 2026
Merged

Verify the skill against CLI v0.2.35 and correct the detection boundary#15
DeliriumPulse merged 2 commits into
mainfrom
chore/cli-0.2.35

Conversation

@DeliriumPulse

@DeliriumPulse DeliriumPulse commented Aug 7, 2026

Copy link
Copy Markdown
Collaborator

What changed and why

The skill told agents that "a local run never performs injection or taint analysis." CLI v0.2.35 made that false. The shared SAST engine and its source-to-sink taint tracking now run locally over JavaScript, TypeScript and TSX.

Left alone, the plugin would have agents tell developers their code was never checked for a class the CLI had just started checking — the exact failure mode the pinned trust-boundary strings in validate.mjs exist to prevent.

Verified against the real 0.2.35 tarball, not the changelog

Extracted codetruss-cli-0.2.35.tgz and ran the binary:

Claim Check Result
Documented commands still hold --help on the built binary all 12 commands and their flags unchanged
verify-policy trust-key --help now listed in the banner (the CLI README's "omitted from --help" note is stale)
Local SAST runs real review run profile local-registry-v2, "What the local security pass checked" section present
Scope inference (v0.2.32) review with no --allow file marked allowed (inferred), clean run exits 0
Suggested fixes (v0.2.34) review over a committed Stripe key Suggested fixes section renders with the value masked
Exit codes --help + real runs PASS=0, REVIEW_REQUIRED=1, FAILED=2, usage=3 — unchanged

Because every documented command still holds, this is a version-reference and truth update rather than a rewrite.

Changes

  • Canonical skill: CLI floor v0.2.30 → v0.2.35; the detection-boundary bullet replaced with what actually runs locally versus what stays hosted, and an instruction to read the receipt's own "What did not run" section rather than assert the boundary from memory, since it moves between releases.
  • Added the REVIEW_REQUIRED ceiling for local security findings, so an agent does not escalate one as blocking.
  • One line each on scope inference and suggested fixes, both phrased as constraints on agent behavior rather than feature copy.
  • Both plugin copies re-synced from the canonical skill (byte-identical, as validate.mjs requires).
  • All three READMEs moved to v0.2.35, including the "verified against the shipped CLI" line.
  • The root README's verbatim receipt excerpt is a real 0.2.35 run reproducing the documented scenario, not the old capture edited by hand. Same policy digest d13f4367…, new session, new profile.
  • validate.mjs pins the replacement claims — the v0.2.35 floor, stay hosted-only, the "What did not run" instruction, and the REVIEW_REQUIRED ceiling — so a future bump cannot quietly restore the old wording.

Validation

  • npm testCodeTruss Claude, Codex, and Agent Skills packages validated.
  • npm run release:verifyCodeTruss plugin release archives are byte-for-byte reproducible.

Both re-run against the committed tree, not just the working copy.

Not done deliberately

No version bump and no tag. v0.1.7 is the founder's call, so package.json, package-lock.json, and all three manifests stay at 0.1.6 and validate.mjs still enforces that they agree.

Summary by CodeRabbit

  • Documentation

    • Updated the minimum supported CodeTruss CLI version to v0.2.35.
    • Documented expanded local JavaScript, TypeScript, and TSX security analysis, including SQL injection and mass-assignment checks.
    • Clarified hosted-only rules, supported boundaries, cross-file analysis limitations, and non-blocking REVIEW_REQUIRED local findings.
    • Added guidance for inferred allow policies and presenting suggested fixes without automatic application.
  • Validation

    • Updated validation requirements to reflect the latest CLI version and security reporting guidance.

@coderabbitai

coderabbitai Bot commented Aug 7, 2026

Copy link
Copy Markdown

Review Change Stack

Warning

Review limit reached

@DeliriumPulse, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 48 minutes

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: f01466e1-5e97-4ffe-9b91-ffb88d475dad

📥 Commits

Reviewing files that changed from the base of the PR and between 6ad0e75 and 1f5d810.

📒 Files selected for processing (7)
  • README.md
  • plugins/codetruss-claude/README.md
  • plugins/codetruss-claude/skills/codetruss/SKILL.md
  • plugins/codetruss/README.md
  • plugins/codetruss/skills/codetruss/SKILL.md
  • scripts/validate.mjs
  • skills/codetruss/SKILL.md
📝 Walkthrough

Walkthrough

The PR updates CodeTruss CLI documentation from v0.2.30 to v0.2.35. It documents local JavaScript and TypeScript SAST coverage, hosted-only boundaries, receipt reporting, non-blocking findings, and safe suggested-fix handling. Validation checks now enforce the revised guidance.

Changes

CodeTruss documentation updates

Layer / File(s) Summary
CLI version requirements and checks
README.md, plugins/*/README.md, plugins/*/skills/codetruss/SKILL.md, skills/codetruss/SKILL.md, scripts/validate.mjs
Documentation and validation now require and verify CodeTruss CLI v0.2.35.
Local SAST and receipt boundaries
README.md, plugins/*/skills/codetruss/SKILL.md, skills/codetruss/SKILL.md, scripts/validate.mjs
The documentation describes local JavaScript, TypeScript, and TSX checks, hosted-only analysis, receipt boundaries, and REVIEW_REQUIRED local findings.
Review policy and suggested-fix guidance
plugins/*/skills/codetruss/SKILL.md, skills/codetruss/SKILL.md
The skill guidance distinguishes inferred allow scopes from declared policies and prohibits automatic application of suggested fixes.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly identifies the CLI version update and the detection-boundary correction, which are the main changes in the pull request.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch chore/cli-0.2.35

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

The skill and READMEs said a local run never performs injection or taint
analysis. As of CLI v0.2.35 that is false: the shared SAST engine and its
source-to-sink taint tracking run locally over JavaScript, TypeScript and TSX,
covering SQL injection, mass assignment, un-awaited database writes, swallowed
errors, coercion-prone `==`, and N+1 queries in loops. Leaving the old sentence
in place would have the agent tell developers their code was never checked for
a class the CLI now checks.

What is still hosted is now stated precisely instead of categorically: the rest
of the rule pack, every non-JavaScript language, and the symbol graph. The skill
directs the agent to read the receipt's own "What did not run" section rather
than assert either boundary from memory, since it moves.

Also new, and both verified against the 0.2.35 tarball rather than the
changelog:

- v0.2.32 infers the scope of a turn when no allow policy exists and marks those
  files `allowed (inferred)`. A clean first run now exits 0 where it used to
  exit 1, so the skill says to treat an inferred allow as weaker evidence than a
  declared boundary.
- v0.2.34 attaches a Suggested fixes section to some findings. The skill says to
  present and never auto-apply one, and to keep rotation first for a credential,
  whose diff is masked and cannot apply cleanly by design.

Local security findings are REVIEW_REQUIRED at most and never fail a verdict on
their own; the skill now says so, so an agent does not escalate one as blocking.

The CLI floor and the "verified against" line move to v0.2.35 across the
canonical skill and all three READMEs. Every documented command was rechecked
against `--help` from the real 0.2.35 binary and still holds, including
`verify-policy trust-key`, which 0.2.35 now lists in its own banner.

The README's verbatim receipt excerpt is a real 0.2.35 run reproducing the same
scenario, not the 0.2.30 capture edited by hand — same policy digest
d13f4367…, new session, new profile `local-registry-v2`.

validate.mjs pins the replacement claims so the next version bump cannot quietly
restore the old wording: the v0.2.35 floor, `stay hosted-only`, the instruction
to read "What did not run", and the REVIEW_REQUIRED ceiling.

No version bump and no tag: v0.1.7 is the founder's call.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 3

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@plugins/codetruss-claude/README.md`:
- Around line 22-24: Update scripts/validate.mjs in its README validation logic
to deterministically assert the corrected security-boundary wording in
plugins/codetruss-claude/README.md: require the v0.2.35 local JavaScript,
TypeScript, and TSX security-pass wording and the hosted “What did not run” gap,
while rejecting stale or incomplete text. Keep the existing version and
installation checks intact.

In `@README.md`:
- Around line 90-102: The local security receipt under “What the local security
pass checked” is incomplete. Update the README receipt to match the exact
v0.2.35 wording and include un-awaited database writes, swallowed errors,
coercion-prone ==, and N+1 queries alongside SQL injection and mass assignment,
while preserving the excluded-rule scope documented elsewhere.

In `@scripts/validate.mjs`:
- Around line 22-32: Update the validation assertions around the existing
canonical skill-line checks in scripts/validate.mjs to also require the README
and skill text covering JavaScript, TypeScript, and TSX coverage, the complete
local rule list, and excluded hosted categories. Use exact string assertions
matching the documented boundary wording so removal or alteration of those lines
causes validation to fail.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 0838dc0d-7999-44b1-bf56-45b88caf9823

📥 Commits

Reviewing files that changed from the base of the PR and between 6ad0e75 and 2d5971c.

📒 Files selected for processing (7)
  • README.md
  • plugins/codetruss-claude/README.md
  • plugins/codetruss-claude/skills/codetruss/SKILL.md
  • plugins/codetruss/README.md
  • plugins/codetruss/skills/codetruss/SKILL.md
  • scripts/validate.mjs
  • skills/codetruss/SKILL.md

Comment thread plugins/codetruss-claude/README.md
Comment thread README.md
Comment thread scripts/validate.mjs
… pass

The README calls this block a verbatim excerpt, and the two security sections
were trimmed. That trim cut in the wrong direction twice: the local pass looked
like it checks two rule classes when it checks six, and the gap list looked like
two items when it is five.

Understating what runs is the same category of error as overstating it, and this
repository exists to keep the skill from doing either. Both sections are now
quoted whole, and verified equal to the real 0.2.35 receipt after normalizing
line wrapping rather than by eye.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@DeliriumPulse
DeliriumPulse merged commit 806c12b into main Aug 7, 2026
4 checks passed
@DeliriumPulse
DeliriumPulse deleted the chore/cli-0.2.35 branch August 7, 2026 05:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant