Skip to content

fix(skills/review-loop): make review-comment replies a mandatory, ungated trace#16

Merged
sourcehawk merged 2 commits into
mainfrom
fix/review-loop-mandatory-reply-trace
May 31, 2026
Merged

fix(skills/review-loop): make review-comment replies a mandatory, ungated trace#16
sourcehawk merged 2 commits into
mainfrom
fix/review-loop-mandatory-reply-trace

Conversation

@sourcehawk
Copy link
Copy Markdown
Owner

Description

The review-loop skill could finish a round having addressed every comment in code but left no reply on the review threads — losing the trace of why each comment was actioned or rejected. The root cause was in the skill's text: the GitHub-mutation discipline section lumped replying and resolving together with pushing and requesting the reviewer under one confirmation gate, so an agent either paused to ask permission before each reply or batch-deferred and dropped them. This makes the reply a mandatory, ungated part of the loop.

Changes

  • Split ## GitHub-mutation discipline into two action classes: replying and resolving are how the loop records a decision already made — mandatory and never confirmation-gated, in every context; pushing and (re-)requesting the reviewer keep the confirmation gate.
  • Rewrote Step 5 to sequence each comment explicitly: address → commit → reply (naming the fix) → resolve, and forbid resolving a thread without a reply.
  • Adjusted Step 6 so it no longer re-states "commit" (Step 5 now commits per comment; Step 6 only pushes).
  • Added two red-flag rows for the rationalizations the baseline produced: "replying is a mutation, confirm first" and "the diff shows what changed".

Testing

Followed the superpowers:writing-skills RED → GREEN loop. Baseline subagents (run isolated from the repo's skill ecosystem) given the original text either gated replies behind a confirmation prompt or batch-deferred them. With the revised text, both an interactive-context and an autonomous-fan-out subagent posted a reply to every comment ungated, while still confirming the push and re-request. Grepped the skill for repo/product leakage (none) and read the diff cold.

…ated trace

The GitHub-mutation discipline section lumped replying-in-threads and
resolving-threads together with pushing and requesting the reviewer
under one confirmation gate. Because a reply was treated as a gated
mutation, the loop either paused to ask permission before every reply
or batch-deferred and dropped them — losing the human-readable trace of
why each comment was actioned or rejected.

Split the section by action class. Replying and resolving are how the
loop records a decision already made: mandatory and never
confirmation-gated, in every context. Pushing and (re-)requesting the
reviewer keep the confirmation gate. Step 5 now sequences address ->
commit -> reply -> resolve explicitly and forbids resolving without a
reply. Added red-flag rows for the two rationalizations the baseline
produced.
Copilot AI review requested due to automatic review settings May 31, 2026 02:57
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the review-loop skill so every review comment gets an explicit threaded reply before resolution, preserving the reasoning trail for accepted and rejected feedback.

Changes:

  • Makes replies and thread resolution mandatory and ungated.
  • Clarifies that pushing and reviewer re-requests still require confirmation in interactive contexts.
  • Adds red flags for skipping replies or treating replies as confirmation-gated mutations.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread skills/review-loop/SKILL.md Outdated
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings May 31, 2026 03:00
@sourcehawk sourcehawk merged commit 06bd300 into main May 31, 2026
@sourcehawk sourcehawk deleted the fix/review-loop-mandatory-reply-trace branch May 31, 2026 03:01
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants