Skip to content

devservices: add eval taskworker offset reset target#115555

Open
JoshFerge wants to merge 2 commits into
masterfrom
jferg-codex/evals-reset-taskworker-offset
Open

devservices: add eval taskworker offset reset target#115555
JoshFerge wants to merge 2 commits into
masterfrom
jferg-codex/evals-reset-taskworker-offset

Conversation

@JoshFerge
Copy link
Copy Markdown
Member

@JoshFerge JoshFerge commented May 14, 2026

Summary

  • add make devservices-evals-reset-taskworker-offset for local seeded eval runs
  • reset the local taskworker Kafka consumer group to latest after stopping taskbroker
  • clear taskbroker's local inflight store and restart eval taskworkers/taskbroker that were running

While debugging slow evals it was noticed sometimes the queues can get backlogged from old runs. this command helps us reset the queues before kicking off a fresh eval run

Verification

  • bash -n scripts/devservices/reset-evals-taskworker-offset.sh
  • make -n devservices-evals-reset-taskworker-offset

@github-actions github-actions Bot added the Scope: Backend Automatically applied to PRs that change backend components label May 14, 2026
@JoshFerge JoshFerge marked this pull request as ready for review May 14, 2026 15:14
@JoshFerge JoshFerge requested review from a team as code owners May 14, 2026 15:14
Copy link
Copy Markdown
Contributor

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit a029fef. Configure here.

Comment thread scripts/devservices/reset-evals-taskworker-offset.sh Outdated
Comment thread scripts/devservices/reset-evals-taskworker-offset.sh Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Scope: Backend Automatically applied to PRs that change backend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants