Skip to content

docs: note severity floor in controller runbook - #355

Merged
ecv merged 1 commit into
mainfrom
docs/326-runbook-severity-floor
Aug 13, 2026
Merged

docs: note severity floor in controller runbook#355
ecv merged 1 commit into
mainfrom
docs/326-runbook-severity-floor

Conversation

@ecv

@ecv ecv commented Aug 12, 2026

Copy link
Copy Markdown
Contributor

Runbook companion to #354, the severity-floor proposal for #326.

Updates the controller-health runbook to describe the proposed behavior: the critical tier requires an absolute error rate above roughly one error per minute in addition to the 50% ratio, and a sparse, permanently-failing controller latches at warning instead of paging. Points latched 100%-ratio warnings at the existing orphan guidance.

Hold for #354 agreement.

Document the absolute error-rate floor on the critical reconcile-error
alert proposed for #326. Critical now requires both a >50% error ratio
and roughly one error per minute sustained; the warning tier keeps no
floor. A sparse controller failing a handful of orphaned objects pins
its ratio at 100% but latches at warning instead of paging on-call.

Key changes:
- Critical "Meaning" gains the error-rate floor condition
- Explain why a sparse permanently-failing controller warns, not pages
- Point latched 100%-ratio warnings at the existing orphan guidance
@ecv
ecv requested a review from scotwells August 12, 2026 16:57
@ecv
ecv marked this pull request as ready for review August 12, 2026 16:57
@ecv
ecv requested a review from aflor024 August 12, 2026 20:05
@ecv
ecv enabled auto-merge August 13, 2026 01:58
@ecv
ecv requested a review from kevwilliams August 13, 2026 01:58
@ecv
ecv merged commit 09db98f into main Aug 13, 2026
13 of 16 checks passed
@ecv
ecv deleted the docs/326-runbook-severity-floor branch August 13, 2026 02:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants