[observability] Observability Coverage Report - 2026-04-10

[github-actions[bot]]

Executive Summary

Observability coverage is healthy for completed runs in the last 7 days. I analyzed 23 downloaded runs and scoped coverage metrics to 18 completed runs to avoid false positives from active executions.

For completed runs, AWF Firewall coverage is 100% (18/18 with access.log) and MCP telemetry coverage is 100% (18/18 with rpc-messages.jsonl and/or gateway.jsonl). There are no critical gaps that would block debugging for completed executions.

Key Alerts and Anomalies

No critical issues detected for completed runs.

🔴 Critical Issues:

• None in completed runs.

⚠️ Warnings:

• Firewall quality signal is uneven: 12/18 completed firewall runs had only allowed traffic and no blocked events, which limits deny-path validation.
• One completed MCP-enabled run had telemetry file presence but zero parsed MCP events/tool calls: §24268687288.
• 5 runs are currently in_progress; they were excluded from coverage scoring.

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	18	18	100.0%	✅
MCP Gateway (gateway.jsonl or rpc-messages.jsonl)	18	18	100.0%	✅

📋 Detailed Run Analysis

Firewall-Enabled Runs

Workflow	Run ID	access.log	Entries	Allowed	Blocked	Status
Daily Code Metrics and Trend Tracking Agent	§24265057747	✅	2135	2135	0	⚠️
Test Quality Sentinel	§24265062816	✅	256	256	0	⚠️
Design Decision Gate 🏗️	§24265062820	✅	40	40	0	⚠️
Daily Compiler Quality Check	§24265352804	✅	323	323	0	⚠️
AI Moderator	§24265366529	✅	30	28	2	✅
Smoke Service Ports	§24265515497	✅	58	58	0	⚠️
Daily Safe Outputs Conformance Checker	§24266157056	✅	75	75	0	⚠️
Draft PR Cleanup	§24266184302	✅	35	35	0	⚠️
Daily Secrets Analysis Agent	§24266776783	✅	138	138	0	⚠️
AI Moderator	§24267460827	✅	54	52	2	✅
AI Moderator	§24267625243	✅	44	42	2	✅
Daily Safe Output Integrator	§24268061641	✅	90	90	0	⚠️
AI Moderator	§24268427715	✅	25	23	2	✅
Daily Project Performance Summary Generator (Using MCP Scripts)	§24268687288	✅	264	264	0	⚠️
AI Moderator	§24268763025	✅	28	26	2	✅
Test Quality Sentinel	§24268819383	✅	155	155	0	⚠️
Design Decision Gate 🏗️	§24268819392	✅	53	53	0	⚠️
AI Moderator	§24268940756	✅	32	30	2	✅

Missing Firewall Logs (access.log)

None in completed runs.

MCP-Enabled Runs

Workflow	Run ID	Telemetry Source	Entries	Servers	Tool Calls	Errors	Status
Daily Code Metrics and Trend Tracking Agent	§24265057747	rpc-messages.jsonl	8	1	8	0	✅
Test Quality Sentinel	§24265062816	rpc-messages.jsonl	2	1	2	0	✅
Design Decision Gate 🏗️	§24265062820	rpc-messages.jsonl	4	2	4	0	✅
Daily Compiler Quality Check	§24265352804	rpc-messages.jsonl	3	2	3	0	✅
AI Moderator	§24265366529	rpc-messages.jsonl	4	2	4	0	✅
Smoke Service Ports	§24265515497	rpc-messages.jsonl	1	1	1	0	✅
Daily Safe Outputs Conformance Checker	§24266157056	rpc-messages.jsonl	1	1	1	0	✅
Draft PR Cleanup	§24266184302	rpc-messages.jsonl	3	2	3	0	✅
Daily Secrets Analysis Agent	§24266776783	rpc-messages.jsonl	1	1	1	0	✅
AI Moderator	§24267460827	rpc-messages.jsonl	11	2	11	0	✅
AI Moderator	§24267625243	rpc-messages.jsonl	13	2	13	0	✅
Daily Safe Output Integrator	§24268061641	rpc-messages.jsonl	1	1	1	0	✅
AI Moderator	§24268427715	rpc-messages.jsonl	4	2	4	0	✅
Daily Project Performance Summary Generator (Using MCP Scripts)	§24268687288	rpc-messages.jsonl	0	0	0	0	⚠️
AI Moderator	§24268763025	rpc-messages.jsonl	4	2	4	0	✅
Test Quality Sentinel	§24268819383	rpc-messages.jsonl	2	1	2	0	✅
Design Decision Gate 🏗️	§24268819392	rpc-messages.jsonl	9	2	9	0	✅
AI Moderator	§24268940756	rpc-messages.jsonl	7	2	7	0	✅

Missing MCP Telemetry (no gateway.jsonl or rpc-messages.jsonl)

None in completed runs.

🔍 Telemetry Quality Analysis

Firewall Log Quality

• Total access.log entries analyzed: 3,835
• Domains accessed: 7 unique
• Blocked requests: 12 (0.31%)
• Most accessed domains: github.com, api.githubcopilot.com, api.anthropic.com

Gateway Log Quality

• Telemetry source usage: rpc-messages.jsonl on all completed MCP-enabled runs; gateway.jsonl not observed in this sample window
• Total MCP telemetry entries analyzed: 78
• MCP servers used: github (50 calls), safeoutputs (28 calls)
• Error rate: 0% in parsed MCP failure metrics
• Average response time: N/A (duration not derivable from this parsed rpc summary)

Healthy Runs Summary

• Completed runs with complete firewall and MCP telemetry coverage: 18/18
• Completed runs with agent logs (agent-stdio.log, agent_output.json, safe output JSONL): 18/18

Recommended Actions

1. Add an explicit deny-path canary check in selected daily workflows so blocked firewall events are consistently exercised and logged.
2. Add a lightweight MCP telemetry quality assertion (entries > 0 when MCP is configured) to catch no-op telemetry cases like §24268687288.
3. Track preferred gateway.jsonl adoption as a separate metric while continuing to treat rpc-messages.jsonl as valid fallback coverage.

📊 Historical Trends

Historical trend comparison was not computed in this run because prior-day observability snapshots were not loaded in this analysis context.

References:

• §24268687288
• §24268940756
• §24269234240

Generated by Daily Observability Report for AWF Firewall and MCP Gateway · ◷

• expires on Apr 11, 2026, 11:53 PM UTC

[github-actions[bot]]

This discussion has been marked as outdated by Daily Observability Report for AWF Firewall and MCP Gateway.

A newer discussion is available at Discussion #25860.