[observability] Observability Coverage Report - 2026-04-09

[github-actions[bot]]

Executive Summary

Analyzed 31 workflow runs from the last 7 days. Firewall logging coverage is 67.7% (21/31) and MCP telemetry coverage is 100.0% (22/22).

The primary risk is firewall observability gaps: 10 firewall-enabled runs are missing access.log, which is a critical debugging artifact. MCP telemetry is present for all MCP-enabled runs via rpc-messages.jsonl fallback, with no runs missing both telemetry files.

MCP gateway JSONL was not present in this sample; coverage relies on rpc-messages.jsonl fallback. Due run-directory permissions on mcp-logs/*, quality checks for MCP used artifact manifests and run_summary.json metadata rather than raw JSONL parsing.

Key Alerts and Anomalies

🔴 Critical Issues:

• Missing firewall access.log: Daily Observability Report for AWF Firewall and MCP Gateway §24218897398
• Missing firewall access.log: Daily Semgrep Scan §24218852202
• Missing firewall access.log: GitHub API Consumption Report Agent §24218508186
• Missing firewall access.log: Test Quality Sentinel §24216575962
• Missing firewall access.log: Design Decision Gate 🏗️ §24216575979
• Missing firewall access.log: Design Decision Gate 🏗️ §24216473072
• Missing firewall access.log: Test Quality Sentinel §24216473075
• Missing firewall access.log: Test Quality Sentinel §24216374758
• Missing firewall access.log: Design Decision Gate 🏗️ §24216374780
• Missing firewall access.log: Agentic Workflow Audit Agent §24213291173

⚠️ Warnings:

• Firewall logs present but low diagnostic diversity (mostly allow traffic only): 20 run(s)
• MCP telemetry present but zero observed MCP tool calls in summary metadata: 3 run(s)

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	31	21	67.7%	🔴
MCP Gateway (gateway.jsonl or rpc-messages.jsonl)	22	22	100.0%	✅

Overall observability coverage across required artifacts: 81.1%

📋 Detailed Run Analysis

Firewall-Enabled Runs

Workflow	Run ID	access.log	Entries	Allowed	Blocked	Status
Daily Observability Report for AWF Firewall and MCP Gateway	§24218897398	❌	0	0	0	🔴
Daily Semgrep Scan	§24218852202	❌	0	0	0	🔴
AI Moderator	§24218700878	✅	28	26	2	✅
GitHub API Consumption Report Agent	§24218508186	❌	0	0	0	🔴
Auto-Triage Issues	§24218492541	✅	48	48	0	⚠️
Daily Project Performance Summary Generator (Using MCP Scripts)	§24218344006	✅	329	329	0	⚠️
Daily Safe Output Integrator	§24217597298	✅	476	476	0	⚠️
Auto-Triage Issues	§24217189212	✅	41	41	0	⚠️
Test Quality Sentinel	§24216575962	❌	0	0	0	🔴
Design Decision Gate 🏗️	§24216575979	❌	0	0	0	🔴
Design Decision Gate 🏗️	§24216473072	❌	0	0	0	🔴
Test Quality Sentinel	§24216473075	❌	0	0	0	🔴
Test Quality Sentinel	§24216374758	❌	0	0	0	🔴
Design Decision Gate 🏗️	§24216374780	❌	0	0	0	🔴
Daily Secrets Analysis Agent	§24216234477	✅	133	133	0	⚠️
Draft PR Cleanup	§24215531538	✅	110	110	0	⚠️
Daily Safe Outputs Conformance Checker	§24215498287	✅	34	34	0	⚠️
Daily Copilot Token Usage Audit	§24215197838	✅	763	763	0	⚠️
Smoke Service Ports	§24214844244	✅	55	55	0	⚠️
Daily Compiler Quality Check	§24214681690	✅	470	470	0	⚠️
Ubuntu Actions Image Analyzer	§24214662767	✅	449	449	0	⚠️
Daily Code Metrics and Trend Tracking Agent	§24214481003	✅	1408	1408	0	⚠️
Daily Malicious Code Scan Agent	§24214130546	✅	256	256	0	⚠️
Daily OTel Instrumentation Advisor	§24214062282	✅	234	234	0	⚠️
Go Logger Enhancement	§24214047937	✅	1042	1042	0	⚠️
Daily Regulatory Report Generator	§24213503346	✅	73	73	0	⚠️
Copilot CLI Deep Research Agent	§24213347890	✅	1198	1198	0	⚠️
Contribution Check	§24213317889	✅	70	70	0	⚠️
Agentic Workflow Audit Agent	§24213291173	❌	0	0	0	🔴
Design Decision Gate 🏗️	§24213247169	✅	17	17	0	⚠️
Test Quality Sentinel	§24213247187	✅	148	148	0	⚠️

Missing Firewall Logs (access.log)

Workflow	Run ID	Date	Link
Daily Observability Report for AWF Firewall and MCP Gateway	24218897398	2026-04-09	§24218897398
Daily Semgrep Scan	24218852202	2026-04-09	§24218852202
GitHub API Consumption Report Agent	24218508186	2026-04-09	§24218508186
Test Quality Sentinel	24216575962	2026-04-09	§24216575962
Design Decision Gate 🏗️	24216575979	2026-04-09	§24216575979
Design Decision Gate 🏗️	24216473072	2026-04-09	§24216473072
Test Quality Sentinel	24216473075	2026-04-09	§24216473075
Test Quality Sentinel	24216374758	2026-04-09	§24216374758
Design Decision Gate 🏗️	24216374780	2026-04-09	§24216374780
Agentic Workflow Audit Agent	24213291173	2026-04-09	§24213291173

MCP-Enabled Runs

Workflow	Run ID	Telemetry Source	Entries	Servers	Tool Calls	Errors	Status
AI Moderator	§24218700878	rpc-messages.jsonl	4	1	4	0	✅
Auto-Triage Issues	§24218492541	rpc-messages.jsonl	8	1	8	0	✅
Daily Project Performance Summary Generator (Using MCP Scripts)	§24218344006	rpc-messages.jsonl	0	0	0	0	⚠️
Daily Safe Output Integrator	§24217597298	rpc-messages.jsonl	1	0	1	0	✅
Auto-Triage Issues	§24217189212	rpc-messages.jsonl	8	1	8	0	✅
Daily Secrets Analysis Agent	§24216234477	rpc-messages.jsonl	1	0	1	0	✅
Draft PR Cleanup	§24215531538	rpc-messages.jsonl	3	1	3	0	✅
Daily Safe Outputs Conformance Checker	§24215498287	rpc-messages.jsonl	1	0	1	0	✅
Daily Copilot Token Usage Audit	§24215197838	rpc-messages.jsonl	5	0	5	0	✅
Smoke Service Ports	§24214844244	rpc-messages.jsonl	1	0	1	0	✅
Daily Compiler Quality Check	§24214681690	rpc-messages.jsonl	1	0	1	0	✅
Ubuntu Actions Image Analyzer	§24214662767	rpc-messages.jsonl	16	1	16	0	✅
Daily Code Metrics and Trend Tracking Agent	§24214481003	rpc-messages.jsonl	8	0	8	0	✅
Daily Malicious Code Scan Agent	§24214130546	rpc-messages.jsonl	1	0	1	0	✅
Daily OTel Instrumentation Advisor	§24214062282	rpc-messages.jsonl	1	0	1	0	✅
Go Logger Enhancement	§24214047937	rpc-messages.jsonl	3	1	3	0	✅
Daily Regulatory Report Generator	§24213503346	rpc-messages.jsonl	2	1	2	0	✅
Copilot CLI Deep Research Agent	§24213347890	rpc-messages.jsonl	0	0	0	0	⚠️
Contribution Check	§24213317889	rpc-messages.jsonl	3	1	3	0	✅
Agentic Workflow Audit Agent	§24213291173	rpc-messages.jsonl	7	1	7	0	✅
Design Decision Gate 🏗️	§24213247169	rpc-messages.jsonl	0	0	0	0	⚠️
Test Quality Sentinel	§24213247187	rpc-messages.jsonl	8	1	8	0	✅

Missing MCP Telemetry (no gateway.jsonl or rpc-messages.jsonl)

None.

🔍 Telemetry Quality Analysis

Firewall Log Quality

• Total access.log entries analyzed: 7382
• Domains accessed: 7 unique
• Blocked requests: 2 (0.03%)
• Most accessed domains: github.com (478), api.githubcopilot.com (374), api.anthropic.com (258), pypi.org (3), chatgpt.com (1)

Gateway Log Quality

• Telemetry source observed: rpc-messages.jsonl (canonical fallback) in all MCP-enabled runs
• Total MCP-enabled runs: 22
• Total MCP tool calls observed (summary metadata): 82
• MCP servers used: agenticworkflows, github, mcpscripts
• Error events in MCP failure logs: 0
• Average response time: N/A (raw rpc-messages content not readable in current environment permissions)

Healthy Runs Summary

• Runs with healthy firewall+MCP observability status: 1 of 31

Recommended Actions

1. Enforce artifact upload of firewall-audit-logs/logs/access.log for all firewall-enabled runs, including failed/cancelled paths.
2. Add a post-job observability check that fails runs when firewall is enabled but access.log is missing, or when MCP is enabled but both telemetry files are missing.
3. Promote gateway.jsonl generation consistently (while keeping rpc-messages.jsonl fallback) and expose parseable latency/error metrics in run_summary.json.

📊 Historical Trends

• Single-window snapshot only (last 7 days in current download). No prior-window baseline loaded in this report run.

References:

• §24218897398
• §24218852202
• §24218508186

Generated by Daily Observability Report for AWF Firewall and MCP Gateway · ◷

• expires on Apr 10, 2026, 11:55 PM UTC

[github-actions[bot]]

This discussion has been marked as outdated by Daily Observability Report for AWF Firewall and MCP Gateway.

A newer discussion is available at Discussion #25723.