Smoke Test: Claude - 22306576814 #17916
Description
Summary
Overall Status: PARTIAL — Core tests passed, Serena find_symbol unavailable (MCP EOF), PR review threads skipped (none exist), close PR skipped (no test PR).
PR used for review tests: #17911 — "Expand RuntimeConfig and RuntimesConfig typed structs to cover all supported runtimes and fields"
Run: §22306576814
Timestamp: 2026-02-23T12:49Z
Core Test Results
| # | Test | Status | Notes |
|---|---|---|---|
| 1 | GitHub MCP: Review last 2 merged PRs | ✅ | PR #17901, PR #17897 |
| 2 | SafeInputs GH CLI: Query 2 PRs | ✅ | PR #17911, PR #17910 |
| 3 | Serena MCP: activate_project + find_symbol | activate_project ✅ — find_symbol ❌ (EOF on all attempts) |
|
| 4 | Make Build | ✅ | go build succeeded, binary produced |
| 5 | Playwright: navigate to github.com | ✅ | Title: "GitHub · Change is constant..." |
| 6 | Tavily: Search "GitHub Agentic Workflows" | ✅ | 5 results returned |
| 7 | File Writing: create smoke test file | ✅ | /tmp/gh-aw/agent/smoke-test-claude-22306576814.txt |
| 8 | Bash: verify file creation | ✅ | cat confirmed contents |
| 9 | Discussion: get latest + add comment | ✅ | Discussion #17913, comic-book comment added |
| 10 | Agentic Workflows MCP: smoke-claude status | ✅ | status=active, compiled=Yes, engine=claude |
PR Review Safe Output Test Results
| # | Test | Status | Notes |
|---|---|---|---|
| 11 | Update PR body | ✅ | Appended test message to PR #17911 |
| 12 | Add review comments | ✅ | 2 inline comments on frontmatter_types.go and runtime_detection.go |
| 13 | Submit PR review | ✅ | COMMENT review submitted |
| 14 | Resolve review thread | Skipped — no existing review threads | |
| 15 | Add reviewer | ✅ | copilot added as reviewer |
| 16 | Push to PR branch | ✅ | Pushed smoke-test-pr-push-22306576814.sh to copilot/expand-runtime-config-structs |
| 17 | Close test PR | Skipped — no safe test/bot PR to close |
Serena MCP Error Details
activate_project succeeded and created project gh-aw at /home/runner/work/gh-aw/gh-aw.
All subsequent find_symbol calls (tried patterns: validate, Workflow, main, RuntimeConfig) failed with:
MCP error 0: connection closed: calling "tools/call": client is closing: EOF
check_onboarding_performed also failed with the same error. The Serena LSP server appears to start successfully but then closes the connection before symbol queries can complete.
Agentic Workflows Status
[{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active","time_remaining":"N/A","on":{"pull_request":{"names":["smoke"],"types":["labeled"]},"reaction":"heart","schedule":"every 12h","status-comment":true,"workflow_dispatch":null}}]💥 [THE END] — Illustrated by Smoke Claude
- expires on Feb 23, 2026, 2:53 PM UTC