Smoke Test Results
Overall status: ❌ FAIL
Validation of the Claude engine via the native external threat-detect path (features: gh-aw-detection: true).
| # |
Test |
Result |
| 1 |
Read latest 2 PRs |
✅ PASS |
| 2 |
make test succeeds |
❌ FAIL |
| 3 |
Create artifacts dir (aw-prompts/prompt.txt, agent_output.json) |
✅ PASS |
| 4 |
./bin/threat-detect --version |
✅ PASS |
| 5 |
Write status file |
✅ PASS |
Details
- Test 1 ✅ — Latest 2 PRs in
github/gh-aw-threat-detection:
- Test 2 ❌ —
make test exited with error. Test TestRunWarnsOnUnwritableStepSummary in cmd/threat-detect timed out after 10m0s and panicked. The stack trace shows it hung inside analyzeWithRetries → copilotEngine.Analyze → runCLIEnvWithSink, waiting on a real node/copilot engine subprocess (os/exec Cmd.Wait, 9 minutes) that never returned. All other packages passed (artifacts, detector, engine, runlog, stepsummary).
- Test 3 ✅ — Created
/tmp/gh-aw/smoke-claude-standalone-31034550307/aw-prompts/prompt.txt and agent_output.json.
- Test 4 ✅ — Binary was missing; built via
make build, then threat-detect 0caa4f9.
- Test 5 ✅ — Status file written to
/tmp/gh-aw/agent/smoke-claude-standalone-31034550307.txt.
Run URL: https://github.com/github/gh-aw-threat-detection/actions/runs/31034550307
Timestamp: 2026-08-05T18:36:56Z
Generated by Smoke Claude Standalone Latest · sonnet46 · 42 AIC · ⌖ 47.4 AIC · ⊞ 4.5K · ◷
Smoke Test Results
Overall status: ❌ FAIL
Validation of the Claude engine via the native external threat-detect path (
features: gh-aw-detection: true).make testsucceedsaw-prompts/prompt.txt,agent_output.json)./bin/threat-detect --versionDetails
github/gh-aw-threat-detection:make testexited with error. TestTestRunWarnsOnUnwritableStepSummaryincmd/threat-detecttimed out after 10m0s and panicked. The stack trace shows it hung insideanalyzeWithRetries→copilotEngine.Analyze→runCLIEnvWithSink, waiting on a realnode/copilot engine subprocess (os/exec Cmd.Wait, 9 minutes) that never returned. All other packages passed (artifacts,detector,engine,runlog,stepsummary)./tmp/gh-aw/smoke-claude-standalone-31034550307/aw-prompts/prompt.txtandagent_output.json.make build, thenthreat-detect 0caa4f9./tmp/gh-aw/agent/smoke-claude-standalone-31034550307.txt.Run URL: https://github.com/github/gh-aw-threat-detection/actions/runs/31034550307
Timestamp: 2026-08-05T18:36:56Z