Skip to content

chore: bump promptfoo to 0.126 and fix evals advisories - #96

Merged
katodea merged 1 commit into
trunkfrom
update/promptfoo-0.126
Nov 19, 2026
Merged

katodea merged 1 commit into
trunkfrom
update/promptfoo-0.126

Conversation

@katodea

@katodea katodea commented Nov 19, 2026

Copy link
Copy Markdown
Collaborator

closes #93, closes #94, closes #95

what

why

every open dependabot alert for evals/ is a transitive dep, all pulled in by promptfoo. promptfoo 0.126.0 already asks for the patched ranges, and npm audit fix cleans up the rest:

trunk: 13 vulnerabilities (1 critical, 5 high, 6 moderate, 1 low)
this branch: found 0 vulnerabilities

checks:

  • node --test "tests/*.test.js": 716/716
  • npm run eval: 60/60 passed, 0 errors, on both Opus 5 and Opus 5.5 ($7.48, 1.51M tokens)

co-authored by claude opus 5.5 🧹

@katodea katodea self-assigned this Nov 19, 2026
@t51eng-poseidon

Copy link
Copy Markdown

🔱 Poseidon started reviewing this PR — central run.

@t51eng-poseidon t51eng-poseidon Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔱 Poseidon Review

No issues found on this pass. The bump only touches the evals tooling: promptfoo moves to 0.126.0 (its engines still asks for Node >=22.22.0, so the evals root's engines is unchanged), the pinned @anthropic-ai/claude-agent-sdk 0.3.312 is untouched in the lockfile, and the README's new cost figures add up ($4.70 + $2.80 = $7.50).


ℹ️ Review info
  • Commit: 61ca227
  • Files reviewed: evals/package.json, evals/README.md, evals/package-lock.json (root and the promptfoo/agent-sdk entries)
  • Files skipped: none (lockfile transitive entries not reviewed line by line, since they're generated)
  • Model: claude-opus-5-5

@katodea
katodea merged commit abefe05 into trunk Nov 19, 2026
3 checks passed
@katodea
katodea deleted the update/promptfoo-0.126 branch November 19, 2026 17:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant