Skip to content

feat(eval): online-insight update (P2) - #2069

Open
jariy17 wants to merge 2 commits into
feat/eval-online-insight-imperativefrom
feat/online-insight-update
Open

feat(eval): online-insight update (P2)#2069
jariy17 wants to merge 2 commits into
feat/eval-online-insight-imperativefrom
feat/online-insight-update

Conversation

@jariy17

@jariy17 jariy17 commented Aug 22, 2026

Copy link
Copy Markdown
Contributor

Draft · P2 of the online-insight stack. Stacked on #2067 (P1). Real-deploy bug bash pending before ready.

Command

agentcore eval online-insight update --id <id> [--sampling-rate] [--session-timeout-minutes] [--filters]
  [--insight <i...>] [--clustering-frequency <f...>] [--agent | --data-source-config] [--endpoint | --clear-endpoint]
  [--role-arn]

What

  • New eval online-insight update handler + updateOnlineInsight client method.
  • Merges over the current config (like online-eval update), sets insights/clusteringConfig (never evaluators), repoints the data source (agent | data-source | endpoint/clear-endpoint), and passes the caller --role-arn straight through.
  • No role re-scope machinery (no --update-role, no role-scope warning) — insight configs are BYO-role only.

Stack

P1 #2067P2 (this) → P3 online-eval BYO role → P4 TUI get/list (+ #2029). See the plan artifact.

Verification

tsc clean; golden test hierarchy updated to include update (19/19 replay). Update golden fixture + real-deploy bug bash: in progress.

Adds `eval online-insight update` + updateOnlineInsight client method:
merges over the current config, sets insights/clusteringConfig (never
evaluators), repoints the data source, and keeps the execution role
caller-supplied (no re-scope machinery — insight configs are BYO-only).
@github-actions github-actions Bot added the size/m PR size: M label Aug 22, 2026
@github-actions github-actions Bot added agentcore-harness-reviewing AgentCore Harness review in progress and removed agentcore-harness-reviewing AgentCore Harness review in progress labels Aug 22, 2026
@github-actions github-actions Bot added size/m PR size: M and removed size/m PR size: M labels Aug 22, 2026
@jariy17
jariy17 marked this pull request as ready for review August 22, 2026 15:56
@jariy17 jariy17 changed the title feat(eval): online-insight update (P2, draft) feat(eval): online-insight update (P2) Aug 22, 2026
@github-actions github-actions Bot added size/m PR size: M and removed size/m PR size: M labels Aug 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/m PR size: M

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant