Skip to content

Actions: livekit/agents

Actions

evals

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
evals.yml
2,500+ workflow runs
2,500+ workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Report a declined phone number as not-reserved, not a generic tool error evals #9982: Pull request #6801 synchronize by u9g
1m 14s fix/phone-decline-not-reserved
fix/phone-decline-not-reserved
1m 14s
fix(hotel_receptionist): stop book_room offering views a room type doesn't have evals #9981: Pull request #6804 opened by u9g
1m 27s fix/book-room-single-room-flow
fix/book-room-single-room-flow
1m 27s
chore(deps): update github actions evals #9980: Pull request #5488 synchronize by renovate Bot
1m 16s renovate/github-actions
renovate/github-actions
1m 16s
fix(hotel_receptionist): give card capture a no-usable-card exit evals #9979: Pull request #6803 opened by u9g
1m 22s fix/get-card-no-usable-card
fix/get-card-no-usable-card
1m 22s
feat(evals): run judges at low inference priority (#6794) evals #9978: Commit 2f29ed8 pushed by u9g
1m 21s main
main
1m 21s
fix(hotel_receptionist): stop the restaurant flow implying a table it never reserved evals #9977: Pull request #6800 synchronize by u9g
1m 28s fix/restaurant-phone-declined
fix/restaurant-phone-declined
1m 28s
fix(hotel_receptionist): say a refused confirm booked nothing evals #9976: Pull request #6802 opened by u9g
1m 27s fix/hotel-refusal-states-outcome
fix/hotel-refusal-states-outcome
1m 27s
Report a declined phone number as not-reserved, not a generic tool error evals #9975: Pull request #6801 opened by u9g
1m 29s fix/phone-decline-not-reserved
fix/phone-decline-not-reserved
1m 29s
fix(hotel_receptionist): stop the restaurant flow implying a table it never reserved evals #9974: Pull request #6800 opened by u9g
1m 30s fix/restaurant-phone-declined
fix/restaurant-phone-declined
1m 30s
fix(hotel_receptionist): pair near-miss rows in the expected-state diff evals #9973: Pull request #6799 opened by u9g
1m 31s fix/hotel-diff-pair-rows
fix/hotel-diff-pair-rows
1m 31s
fix(google): replay Gemini realtime tool result across session restart evals #9972: Pull request #6481 synchronize by ByteMaster-1
1s ByteMaster-1:fix/gemini-realtime-tool-update
ByteMaster-1:fix/gemini-realtime-tool-update
1s
feat(evals): run judges at low inference priority evals #9971: Pull request #6794 synchronize by u9g
1m 32s fix/drop-hotel-judge-group
fix/drop-hotel-judge-group
1m 32s
soniox: add reduce_silence option to TTS evals #9970: Pull request #6798 opened by razvanvoica
6s razvanvoica:soniox-tts-reduce-silence
razvanvoica:soniox-tts-reduce-silence
6s
fix(hotel_receptionist): don't pass simulation runs the grading never checked evals #9969: Pull request #6797 opened by u9g
1m 26s fix/hotel-grading
fix/hotel-grading
1m 26s
feat(hotel_receptionist): add say_goodbye_and_close_call evals #9968: Pull request #6796 opened by u9g
1m 31s feat/hotel-say-goodbye-close-call
feat/hotel-say-goodbye-close-call
1m 31s
feat(evals): run judges at low inference priority evals #9967: Pull request #6794 opened by u9g
1m 30s fix/drop-hotel-judge-group
fix/drop-hotel-judge-group
1m 30s
feat(voice): phrase-based backchannel filter for STT interruptions (backchannel_phrases) evals #9966: Pull request #6750 synchronize by ajayarora1235
1s ajayarora1235:feat/backchannel-interruption-phrases
ajayarora1235:feat/backchannel-interruption-phrases
1s
fix(rime): remove Arcana model support evals #9965: Pull request #6773 synchronize by naszzz
1s naszzz:rime-arcana-migration
naszzz:rime-arcana-migration
1s
feat(voice): phrase-based backchannel filter for STT interruptions (backchannel_phrases) evals #9964: Pull request #6750 synchronize by ajayarora1235
1s ajayarora1235:feat/backchannel-interruption-phrases
ajayarora1235:feat/backchannel-interruption-phrases
1s
fix(realtime): support externally transcribed user turns evals #9963: Pull request #6786 synchronize by TonyG-FWE
1s TonyG-FWE:fix/issue-5408-google-realtime-external-input
TonyG-FWE:fix/issue-5408-google-realtime-external-input
1s
fix(rime): remove Arcana model support evals #9962: Pull request #6773 synchronize by naszzz
1s naszzz:rime-arcana-migration
naszzz:rime-arcana-migration
1s
feat(voice): phrase-based backchannel filter for STT interruptions (backchannel_phrases) evals #9961: Pull request #6750 synchronize by ajayarora1235
8s ajayarora1235:feat/backchannel-interruption-phrases
ajayarora1235:feat/backchannel-interruption-phrases
8s
fix(realtime): support externally transcribed user turns evals #9960: Pull request #6786 synchronize by TonyG-FWE
1s TonyG-FWE:fix/issue-5408-google-realtime-external-input
TonyG-FWE:fix/issue-5408-google-realtime-external-input
1s
fix(voice): enforce interruption min_duration on STT transcript triggers (#3515) evals #9959: Pull request #6417 synchronize by dorukdumlu
1s dorukdumlu:fix/min-interruption-duration
dorukdumlu:fix/min-interruption-duration
1s
fix(cartesia): narrow aligned_transcript when timestamps unsupported (#6493) evals #9958: Pull request #6735 synchronize by dorukdumlu
1s dorukdumlu:fix/tts-aligned-transcript-capability
dorukdumlu:fix/tts-aligned-transcript-capability
1s