Blaze Livekit plugin integration by HoangPN711 · Pull Request #5050 · livekit/agents

HoangPN711 · 2026-03-09T15:01:57Z

Summary

Add Blaze plugin support for LiveKit Agents.

Changes

add Blaze STT plugin
add Blaze TTS plugin
add Blaze LLM plugin
add Blaze plugin packaging/config helpers
add Blaze plugin README

Motivation

Enable Blaze voice AI services to be used through the existing LiveKit Agents plugin architecture.

Notes

The implementation is isolated under livekit-plugins/livekit-plugins-blaze and follows the existing provider plugin pattern.

CLAassistant · 2026-03-09T15:02:08Z

All committers have signed the CLA.

HoangPN711 · 2026-05-05T23:09:30Z

Hi @tinalenguyen,

This PR adds the Blaze provider integration for LiveKit Agents and keeps the implementation scoped under livekit-plugins/livekit-plugins-blaze.

It follows the existing STT/TTS/LLM plugin structure used by other provider integrations. I’ve also addressed the outstanding review comments on the PR.

Would appreciate a review when you have time. Thanks!

tinalenguyen · 2026-05-13T00:43:59Z

hi @HoangPN711! thank you for the contribution, could you bump the version and add the plugin to this pyproject file

HoangPN711 · 2026-05-13T23:17:54Z

Hi @tinalenguyen , thanks for reviewing this PR!

Updated as requested:

Bumped livekit-plugins-blaze to 1.5.9 (aligned with the current livekit-agents release)
Added blaze = ["livekit-plugins-blaze>=1.5.9"] to livekit-agents/pyproject.toml

Please let me know if any further changes are needed.

Devin: SpeechStream._run set closing_ws when the input channel drained but never closed the WebSocket, so async-for on recv hung until task cancel. After end_input, wait a short grace for trailing finals then close the WS so _run completes cleanly on intentional shutdown.

Devin: empty pcm path returned alternatives=[], while all other paths return one SpeechData — callers that index alternatives[0] crash. Return a single empty SpeechData (text="", confidence=0.0) for shape parity. Update unit test.

The gateway protocol (and agents-js) does not define a speech-start acknowledgement. Unconditional recv after speech-start either stalled until idle timeout (60s) when the server waits for a query, or dropped the first status/audio frame when pipelined. Let the normal reader loop handle whatever follows speech-start.

- Emit END_OF_SPEECH on SpeechStream teardown if speaking and no final arrived (grace close / peer drop left the user turn open). - Normalize api_url (config + STT/TTS/LLM constructors) so trailing slashes never produce //v1/... HTTP paths.

trunghlt · 2026-08-10T20:28:07Z

Hi @tinalenguyen — friendly re-review nudge when you have a moment.

Status on 6ae1f7da7:

CI green: ruff, unit-tests, type-check (3.10/3.13), blockguard, release gate, CLA
Devin Review SUCCESS (latest findings addressed; remaining E501 note is a false positive — E501 ignored project-wide and line is exactly 100 chars)
Prior review points from your 2026-07-24 pass remain addressed (blaze.vn URLs, authors, py.typed, PCM→WAV via rtc.AudioFrame.to_wav_bytes(), framework SentenceTokenizer, tests)
MERGEABLE; only blocked on review approval

Happy to address any further feedback. Thanks!

trunghlt · 2026-08-12T21:15:29Z

Hi @tinalenguyen — friendly re-review nudge when you have a moment.

Status on 6ae1f7da7:

CI green: ruff, unit-tests, type-check (3.10/3.13), blockguard, release gate, CLA
Devin Review SUCCESS (latest findings addressed; remaining E501 note is a false positive — E501 ignored project-wide and ruff is green)
Branch is MERGEABLE with main
Prior review feedback (README/blaze.vn, authors, py.typed, PCM→WAV, tokenizer) already addressed in earlier commits

Happy to rebase or take any further feedback. Thanks!

Keep main's plugin optional-deps pins at 1.6.10 and re-add blaze entry. Bump livekit-plugins-blaze to 1.6.10 to match workspace pins.

trunghlt · 2026-08-13T05:19:06Z

Automated fix: resolved merge conflicts with origin/main (1.6.10).

Kept main’s optional-deps pins at >=1.6.10 / browser >=0.2.10
Re-added blaze = ["livekit-plugins-blaze>=1.6.10"]
Bumped livekit-plugins-blaze to 1.6.10 to match workspace pins

Head: eb3f6b1af

Prevent asyncio "exception was never retrieved" when the background reader already failed before finally cancel.

trunghlt · 2026-08-13T20:17:42Z

Follow-up for Devin review: consume pending TTS audio reader_task exceptions after gracefully_cancel so asyncio does not later log "exception was never retrieved" when the reader already failed (e.g. ConnectionClosed). See be86781702ce1daa9a7eef2d68235388400fe21c.

- Fall back to default when BLAZE_API_URL is empty/whitespace - Raise APIConnectionError(retryable=False) when auth token missing for STT stream (and TTS if same pattern)

- Regenerate uv.lock for livekit-plugins-blaze workspace member - Validate Blaze API/WS base URL has an absolute host - Avoid echoing raw auth handshake payloads/tokens in STT errors

trunghlt · 2026-08-13T22:20:25Z

Babysit fix for latest Devin findings: a284fc0b493f5e745ba9cdce75ac4104c6ee2170 — URL host/scheme validation, STT/TTS error redaction, and uv.lock confirmation for livekit-plugins-blaze.

trunghlt · 2026-08-13T22:22:29Z

Fixed CI ruff format on livekit-plugins-blaze/.../_utils.py (collapsed multi-line ValueError to match ruff line-length formatting).

Verified uv.lock already lists livekit-plugins-blaze as a workspace member (uv lock is a no-op); prior commit message mentioned refreshing the lock but the package entry was already present from earlier workspace work.

Match one-shot TTS: raise non-retryable APIConnectionError before opening the WS auth handshake with an empty token.

Route non-200 response text through existing redact helpers so bearer tokens echoed by gateways do not land in exception messages.

- Raise retryable error if audio reader finishes while text still pending - Route TTS WS error bodies through secret-redaction helpers

trunghlt · 2026-08-14T21:15:56Z

Hi @tinalenguyen — friendly re-review nudge when you have a moment.

Status on d7f8622e1:

CI green: ruff, unit-tests, type-check (3.10/3.13), blockguard, release gate, CLA
Devin Review SUCCESS
Branch is MERGEABLE with main
Prior review feedback (README/blaze.vn, authors, py.typed, pcm→wav via AudioFrame.to_wav_bytes, TTS tokenizer) remains addressed

Happy to address any new feedback. Thanks!