feat(requesty): add Requesty provider - #2435
Open
Thibaultjaigu wants to merge 1 commit into
Open
Conversation
Add Requesty (https://requesty.ai), an OpenAI-compatible LLM router, as a provider, mirroring the existing OpenRouter provider. - instructor/v2/providers/requesty/ (from_requesty factory + JSON-schema handler) - Provider.REQUESTY enum + get_provider URL detection - PROVIDER_SPECS spec entry + OpenAI-compat/parallel-tools registration - from_provider('requesty/<provider>/<model>') dispatch + _build_requesty - instructor.__init__ export + lazy import - docs/integrations/requesty.md + mkdocs nav + example + CHANGELOG Signed-off-by: Thibault Jaigu <thibault.jaigu@gmail.com>
This was referenced Jul 29, 2026
jxnl
added a commit
that referenced
this pull request
Aug 3, 2026
## Summary - accumulate declared, nested, and unknown numeric OpenAI/Anthropic usage fields across retries while preserving non-numeric metadata - add corrective feedback when a Responses API retry receives no tool call - preserve raw iterable type hints through sync and async v2 parallel-tool wrappers - strengthen API-key-free coverage for current and future SDK usage counters ## Consolidated and superseded items - closes #2493 - consolidates contributor work from #2498, #2500, and #2501 with original commit authorship preserved - supersedes #2497 because it drops unknown `model_extra` counters - supersedes #2499 because its hand-maintained provider field lists would drift as SDKs evolve ## Validation - focused changed-surface suite: `110 passed` - broad offline v2/coverage suite: `2368 passed, 91 skipped, 73 deselected` - Ruff check and format check: passed - scoped `ty check`: passed - `uv lock --check`: passed - pre-commit hooks and `git diff --check`: passed The 73 deselected tests require live provider credentials. An unfiltered local run confirmed its 22 failures were provider network connections in the restricted environment; GitHub provider jobs remain the authoritative validation for those paths. ## Intentionally skipped - provider additions or expansions: #2436, #2435, #2423, #2409, #2384, #2322, #2306, #2298, #2283, #2168, #2086; issues #2408, #2383, #2365, #2260, #2084, #2076 - broad architecture, product, security, or streaming decisions: #2394, #2392, #2357, #2356, #2355, #2351, #2321, #2307, #2287, #2263; issues #2479, #2403, #2393, #2391, #2316, #2272, #2056 - dependency batch: #2433 - nontrivial examples and editorial/resource additions: #2468, #2405, #2401, #2354, #2346, #2311, #2305; issue #2404 These remain open because they need dedicated product, architecture, provider, security, dependency, or editorial review and are not required for the `1.15.5` patch release. <!-- CURSOR_SUMMARY --> --- > [!NOTE] > **Medium Risk** > Changes retry usage totals and reask message content on failure paths; scope is limited and heavily covered by tests, with no auth or data-store changes. > > **Overview** > Bundles three v2 retry and wrapper fixes for a patch release. > > **Retry usage accounting** replaces hand-maintained token field sums with generic `_accumulate_models` on Pydantic usage objects. Numeric fields (including nested models and `model_extra` counters) add across retries; booleans and other non-numeric metadata are not treated as billable. OpenAI and Anthropic paths share this logic. > > **OpenAI Responses reask** appends a user correction when `RESPONSES_TOOLS` validation fails but the output has no tool calls (e.g. reasoning-only), so retries include feedback instead of repeating the same request. > > **Parallel tools** in `patch_v2` skips `prepare_response_model` and does not replace `response_model` with the handler’s prepared wrapper for parallel modes, keeping raw `Iterable[...]` hints so schemas and parsed results include every member type. > > <sup>Reviewed by [Cursor Bugbot](https://cursor.com/bugbot) for commit bbddca1. Configure [here](https://www.cursor.com/dashboard/bugbot).</sup> <!-- /CURSOR_SUMMARY -->
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds Requesty — an OpenAI-compatible LLM router — as a provider, mirroring the existing OpenRouter provider (
instructor/v2/providers/openrouter/). Requesty exposes 400+ models through one endpoint, addressed asprovider/model.Changes
instructor/v2/providers/requesty/—from_requesty()factory +RequestyJSONSchemaHandler(mirrors the OpenRouter provider; reuses the generic OpenAI-compatible JSON-schema wiring)instructor/v2/core/providers.py—Provider.REQUESTY+get_provider()URL detectioninstructor/v2/core/provider_specs.py—PROVIDER_SPECSentry (TOOLS / JSON_SCHEMA / MD_JSON / PARALLEL_TOOLS)instructor/v2/providers/openai/handlers.py— Requesty added to the OpenAI-compat + parallel-tools provider sets (same as OpenRouter)instructor/__init__.py— export + lazy import forfrom_requestyinstructor/v2/auto_client.py—_build_requesty()(base URLhttps://router.requesty.ai/v1, envREQUESTY_API_KEY) +requestyin the provider builders andsupported_providersdocs/integrations/requesty.md+mkdocs.ymlnav +examples/open_source_examples/requesty.py+ CHANGELOG entryTesting
Verified end-to-end through the real
from_provider("requesty/openai/gpt-4o-mini")code path against the live endpoint: a structured extraction into a Pydantic model returned the expected value.ruff checkis clean on the touched files.I work at Requesty. This mirrors the existing OpenRouter provider as closely as possible. Happy to adjust or close it if it's not a fit.