feat(providers): add Parasail serverless inference catalog - #5117
Open
Kaihuang724 wants to merge 5 commits into
Open
feat(providers): add Parasail serverless inference catalog#5117Kaihuang724 wants to merge 5 commits into
Kaihuang724 wants to merge 5 commits into
Conversation
Enable Parasail as an OpenAI-compatible provider and include its serverless model catalog so users can reference it via models.dev. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Kaihuang724
marked this pull request as draft
August 20, 2026 13:28
Contributor
Action items
|
- Update provider model list from the live /v1/models endpoint. - Remove obsolete models and add current serverless models. - Tighten base_model references and reasoning_options for new entries. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Kaihuang724
marked this pull request as ready for review
August 20, 2026 15:58
Contributor
Action items
|
…wire comments - Convert all nameable Parasail provider models to base_model references. - Add missing lab metadata under models/ for gemma-3, qwen3-vl, bge-m3, ui-tars, and community models served by Parasail. - Remove budget_tokens from GPT-OSS reasoning options; use effort only. - Correct base_model for qwen3-235b-a22b-instruct-2507 to the -instruct SKU. - Add leading wire-path comments for every reasoning option toggle/effort/budget. - Replace [] reasoning controls with lab/peer-aligned options for GLM, MiniMax, MiMo, and Kimi where controls are known. - Preserve or remove public pricing to match the prior catalog data. bun validate passes. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Contributor
Action items
|
…selines - Kimi K2.6: toggle-only (thinking.type), no invented effort. - Kimi K2.7 Code: always-on reasoning with no caller control. - Kimi K3: correct wire comments to thinking.type and output_config.effort. - GLM-5.1, MiMo-V2.5, MiniMax-M3: thinking.type toggle comments. - Add models/meta/llama-3.2-3b-instruct.toml and point Parasail SKU at it. - Vary newly added community lab limits so they are not copy-pasted. bun validate passes. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Contributor
Action items
|
…d costs - Point Parasail Muse Glimmer at the canonical meta/muse-glimmer-30b lab (delete the duplicate models/muse stub) and use effort low|medium|high|xhigh. - Reuse the existing thedrummer/unslopnemo-12b lab (delete mlabonne stub). - Drop BGE-M3 (embedding SKU, not in chat catalog semantics). - Update Gemma 4 entries to toggle per first-party/peer baseline. - Update Qwen3.8-27B to peer toggle + effort low|medium|xhigh. - Simplify Qwen3.5-9B to toggle-only and add peer-sourced cost. - Add peer-sourced costs for GLM-5.2, Kimi K3/K2.7 Code, MiniMax-M3, UI-TARS, Mistral Nemo, Llama 3.2 3B Instruct, Gemma 3 4B Instruct. - Add text-only/missing-structured-output overrides for Parasail Gemma-3 SKUs. - Mark remaining public-but-unpriced SKUs as intentionally unpriced. bun validate passes. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Contributor
Action items
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
@ai-sdk/openai-compatibleprovider backed byhttps://api.parasail.io/v1.base_modelreferences to canonical lab metadata.costandreasoning_optionsfor publicly priced / controllable SKUs; mark intentionally unpriced entries.Data sources and claim mapping
https://api.parasail.io/v1/models(live list)models/directory + first-party lab entriesreasoning_effort = low|medium|high(per OpenAI GPT-OSS docs / peers)thinking.type = enabled|disabled,reasoning_effort(DeepSeek first-party + OpenRouter peers)enable_thinking/thinking_budget(Qwen first-party + OpenRouter peers)enable_thinking/reasoning_effort = low|medium|xhigh(OpenRouter peers)thinking.type+output_config.effort = low|high|max(OpenRouter peers)thinking.type = enabled|disabled(first-party docs + OpenRouter peers)thinking.type) per Google first-party + OpenRouter peersIntentionally unpriced on Parasail (public pricing not available)
Provider changes
base_modelreferences and created missing lab stubs where needed.models/muse/glimmer-30bandmodels/mlabonne/unslopnemo-12bstubs in favor ofmeta/muse-glimmer-30bandthedrummer/unslopnemo-12b.reasoning_optionsand wire comments to match the lab/peer control surface.costfrom OpenRouter peers for unpriced public SKUs with a leading source comment.Test plan
bun validatepassesGenerated with Devin