fix(ollama-cloud): correct 3 context_lengths, add 3 served-but-missing tags - #5109
Open
mikkihugo wants to merge 2 commits into
Open
fix(ollama-cloud): correct 3 context_lengths, add 3 served-but-missing tags#5109mikkihugo wants to merge 2 commits into
mikkihugo wants to merge 2 commits into
Conversation
Values taken from the provider itself via ollama.com/api/show, which reports model_info.<family>.context_length. glm-5.2 976_000 -> 1_000_000 minimax-m3 512_000 -> 524_288 nemotron-3-nano:30b 1048576 -> 262144 nemotron-3-nano:30b is the consequential one: the recorded value is 4x the real window, so a client sizing requests from it overruns and the provider rejects them.
Contributor
Action items
|
Contributor
There was a problem hiding this comment.
Pull request overview
Updates the ollama-cloud provider catalog to match the actual served context windows reported by Ollama’s api/show, preventing clients from constructing requests that exceed the provider-enforced limits.
Changes:
- Correct
limit.contextforglm-5.2to1_000_000. - Correct
limit.contextforminimax-m3to524_288. - Correct
limit.contextfornemotron-3-nano:30bto262_144.
Reviewed changes
Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| providers/ollama-cloud/models/nemotron-3-nano:30b.toml | Reduce limit.context to the provider-reported 262,144 tokens to prevent request overruns. |
| providers/ollama-cloud/models/minimax-m3.toml | Adjust limit.context to 524,288 to match api/show. |
| providers/ollama-cloud/models/glm-5.2.toml | Increase limit.context to 1,000,000 to match api/show. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
Comment on lines
12
to
14
| [limit] | ||
| context = 1048576 | ||
| context = 262144 | ||
| output = 131072 |
Comment on lines
11
to
+12
| [limit] | ||
| context = 976_000 No newline at end of file | ||
| context = 1_000_000 No newline at end of file |
GET https://ollama.com/v1/models lists these three; the database has no entry. deepseek-v4-pro:0813 context 1048576 deepseek-v4-pro:preview context 524288 <- half the stable tag deepseek-v4-flash:preview context 1048576 Contexts read from https://ollama.com/api/show, the same source the existing deepseek-v4-flash:0731 entry cites. Output mirrors context, following every other deepseek entry under this provider; api/show reports no max output, so that field is convention rather than API-verified.
Contributor
Action items
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
All values read from the provider via
ollama.com/api/show, the same source the existingdeepseek-v4-flash:0731entry already cites.1. Corrected
limit.context(3 models)glm-5.2minimax-m3nemotron-3-nano:30bnemotron-3-nano:30bis the one that bites: the recorded window is 4x the real one, so a client sizing requests from this database overruns the model and the provider rejects the request. I hit exactly that in practice before checking against the API.2. Added 3 tags that are served but not catalogued (new files)
GET https://ollama.com/v1/modelslists these three; the database had no entry.deepseek-v4-pro:0813deepseek-v4-pro:previewdeepseek-v4-flash:previewHow to reproduce
Observed:
I checked all 17 other
ollama-cloudentries the same way; they already match and are untouched.Scope notes
providers/ollama-cloud/is changed.minimax-m3is deliberately not aligned with the MiniMax entries.minimax/MiniMax-M3andminimax-coding-plan/MiniMax-M3are both 1,000,000, and Ollama genuinely serves a smaller window for the same model — the per-provider split here is correct, only the ollama-cloud number was off.outputon the corrected models is untouched:api/showreports no max output, so I have no provider-sourced value. On the three new filesoutputmirrorscontext, following every other deepseek entry under this provider; that field is convention, not API-verified.