Skip to content

[BOT ISSUE] Together: missing provider for 3 models + missing gemma-4-31b-it entry #675

@github-actions

Description

@github-actions

Gap

Three models in the catalog are available on Together AI's serverless API but don't list together in their available_providers. Additionally, one model (google/gemma-4-31b-it) is entirely absent from the catalog.

Models needing together added to available_providers

Model ID Current providers Together pricing (input/output per MTok)
MiniMaxAI/MiniMax-M2.5 (line 10019) ["baseten"] $0.30 / $1.20
zai-org/GLM-5 (line 9794) ["baseten"] $1.00 / $3.20
moonshotai/Kimi-K2.6 (line 5498) ["baseten"] $1.20 / $4.50

Note: Together pricing differs from the existing baseten pricing for some of these models (e.g., zai-org/GLM-5 is $0.95/$3.15 on baseten vs $1.00/$3.20 on Together). Adding together to available_providers will use the existing entry's pricing, which may not match Together's pricing. Whether provider-specific pricing variants are needed is a design decision.

Missing model entry

Model ID Provider Pricing (input/output per MTok)
google/gemma-4-31b-it together $0.39 / $0.97

The Together pricing page lists "Gemma 4 31B" at $0.39/$0.97. The model is available as a serverless chat model. No google/gemma-4-31b-it or pearl-ai/gemma-4-31b-it entry exists in the catalog.

Suggested new entry

"google/gemma-4-31b-it": {
  "format": "openai",
  "flavor": "chat",
  "input_cost_per_mil_tokens": 0.39,
  "output_cost_per_mil_tokens": 0.97,
  "displayName": "Gemma 4 31B IT",
  "available_providers": ["together"]
}

Official sources

Local files inspected

  • packages/proxy/schema/model_list.json — confirmed current available_providers for each model and absence of google/gemma-4-31b-it
{
  "kind": "missing_model",
  "provider": "together",
  "models": [
    "google/gemma-4-31b-it"
  ],
  "provider_additions": [
    {"model": "MiniMaxAI/MiniMax-M2.5", "add_provider": "together"},
    {"model": "zai-org/GLM-5", "add_provider": "together"},
    {"model": "moonshotai/Kimi-K2.6", "add_provider": "together"}
  ],
  "status": "active",
  "source_urls": [
    "https://docs.together.ai/docs/serverless-models",
    "https://www.together.ai/pricing"
  ]
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    autofix-blockedBot issue is blocked until metadata or source information is updated.

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions