Skip to content

[Feature] Vision projector for embedding models #1942

@MerijnHendriks

Description

@MerijnHendriks

Describe the Issue

I want to use the vision capabilities from qwen-3-vl-embedding for embedding images/ocr, but there is no place in koboldcpp where I can load the embedding model's mmproj.

Request

Add a place to load the embedding model's mmproj in the interface.

Temporary workaround

Using llama.cpp, start a new server for both the embedding model + mmproj, and enable embeddings flag.
Then use that server for embedding instead of koboldcpp.

For testing, you can use:

Metadata

Metadata

Assignees

No one assigned

    Labels

    KIV for nowSome issues prevent this from being merged

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions