Describe the Issue
I want to use the vision capabilities from qwen-3-vl-embedding for embedding images/ocr, but there is no place in koboldcpp where I can load the embedding model's mmproj.
Request
Add a place to load the embedding model's mmproj in the interface.
Temporary workaround
Using llama.cpp, start a new server for both the embedding model + mmproj, and enable embeddings flag.
Then use that server for embedding instead of koboldcpp.
For testing, you can use:
Describe the Issue
I want to use the vision capabilities from qwen-3-vl-embedding for embedding images/ocr, but there is no place in koboldcpp where I can load the embedding model's mmproj.
Request
Add a place to load the embedding model's mmproj in the interface.
Temporary workaround
Using llama.cpp, start a new server for both the embedding model + mmproj, and enable embeddings flag.
Then use that server for embedding instead of koboldcpp.
For testing, you can use: