Support further AI services

[m-1-k-3]

since chatgpt openai is a paid service it would be great to have deepseek or gemini api too.

Originally posted by @pedramasl in #1837

[m-1-k-3]

Module Q02 could be used as a template. Should not be too hard to extract and adjust the relevant code areas

• OpenAI
• Deepseek
• Gemini
• Grok

[github-actions]

This issue is stale because it has been open for 28 days with no activity.

[jblu42]

It would be also great to support Claude and/or local LLMs, so a generic approach to configure the API URL probably would be best.

[github-actions]

This issue is stale because it has been open for 28 days with no activity.

[m-1-k-3]

Probably we should go into a token free direction without the need of payments for results. Which local LLMs have you guys already used for our needed tasks like source code analysis?

[jblu42]

It´s not the question of the LLM, but the tool running the LLM. So far for local stuff I have used OLLAMA, which is very easy to set up, download local models.
It offers an API which is usually running on http://127.0.0.1:11434

It just takes the prompt, I think the only main difference is, that you have to set the model in the API query

https://github.com/ollama/ollama/blob/main/docs/api.md

[jblu42]

As for the model this heavily depends on your hardware, GPU, RAM, anything that is fit for coding