This service is responsible for handling the LLM requests and responses.
- Install dependencies:
uv syncMake sure to have the LLM models installed in your environment which includes - gemma3:1b, qwen3:4b, qwen2.5-coder:0.5b
- Run the service:
python app/llm_service.py