Skip to content

v0.1.0

Latest
Latest

Choose a tag to compare

View all tags
@Mattbusel Mattbusel released this 07 Mar 03:29
· 9 commits to main since this release
v0.1.0
bacef6d

Initial release. Five single-header C++ libraries for LLM inference: streaming, caching, cost estimation, retry/circuit-breaker, and structured output.

Assets 2
Loading