v0.8.0

XkunW released this 08 Jan 20:37

· 129 commits to main since this release

855ded1

What's Changed

SGLang is now supported as alternative inference engine backend
Abstract inference engine
Update config formats
Change model types to be dynamic for forward compatibility

Full Changelog: v0.7.3...v0.8.0

Contributors

Contributors

XkunW

Assets 2