本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
UK postcode & geolocation API, serving up open data
A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.
Bud Decision studio is an easy to use cross platform desktop application & serving system for Jev like models locally.