πŸ“ˆ GH Trending Explorer 🎲 Surprise me

Search: vllm-omni Β· clear

vllm-project / vllm-omni

A framework for efficient model inference with omni-modality models

β–² ~84/7d β˜… 7.3k Python today
InferMatrixLab / system1-omni

community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance

β–² ~5/7d β˜… 62 Rust today
joeynyc / MiniMax-H3-DGX-Spark

Measured SM121 compatibility recipe for MiniMax H3 FL2VA on one NVIDIA DGX Spark with vLLM-Omni and online FP8.

β–² ~0/7d β˜… 61 Python 1d ago
InferMatrixLab / vllm-omni-mlx

High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.

β–² ~0/7d β˜… 26 Python 2d ago