LLM speculative inference server for heterogeneous hardware & consumer GPUs
Community benchmarks and scripts for running Poolside Laguna S 2.1
LLM speculative inference server for heterogeneous hardware & consumer GPUs
Community benchmarks and scripts for running Poolside Laguna S 2.1