iammrduncan / inference-benchmarks

git clone https://github.com/iammrduncan/inference-benchmarks.git

This is a LLM Gateway that mimics typesafe ai structured output. Like an imposter Jev.