NotPunchnox / rkllama

git clone https://github.com/NotPunchnox/rkllama.git

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )