ollama / ollama
Runs open-weight LLMs such as Gemma, Qwen, DeepSeek, and gpt-oss locally or in the cloud, with a CLI, REST API, and Python and JavaScript libraries.
ollama / ollama
hiyouga / LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
1Panel-dev / MaxKB
🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
emcie-co / parlant
Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.
bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
InternLM / lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
SciSharp / LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
NVIDIA-NeMo / Automodel
🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
qualcomm / GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
b4rtaz / distributed-llama
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
AI-Hypercomputer / maxtext
A simple, performant, and scalable Jax LLM!
aws-samples / generative-ai-use-cases
Application implementation with business use cases for safely utilizing generative AI in business operations
EmbeddedLLM / JamAIBase
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.
agents-flex / agents-flex
Agents-flex is A lightweight Java AI agent development framework (positioned as a counterpart to Spring AI). It supports features such as RAG, MCP, Skills, Text2SQL , LLM Wiki, Sub-agents, Web Search, TTS (synchronous and streaming), and STT.
vincenzo-afk / Lucie-AI
A real-time 2D Live AI companion powered by Groq (LLaMA 3.3 & Whisper) and Live2D Hiyori Pro.
47thtechcorner / RayCodes_Kronos
Kronos AI: Tiny Model That Beats Expensive Trading Bots - Open-source foundation model for financial candlesticks with Ollama Llama 3.2 Indian market analysis.
linkedin / Liger-Kernel
Efficient Triton Kernels for LLM Training