tashfeenahmed / freellmapi

Self-hosted OpenAI-compatible proxy that routes requests across free-tier LLM providers with failover and encrypted key storage.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

elie222 / rakazo

Self-hosted AI agent platform with persistent bots, sandboxed computers, and bring-your-own model, available on web, Electron, and mobile.

ranxianglei / billion-context

A TypeScript proxy plugin that sits between coding agents and model APIs, compressing conversation history into reversible layered summaries.

alibaba / open-code-review

Go-based AI code review CLI that runs deterministic pipelines alongside an LLM agent to leave line-level review comments on Git diffs.

anthropics / claude-code

Agentic coding tool that runs in your terminal, reads your codebase, and executes coding and git tasks from natural language commands.

GCWing / OpenBitFun

Open-source desktop agent workspace built on a Rust agent runtime, with four harness modes and cross-device remote control.

CopilotKit / OpenBot

Self-hostable template for AI coworkers that each get their own browser, files, and tools, with actions gated before and logged after.

BerriAI / litellm

Python SDK and self-hostable proxy server that calls 100+ LLM providers through a unified OpenAI-compatible API.

rikkahub / rikkahub

Native Android chat client for LLMs that switches between multiple AI providers within conversations.

ggml-org / Llama-Windows

Windows 11 system tray app for running llama.cpp models locally with a flyout chat interface and Hugging Face model downloads.

ddalcu / mlx-serve

Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.

wangzhishou / OneBox

Android app combining an AI agent that runs 90+ built-in tools with image, document, productivity and daily utility tools.

ed-donner / llm_engineering

Jupyter notebooks and code accompanying Ed Donner's 8-week LLM engineering course, from local models through building LLM applications.

monoscope-tech / monoscope

Open-source observability platform that ingests logs, traces, and metrics into your own S3 buckets and lets you query them in natural language.

techjarves / Uncensored-Local-AI-Multiplatform

A Flutter app that runs GGUF language models fully offline on Android, iOS, and desktop, with an optional local OpenAI-compatible API.

jihe520 / MathModelAgent

An agent and skill set that automates mathematical modeling competitions, producing a complete, submission-ready paper.

techjarves / Mobile-Harness

Android app that runs coding agents like Claude Code on-device, with an Ubuntu PRoot Linux environment for editing files, running commands, and previewing web apps.

olimorris / codecompanion.nvim

A Neovim plugin for AI-assisted coding with LLMs and agents, including chat, inline edits, and Agent Client Protocol support.