Unified framework for building enterprise RAG pipelines with small, specialized models
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
An open source extension that connects AI agents to computational notebooks in JupyterLab.
Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP/A2A Support
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration
handwritten harness for AI, not vibecoded, everything is a module/plugin, tailor made for use with local models, tiny system prompt (around 1k by default), support for exclusive llamacpp features, strong security, strict zero-trust-in-the-ai policy (the code hard limits the ai, no amount of prompt engineering will bypass it)
Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.
macOS Hermes skill for sharing one canonical writable profile across Buzz and ACP surfaces
Restore full Google Chrome hardware acceleration (OpenGL, WebGL, WebGPU) on legacy Mac GPUs running macOS Sequoia & Sonoma via OCLP
Independent, focused OpenCore Legacy Patcher derivative for advanced Custom Mac / Hackintosh systems, providing Modern Wi-Fi (Broadcom & Intel), AppleHDA root patching and Broadcom AWDL/Continuity features including AirDrop, AirPlay, Screen Mirroring, Continuity Camera and Personal Hotspot on macOS Tahoe.